Etl Ab Initio Projects
Looking for freelance Etl Ab Initio jobs and project work? PeoplePerHour has you covered.
Power BI Developer
Key Responsibilities: Develop functional & operational reports & dashboards. Build automated reports and dashboards with the help of Power BI and other reporting tools. Understand business requirements to set functional specifications for reporting applications. Be experienced in tools and systems on MS SQL Server BI Stack, including SSRS and TSQL, Power Query, MDX, Power BI, and DAX Be able to quickly shape data into meaningful reports and analytics solutions. Have knowledge of database fundamentals such as multidimensional database design, relational database design, and more. Analyse data sources and ensure data quality and integrity. Design and develop efficient data models in Power BI, ensuring optimal performance and scalability. Transform raw data into meaningful insights by implementing appropriate data transformations. Develop visually appealing and user-friendly dashboards, reports, and interactive visualizations in Power BI. Implement complex calculations and custom measures to meet business requirements. Leverage DAX (Data Analysis Expressions) to create advanced calculations. Integrate data from various sources into Power BI, ensuring seamless connectivity and data refresh. Utilize Power Query to clean, transform, and shape data for reporting purposes. Collaborate with cross-functional teams, including business analysts, data engineers, and IT teams, to ensure alignment with overall business goals. Conduct regular stakeholder meetings to gather feedback and make necessary adjustments to BI solutions. Provide training and documentation for end-users to ensure effective use of Power BI reports and dashboards. Monitor and optimize the performance of Power BI reports and dashboards. Ability of learning new tools to enhance the data quality and visualizations. Qualifications and Skills: Bachelor’s degree in computer science, Information Systems, or a related field. Proven experience as a Power BI Developer or similar role. Strong knowledge on Azure Data Lake, Data Factory and other data services Strong proficiency in Power BI, including data modelling, DAX, and Power Query. Solid understanding of relational databases and SQL. Experience in ETL processes and data integration. Excellent analytical and problem-solving skills. Strong communication and collaboration skills. Ability to work independently and as part of a team. Preferred Qualifications: Microsoft Power BI certification. Experience with other BI tools (Tableau, QlikView, etc.). Knowledge of data warehousing concepts. Familiarity with cloud platforms (Azure, AWS) for BI solutions.
6 days ago18 proposalsRemote
Past "Etl-ab-initio" Projects
Python ETL Expert Needed for Data Transformation Project
Hello We're looking for a skilled Python ETL expert to assist us with a data transformation project. Our goal is to extract, transform, and load data from various sources into a structured format for analysis. We need someone with experience in automating ETL pipelines, handling data quality issues, and ensuring seamless integration. Key Responsibilities: Retrieve data from all sorts of places – databases, APIs, and flat files. Work on raw data, making it clean, consistent, and accurate. Handle missing values, normalize data, and some feature engineering. Load the transformed data where it belongs, ensuring it gets along with our storage solution. Test and validate, ensuring our data stays true to its transformed self. Proven experience in Python development with a focus on ETL processes Strong understanding of data extraction, transformation, and loading best practices. Previous success in automating ETL pipelines for efficient data processing. Excellent problem-solving skills and attention to detail. Python Expertise: Proven experience in Python development with a focus on ETL processes. A deep understanding of data extraction, transformation, and loading best practices. A track record of successfully automating ETL pipelines for efficient data processing. Excellent problem-solving skills and meticulous attention to detail. Delivarbles: structured and organized CSV files, each containing accurately transformed, structured data. An automated and efficient ETL pipeline that can be easily maintained. Regular updates on project progress, ensuring we're always on the same page. If you're a Python ETL expert looking for an engaging project, we'd love to hear from you! Please send a propsal detailing your relevant experience, a brief overview of your approach to ETL projects, and any examples of past work.
Can you give me property investment advice?
Hi, Can you help me with property investment advice? I have saved income from my salary over the years and I want to get smarter about how to use this to invest in the UK property market. I want advice on the best route to take - auction, buy to let etc. My main goals are to secure a dual income and investment ROI. I’ve optimised my ISA, pension etc. so looking towards holistic financial planning. Can you please send me a proposal for an initial 30-min consultation to discuss options? Happy to take your guidance on how to proceed with similar clientele. Thanks, Abs
pre-funded
Looking for Experienced Graphic Designer for Beach Flag Design
Hello, I am the owner of "DIN Bilskrot AB", a company that specializes in environmentally friendly car recycling. Right now I'm looking for a creative and experienced graphic designer who can help design a beach flag to be placed outside our business premises. Project description: Objective: Create an eye-catching and professional design for a beach flag that reflects our company's brand and eco-friendly values. Flag size: 690x2590 mm. Design elements: The company logo must be prominent, together with the company name "DIN Bilskrot AB". The flag must also include a welcoming slogan in Swedish ("Welcome to a greener future"), graphic elements related to the car scrapping industry (eg car components, recycling icons), and a call to action at the bottom of the flag. Color scheme: Shades of green consistent with the logo's color scheme, with the option of contrasting colors to increase visibility and legibility. Qualifications: Strong portfolio with previous work in graphic design, especially with outdoor advertising or similar projects. Ability to create visually appealing and clear design solutions. Good communication in Swedish and/or English. What we offer: Opportunity to work on a unique and environmentally conscious project. Fair and competitive compensation for your work. Potential continued collaboration for future design projects. If you are interested and think you match this description, please send a message with your portfolio and a brief introduction of yourself. Thank you for your time and look forward to hearing from you!
MERN Stack dev
Hello, I'm looking for an individual who can work with us on an ongoing basis on various POC projects we have going on. We're wanting to move forward with at least 2 ready to build sites/apps and have the figma designs ready to go. We would expect that you have extensive experience with React, Express and various related services/libraries as well as containerisation and deployment/orchestration techniques. This is crucial as we build our products in a micro-service manner using ECS and so, for example, we would expect our POCs to be built front/back/api etc.... A bonus would be an individual that has experience working with ETL and can work with our AI/ML engineer fairly closely. As well as having worked with Expo to deliver native apps. i would expect this person to join our slack organisation and be working with other devs and designers on an ongoing basis. For the right person there is plenty of new and ongoing work. A brilliant english/native english speaker, high availability in terms of communication and can show verified examples of previous work.
I'm wondering if you can help
I'm wondering if you can help. I'm looking for a UK-based virtual assistant / admin support. Asks will mainly be research based once or twice a week. It could be anything from doing data entry tasks to booking tickets or internet research. I'd then hope to pay you an hourly rate for how long it takes you to do such activities. Not urgent but are you up for it? Can I share more details? Abs
Web Data Scraping and Automation Developer - Python
We are seeking an experienced developer for a web data scraping and automation project. The project involves extracting specific data from multiple URLs, and we are looking for a reliable, long-term developer with expertise in Python and Selenium. Project Details: Objective: Extract specific data from a list of URLs where the data is visible only after redirection. URL Sample: Caterpillar battery patents: [URL](https://ppubs.uspto.gov/pubwebapp/external.html?q=(CATERPILLAR.AS.)AND((BATTERY.TTL.)OR(BATTERIES.TTL.)OR((BATTERY%20ADJ%20ELECTRIC).AB.)OR((BATTERY%20ADJ%20PACK).AB.)OR((HIGH%20ADJ%20VOLTAGE%20ADJ%20BATTERY).AB.)OR((BATTERY%20ADJ%20ELECTRIC).DETD.)OR((BATTERY%20ADJ%20PACK).DETD.)OR((HIGH%20ADJ%20VOLTAGE%20ADJ%20BATTERY).DETD.)OR((CELL%20ADJ%20CHEMISTRY).DETD.)OR((BATTERY%20ADJ%20MANAGEMENT).DETD.))&db=USPAT Volvo battery patents: [URL](https://ppubs.uspto.gov/pubwebapp/external.html?q=(((AB%20ADJ%20VOLVO).AS.)OR((VOLVO%20ADJ%20CONSTRUCTION).AS.))AND((BATTERY.TTL.)OR(BATTERIES.TTL.)OR((BATTERY%20ADJ%20ELECTRIC).AB.)OR((BATTERY%20ADJ%20PACK).AB.)OR((HIGH%20ADJ%20VOLTAGE%20ADJ%20BATTERY).AB.)OR((BATTERY%20ADJ%20ELECTRIC).DETD.)OR((BATTERY%20ADJ%20PACK).DETD.)OR((HIGH%20ADJ%20VOLTAGE%20ADJ%20BATTERY).DETD.)OR((CELL%20ADJ%20CHEMISTRY).DETD.)OR((BATTERY%20ADJ%20MANAGEMENT).DETD.))&db=USPAT Data Extraction: Extract specific data as shown in the attached screenshot. Approach: Store URLs in a CSV file and iterate through each URL. Concatenate values based on the header in a data frame. Requirements: Proficiency in Python and Selenium for web scraping and automation. Experience with similar web scraping projects. Reliability and a long-term commitment, as we have similar projects planned for the future. How to Apply: If you meet the above requirements and have experience with similar web scraping jobs, please submit your proposal. Include details of your relevant experience, your approach to this project, and any relevant references. We look forward to working with a skilled developer for this and future projects. -Manish
An ETL Project in PySpark
I was looking at your profile and your skills match the requirements I am looking for an ETL Project I am working on, it will only require 2hours of work. Unfortunately the deadline is Tuesday so would love your help asap.
opportunity
Python Programmer with Music Theory for MIDI File Generation
This project involves the development of a Python script for generating MIDI files, specifically designed for ear training. The focus is on creating a comprehensive collection of 4-note sequences, meticulously labelled and structured in accordance with music theory. This includes a thorough exploration of all possible note variations, starting from every note between C4 and B4. Requirements: 1. Script Development: • Develop a user-friendly and adaptable Python script for MIDI file generation. 2. MIDI File Specifications: • Sequence Composition: Each MIDI file will contain a 4-note sequence. • Key Signature Determination: The first note, within the Middle C octave (C4 to B4), sets the key signature for the sequence. Every possible starting note between C4 and B4 must be explored to include all the potential key signatures (majors: C, G, D, A, E, B, F#, F, Bb, Eb, Ab, Db, Gb) . • Note Movement: Include all possibilities (25) for each subsequent note, allowing movements up, down, or remaining the same, encompassing all interval leaps within an octave. • Guitar Range Compatibility: Ensure all sequences are within the guitar's easily playable range, typically E2 to E5, covering all possible variations within these parameters. 3. File Naming and Organization: • Naming Convention: Files named according to note names (e.g., A, B, G#, Db, etc.), with 'M' for melodic and 'H' for harmonic versions. Sequences must be spelt in accordance with the key signature. Indicate pitch movement between notes with an appropriate symbol indicating whether the note is higher or lower than the previous one and no mark for repeated notes. • Organizational Structure: Files should be categorized into multiple folders using music theory for easy access and efficient organization using the interval leaps in the sequence. 4. Instrument Setting: • Set all MIDI files to use an Acoustic Grand Piano sound for consistency. 5. Tempo and Rhythm (for Melodic Files): • Tempo: 120 BPM. • Note Duration: Crotchets (quarter notes). 6. Documentation: • Provide a comprehensive and user-friendly README file detailing the script's functionality, usage, and dependencies. Deliverables: 1. A Python script for MIDI file generation. 2. Sample sets of both melodic and harmonic MIDI files for initial review. 3. A well-organized collection of MIDI files, sorted into multiple folders. 4. Source code with detailed comments. 5. A thoroughly documented README file. Timeframe: • Expected completion within 4 weeks. Ideal Candidate: • Proficient in Python, with an understanding of music theory, especially in relation to MIDI and key signatures. • Capable of creating a broad range of MIDI sequences, both melodic and harmonic, encompassing all possibilities within the defined parameters. • Strong organizational skills for effective file management. • Excellent communication skills and adherence to project requirements.
opportunity
CI/CD Pipeline Implementation Requirement Specification
Project: ETL, Reporting and Workflow Application – UK Based Consultancy 1. Introduction We are seeking a qualified service provider to assist in the setup and configuration of a robust CI/CD (Continuous Integration/Continuous Deployment) pipeline for our software project. The purpose of this specification is to outline our project's requirements and expectations for the CI/CD pipeline implementation. 2. Project Overview The PHP / Laravel based application is currently an inventory database with some specialist capabilities for IT Network Management and its roadmaps is to work towards becoming a full CMDB solution with advanced data integrity, integration, data visualisation and workflow capabilities. 3. Scope of Work The scope of work for this CI/CD pipeline implementation includes, but is not limited to, the following components: 3.1. Source Code Management (SCM) Integration o Integrate the CI/CD pipeline with our existing GitHub repository for version control. o Automate triggers for builds and deployments based on code commits and merges. 3.2. Build and Deployment Automation • Implement automated build processes for application. • Set up deployment automation to various environments, including development, testing, and production. 3.3. Automated Testing • Automate unit tests, integration tests, security scans, and other relevant tests as needed. • Ensure compatibility with Selenium for automated functional testing. • Configured test will be provided however please let us know if you have in house experience of configuring test and UAT testing services separately. 3.4. Documentation Management • Automate documentation updates based on code changes and new software versions. • Ensure seamless integration with our existing documentation repository (In House Development) 3.5. Release Management • Implement versioning and release processes, including automatic generation of release notes. • Configured versioning and tagging process in coordination with documentation updates. 3.6. Integration with Third-Party Tools • Integrate with AWS for automated resource provisioning and management. • Ensure integration with SonarQube for code quality analysis. • Include integration to PHP based document management portal • Ensure integration to Selenium • Ensure integration to SourceGuardian 3.7. Notifications and Reporting • Set up notifications for build and deployment status. • Generate and distribute reports on test results, code quality, and pipeline performance. 3.8. Knowledge Transfer • Provide comprehensive documentation of the CI/CD pipeline setup and configuration. • Conduct knowledge transfer sessions for our internal team for ongoing maintenance and support. 4. Project Timeline ASAP 4. Required Contract Base Fixed Price against agreed deliverables in Statement of Work. 5.Provider Qualifications Evidence of completion of successful similar projects including access to case studies and references. 7. Evaluation Criteria We will evaluate potential providers based on their experience, expertise, proposed approach, references, timeline, and budget.
opportunity
I want to build a ETL sytem
Hi! I'm looking for some help for a smaller project. I want to build a web application which lets users send data to bigquery from their different marketing platforms via api's. Interested? Ping and I will let you know some more details. Something similar as - https://www.catchr.io/destinations/big-query https://supermetrics.com/products/bigquery
Database analyst
We are currently recruiting for an experienced Database Analyst. As a successful candidate, you will be responsible for database support and analytics, integration management and creating & maintaining dashboards. You have in-depth experience with database management Systems, BI software, SQL Server, and solid ability in integrating, analyzing, interpreting, reporting, and disseminating data. This role is located in Edmonton, AB., and does have hybrid working permissions (work form office/work from home) for eligible candidates.
Regular help with email marketing to push leads down funnel
I work for a weight loss company and need regular help with nurturing our growing database of leads. We offer a premium service and looking for help to set up automated email and seasonal emails to help with conversions. • Plan and implement email nurture workflows and campaigns that engage and drive customers and leads down each stage of the funnel • Methodically test and identify best performing content, timing, messages, etc. for each audience and lead segment • Strategize, plan, and ideate new ideas for email initiatives, from one-off campaigns to email automation • Manage email initiatives from the ideation phase to execution, and be involved in every stage including outlines for copy, design suggestions, and tasks for the development team • Plan and conduct AB tests on email campaigns to continually optimize performance • Report on the performance of email initiatives You'll get design support and technical support, and must be able to work with Hubspot.
opportunity
Expert in Tableau
I need an EXPERT in Tableau who can take data concepts and transform them into Tableau design based on scope of the project. Please DO NOT apply if you have ONLY worked on basic drag & drop designs. We would like a partner who we can call upon on a regular basis. Your skills: Tech: understand ETL process, understand sql db, able to extract data using custom sql, Design: Tableau skill sets to create calculations, Immediate need: We have a 1-2 day project to take data that needs transforming via custom SQL and design, custom calcs
Fintech (Embedded finance) and DLT (blockchain)
Expertise required for a fintech (Embedded finance) and DLT (blockchain) project. Required experience includes business ‘light paper’ support and process flow design by analysts and architects with a deep understanding of ‘in-database’ blockchain, blockchain oracles, reverse ETL, data science, analytics and related areas. Involvement in this project serves as precursor to flexible yet long terms engagement for successful applicants.
opportunity
Need a Professional to design a beautiful WordPress website
I need a designer who specializes in WordPress to create me an ecommerce store for a clothing store. Please send me your previous work/portfolio. And please include the word "chicken" at the top of the proposal. Many thanks, AB
Data Engineer
As a Data Engineer, you will be responsible for designing, developing, and maintaining the systems and infrastructure needed to process and manage large volumes of data. Your role will involve working with various data sources, transforming data into usable formats, and ensuring data quality and reliability. Additionally, you will collaborate with cross-functional teams to develop scalable data solutions and optimize data workflows. Key Responsibilities: Data Pipeline Development: Design and implement data pipelines to extract, transform, and load (ETL) data from various sources into databases or data warehouses. Develop efficient data integration processes that handle large volumes of structured and unstructured data. Database Design and Optimization: Work closely with data architects and analysts to design and optimize database structures and schemas for efficient data storage and retrieval. Ensure proper indexing, partitioning, and data organization to maximize query performance. Data Transformation and Cleansing: Develop scripts and workflows to clean, transform, and preprocess raw data into usable formats. Apply data quality checks and validation techniques to ensure accuracy and consistency of data. Data Modeling and Warehousing: Design and implement data models for data warehousing and reporting purposes. Develop and maintain data marts and dimensional models to support analytical queries and reporting needs. Performance Tuning and Optimization: Monitor and analyze database performance, identifying and resolving performance bottlenecks. Optimize SQL queries, indexes, and database configurations to enhance system performance and scalability. Data Security and Governance: Implement data security measures, access controls, and data encryption techniques to protect sensitive information. Ensure compliance with data governance policies and regulations. Collaboration and Integration: Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and develop solutions that meet business needs. Integrate data from various systems and platforms to create a unified view of data. Documentation and Documentation: Maintain comprehensive documentation of database designs, data models, ETL processes, and workflows. Document data standards, data dictionaries, and data lineage for effective data management and governance. Qualifications: Bachelor's degree in Computer Science, Information Systems, or a related field (or equivalent work experience). Proven experience as a Data Engineer or in a similar role. Strong proficiency in SQL and experience with relational databases (e.g., Oracle, MySQL, Microsoft SQL Server). Familiarity with big data technologies (e.g., Hadoop, Spark, Hive) and NoSQL databases (e.g., MongoDB, Cassandra). Experience with ETL tools and data integration frameworks. Knowledge of data modeling concepts and dimensional modeling. Understanding of data warehousing and business intelligence concepts. Proficiency in programming languages like Python, Java, or Scala. Familiarity with cloud-based data platforms (e.g., AWS, Azure, GCP). Strong analytical and problem-solving skills. Excellent communication and collaboration skills.
Upgrade my website to latest Joomla Version
1, I need a designer knowledgeable in Joomla who can upgrade my website to latest version of Joomla 2, 2, I need my website components, Plugins and extensions updated as well. 3. I need a copy of my website to ne ab execytable website template, My website is https://igbo1.com/ Thanks. Mazi Ogbonna
opportunity
ETL: XML file into SQL database e.g. Azure, Snowflake
Stage 1 - 1 file - Extract data from nested XML file, - Transform the data as needed including file name into an extra column and date of creation - Load data into Azure (for now) but we would like to hear if Snowflake etc is better We will connect to the data via Tableau or PowerBI for analysis Stage 2 - Do the same for 1000 files every hour. - Delete duplicate records based on where all lines of information are the same Following agreement with candidate an XML file will be provided as PPH does not allow XML file
opportunity
Developing AI Copywriting Tool Cadabra.ai
We are looking to hire a developer or agency to develop an AI copywriting tool called Cadabra.ai. The primary target audience of this tool is students, marketers, and company founders. The tool should be able to generate content in any style the user wants, and be able to detect plagiarism and run AI checks. The developer should be able to build a simple and intuitive user interface, use GPT3 to generate responses to user questions, create a filtering system to adjust response length, writing level, and content type, create a referral system for users to upgrade their accounts, and ensure the platform is secure and able to handle large volumes of traffic and data. The developer should also be able to create an AI training model that can be trained based on user’s past writing, and an AB testing framework. The ultimate goal is to reach a profitable level of growth and to be able to raise money to create a full AI companion tool. https://projects.invisionapp.com/share/AP135EWRYEUV#/screens/471808404_Screenshot_2023-01-26_At_10-41-00