Responsibilities:
Design, develop, and maintain robust ETL pipelines using MS Azure Data Factory, MS Azure Databricks, and other Azure services.
Build and manage data integration interfaces between internal systems and external platforms such as Coupa and SAP.
Collaborate with data architects, analysts, and business stakeholders to understand data requirements and deliver scalable solutions.
Optimize data workflows for performance, reliability, and cost-efficiency.
Implement data quality checks, error handling, and logging mechanisms.
Participate in code reviews, architecture discussions, unit testing, and performance tuning.
Ensure compliance with data governance, security, and privacy standards.
Mentor junior developers and contribute to best practices in data engineering
Mandatory Skills Description:
Bachelor's or Master's degree in Computer Science, Information Systems, or related field.
5+ years of experience in ETL/ELT development, with at least 2 years focused on Azure Data Factory.
Strong proficiency in SQL, Postgres, and data transformation logic.
Experience with Azure Blob Storage, Azure Functions, and Databricks.
Hands-on experience integrating with Coupa and SAP platforms.
Familiarity with CI/CD pipelines and version control tools (e.g., Git, Azure DevOps).
Experience with Unix/Linux shell scripting for automation and process orchestration.
Expertise in data extraction, transformation, and loading from/to various data sources (e.g., relational databases, flat files, XML, JSON, etc.).
Solid understanding of data warehousing concepts, dimensional modeling, and big data processing.
Excellent problem-solving, communication, and documentation skills.
Experience with IBM DataStage development.
Experience with Power BI, Snowflake, or Apache Spark.
Knowledge of data lake architecture, data mesh, or data fabric concepts.
Microsoft Azure certifications (e.g., DP-203: Data Engineering on Microsoft Azure).
Experience with REST/SOAP APIs and middleware platforms for enterprise integration.
...education, insurance, loans, real estate and travel. Job Description Forbes Advisor is looking for a staff writer with writing and reporting experience on tax... ...Competitive compensation package Ability to work remotely Unlimited PTO Every third Friday of the...
...Job Title: Recruiters Wanted | AI-Powered Platform for Revenue Growth | Remote Location: Remote (UK & Global) Job Type: Platform Membership / Flexible Collaboration Overview: Whether you're running solo, leading an agency, in-house, or part of an RPO - RecXchange...
...in the 11-western states with regional offices in Reno, NV; Phoenix, AZ; Richmond, CA; and Salt Lake City, UT. As a Project Safety Trainer , you will be working with our corporate safety team with training facilitation and administrative tasks at a rural lithium...
...on LinkedIn. GENERAL FUNCTION The Sr. Associate General Counsel is responsible for overseeing legal aspects of commercial client... ...the basis of a legally protected pregnancy or maternity leave), genetic information or any other characteristics protected by law....
...Role Overview Mercor is collaborating with a global insurance and financial services client to support actuarial modeling processes via high-quality data preparation. We are seeking actuarial professionals with experience in seriatim data extraction, cleansing, and validation...