Job Role: Senior Data Engineer
Location: Remote
JD:
Key Responsibilities
Design and implement ETL pipelines using Microsoft Fabric (Dataflows, Pipelines, Lakehouse, warehouse, sql) and Azure Data Factory.
Build and maintain a metadata-driven Lakehouse architecture with threaded datasets to support multiple consumption patterns.
Develop agent-specific data lakes and an orchestration layer for an uber-agent that can query across agents to answer customer questions.
Enable interactive data consumption via Power BI, Azure OpenAI, and other analytics tools.
Ensure data quality, lineage, and governance across all ingestion and transformation processes.
Collaborate with product teams to understand data needs and deliver scalable solutions.
Optimize performance and cost across storage and compute layers.
Required Qualifications
5+ years of experience in data engineering with a focus on Microsoft Azure and Fabric technologies.
Strong expertise in:
o Microsoft Fabric (Lakehouse, Dataflows Gen2, Pipelines, Notebooks)
o Azure Data Factory, Azure SQL, Azure Data Lake Storage Gen2
o Power BI and/or other visualization tools
o Azure Functions, Logic Apps, and orchestration frameworks
o SQL, Python and PySpark/Scala
Experience working with structured and semi-structured data (JSON, XML, CSV, Parquet).
Proven ability to build metadata-driven architectures and reusable components.
Familiarity with agent-based architectures and conversational AI integration is a plus.
Strong understanding of data modeling, data governance, and security best practices.
Preferred Qualifications
Experience with Azure OpenAI, Copilot Studio, or similar conversational platforms.
Knowledge of CI/CD pipelines and DevOps practices for data engineering.
Experience in building multi-tenant data platforms or domain-specific lakes.
Records Inventory Manager (Administrative Officer II) Location Jessup, MD : Introduction The Maryland Department of General Services (DGS) supports State and local government agencies, as well as local non-profit organizations and the citizens of Maryland, by providing...
...Interventional Cardiologist - West New York & Jersey City, NJ (#3137) Location: West New York and Jersey City, NJ Employment Type: Full-time Salary: $450,000 - $500,000 / yr (base salary) Position Overview: We are seeking a skilled and dedicated Interventional...
...experiences, which fuel our commitment to equity and culture of service. Grow your career with comprehensive training and... ...Bonus ~ Paid time off and Holiday pay Description The Security Supervisor I reflects the mission, vision, and values of NM, adheres...
...nationwide. We partner with businesses and jobseekers to place qualified individuals efficiently. We are currently in need of Structural Welders to join our team in Sturgeon Bay, WI. **$35 hr- $110 per diem** Requirements Structural Welder Job Description...
This Job is based in AustraliaPost-Doctoral Fellow (Immunology) - School of Pathology Employment Type: Full - time (35 hours a week) but part time is also considered. Duration: 2-Year Fixed Term Remuneration: $91k - $121k base (+ 17% Super, leave loading) Working rights...