Compunnel

Senior Microsoft Fabric Data Engineer/Lead/SME/Architect

  • Montvale, NJ
  • contractor
  • Posted yesterday
  • Staffing / consulting
Apply on Compunnel's site ↗Checked today on the employer's career site. We never take applications.

Job Summary:
We are seeking a highly skilled Senior/Lead Data Engineer with 10–12+ years of experience to drive the development of modern data platforms and AI-enabled data solutions. This is a hands-on individual contributor role focused on building intelligent data ecosystems, enabling AI agents, and delivering scalable enterprise data solutions. The ideal candidate will have expert-level knowledge of Microsoft Fabric, particularly Fabric Data Agent and Fabric IQ, along with experience in data engineering, AI/LLMs, and enterprise data platforms. The role requires strong technical leadership, independent execution, and the ability to translate business requirements into scalable data and AI solutions.

Key Responsibilities:
• Design, build, and optimize enterprise-scale data platforms and data lake architectures.
• Implement and support Microsoft Fabric Data Agent, Fabric IQ, or Databricks Genie solutions.
• Design and develop Fabric IQ ontologies, including ontology modeling and integration with enterprise data platforms.
• Design AI agents in Microsoft Foundry using Fabric ontology as the backend.
• Implement and configure the Fabric IQ MCP server, exposing ontology through an MCP endpoint.
• Enable AI-driven data access and establish data foundations for Agentic AI use cases.
• Configure and optimize data agents, retrieval systems, and AI-powered data workflows.
• Develop scalable data pipelines, ingestion frameworks, and data transformation processes.
• Implement and manage Microsoft Fabric components, including OneLake, Lakehouse, Warehouse, pipelines, and Medallion architecture.
• Collaborate with AI, analytics, and business teams to deliver intelligent data solutions.
• Ensure data quality, governance, security, and performance across enterprise environments.
• Evaluate and implement modern data engineering best practices and emerging technologies.
• Lead requirement-gathering sessions and translate business needs into technical solutions.
• Drive technical solutions independently from design through production deployment.
• Provide technical leadership and guidance while maintaining a hands-on individual contributor approach.

Required Qualifications:
• 10–12+ years of experience in Data Engineering.
• Expert-level hands-on expertise in Microsoft Fabric, including OneLake, Lakehouse, Warehouse, pipelines, and Medallion architecture.
• Strong hands-on experience with Fabric IQ, including ontology design and modeling.
• Strong experience with Microsoft Fabric Data Agent.
• Experience designing agents in Microsoft Foundry using ontology as the backend.
• Experience with the Fabric IQ MCP server and exposing ontology as an MCP endpoint.
• Strong technical knowledge across the Microsoft Azure ecosystem.
• Experience with Microsoft Fabric Data Agent/Fabric IQ or Databricks Genie.
• Knowledge of AI/LLMs and configuring data agents for AI-powered solutions.
• Experience building or enabling AI agents on enterprise data platforms and data lakes.
• Strong experience with data pipelines, ETL/ELT processes, data modeling, and analytics platforms.
• Strong hands-on technical expertise with modern data platforms and cloud data architectures.
• Ability to work independently with minimal guidance and drive initiatives end to end.
• Excellent problem-solving, leadership, and communication skills.
• Proactive, self-driven approach with the ability to lead client requirement-gathering sessions.
• Ability to work onsite at the client location.

Preferred Qualifications:
• DP-700 (Microsoft Fabric Data Engineer Associate) certification.
• Experience with Microsoft Fabric, Azure Data Services, Databricks, and modern lakehouse architectures.
• Working knowledge of Databricks.
• Foundational knowledge of Power BI.
• Exposure to Agentic AI, RAG architectures, vector databases, or AI-driven analytics solutions.
• Working knowledge of AI systems and their integration with enterprise data platforms.
• Experience in client financials and audit domains.

Similar open jobs

All H-1B data engineer jobs in New Jersey →