1 year We are seeking a mid-level Data Platform Engineer to build a new greenfield data platform integrating internal systems (GSCM, SEASI, SMART, and BOSS) using a Medallion Architecture.
This role owns the end-to-end data pipeline—from ingestion through Bronze/Silver/Gold transformation—while migrating existing Alteryx workflows to code-based dbt and Python implementations.
The engineer will also develop an MCP server enabling AI agents to query business-specific data marts, directly supporting the organization's AI-driven analytics initiatives.
Success in this role will deliver a scalable, governed data foundation that accelerates business insights and AI adoption.
Job DescriptionIngest data from sources such as Microsoft SQL Server (BOSS) and Oracle into the Bronze layer, implementing CDC-based incremental ingestionDevelop dbt models for the Silver layer including cleansing, standardization, deduplication, and data quality testingDevelop Gold layer business-specific data marts and migrate existing Alteryx transformation logicConfigure Apache Iceberg tables and a REST Catalog, including schema evolution and time travel supportDevelop and operate Apache Airflow DAGs, managing dependencies, scheduling, and failure notificationsDevelop an MCP server enabling AI agents to query Gold-layer data marts, including catalog/metadata access, ontology integration, and query executionManage metadata and data lineage using OpenMetadataAutomate Excel reporting using Python and openpyxlQualifications3+ years of hands-on data engineering experience in production environmentsAdvanced SQL skills, including window functions, CTEs, and query tuningHands-on dbt experience, including model design, incremental strategies, macros, and testsPython proficiency for data processing and automation, including libraries such as pandasExperience developing Apache Airflow DAGsExperience with at least one analytical engine: Trino/Presto, Apache Spark, or DuckDBExperience with at least one lakehouse table format: Apache Iceberg, Delta Lake, or Apache HudiExperience with Medallion Architecture and star schema/dimensional modelingExperience integrating relational database sources, such as Microsoft SQL Server and Oracle, using CDC or batch processing Required Technical SkillsSQLdbtPythonpandasApache AirflowTrino/Presto or Apache Spark or DuckDBApache Iceberg or Delta Lake or Apache HudiMicrosoft SQL ServerOracleKubernetesMinIO (S3-compatible storage) Preferred QualificationsExperience with EL tools such as Airbyte or Fivetran, and Iceberg REST Catalog implementations such as Apache PolarisExperience with governance tools such as OpenMetadata or DataHub, and semantic layers such as Cube.devAbility to interpret Alteryx workflows (.yxmd) and migrate their logic to SQL/dbtExperience developing MCP servers or building LLM, RAG, or AI agent pipelinesExperience developing applications, APIs, or backend services using Java and/or PythonExperience building Generative AI (GenAI) applications, including LLM integration, retrieval-augmented generation (RAG), and AI agent workflowsHands-on experience with LangChain and/or LangGraph for developing tool-enabled AI agents and orchestrating multi-step workflowsUnderstanding of retail and home appliance business domains, including PSI (Production, Sales, and Inventory) and sales analyticsUnderstanding of retail and home appliance business domains, including PSI (Production, Sales, and Inventory) and sales analytics Preferred Technical SkillsJava or PythonGenerative AI (GenAI) and LLM integrationLangChainLangGraphRAG and AI agent pipelinesMCP server developmentAirbyteFivetranApache PolarisOpenMetadataDataHubCube.devAlteryxopenpyxlAdditional InformationAll your information will be kept confidential according to EEO guidelines.