We are seeking a highly skilled Snowflake Data Engineer with deep expertise in Snowflake's modern AI and data platform capabilities. The ideal candidate goes beyond traditional data engineering — they are proficient in Snowflake Cortex AI, building intelligent agents, developing Streamlit-based data applications, and leveraging Snowpark for advanced analytics. This role is central to our healthcare data modernization strategy and requires someone who can architect, build, and scale next-generation data and AI solutions on Snowflake.
Snowflake AI & Cortex (Core Focus)
- Design and deploy AI-powered solutions using Snowflake Cortex, including LLM-based functions (COMPLETE, SUMMARIZE, SENTIMENT, TRANSLATE, CLASSIFY) for healthcare data use cases.
- Build and orchestrate multi-step AI agents using Snowflake Cortex Agents and Cortex Analyst to automate data workflows and enable natural language querying of structured healthcare datasets.
- Leverage Cortex Search for semantic and hybrid search capabilities across unstructured clinical and operational data.
- Implement RAG (Retrieval-Augmented Generation) pipelines using Snowflake's native vector embeddings and VECTOR data type for domain-specific LLM grounding.
- Use Arctic Embed and other Snowflake-native embedding models to build scalable, cost-effective AI features within the Snowflake perimeter.
Streamlit & Application Development
- Build interactive, production-grade data applications and internal tools using Streamlit in Snowflake (SiS) for business stakeholders and data consumers.
- Develop self-service analytics dashboards and AI-assisted exploration tools embedded directly in the Snowflake environment.
- Create Streamlit-based front-ends for Cortex-powered features — enabling clinical users and analysts to interact with AI outputs without leaving the Snowflake ecosystem.
Snowpark & Data Engineering
- Develop complex data transformations, feature engineering pipelines, and ML preprocessing workflows using Snowpark for Python.
- Build and manage scalable ELT pipelines leveraging Snowflake Streams, Tasks, Dynamic Tables, and Snowpipe for real-time and batch ingestion.
- Optimize Snowflake performance through micro-partition pruning, clustering keys, materialized views, search optimization, and warehouse right-sizing.
- Design and implement Data Vault or Medallion architecture patterns for healthcare data platforms.
- Integrate Snowflake with upstream healthcare data sources and downstream BI platforms.
Data Governance & Security
- Implement Snowflake-native governance including row-level security, column masking policies, object tagging, and data classification.
- Ensure HIPAA compliance and PHI data handling best practices across all Snowflake data assets.
- Manage data lineage, cataloging, and access control in alignment with organizational governance frameworks.
Collaboration & Platform Ownership
- Partner with data scientists, ML engineers, clinical analysts, and business stakeholders to translate requirements into robust Snowflake-native solutions.
- Act as a Snowflake subject matter expert and internal champion — driving best practices, onboarding teams, and evangelizing new platform capabilities.
- Participate in platform roadmap planning and contribute to Snowflake feature adoption strategy.
- 5+ years of data engineering experience, with at least 3+ years of hands-on Snowflake expertise.
- Proven experience with Snowflake Cortex AI features: LLM functions, Cortex Analyst, Cortex Search, and AI agent orchestration.
- Hands-on experience building Streamlit in Snowflake applications deployed in production environments.
- Proficiency in Snowpark for Python — including custom UDFs/UDTFs, stored procedures, and DataFrame API usage.
- Strong SQL skills with deep understanding of Snowflake's execution engine, query profiling, and optimization techniques.
- Experience with Snowflake data sharing, Marketplace, and cross-cloud/cross-region replication.
- Familiarity with vector search, embeddings, and RAG architecture patterns within or integrated into Snowflake.
- Good to have experience with cloud platforms: Azure, and GCP — and connecting Snowflake to cloud-native services.
- Strong understanding of data modeling for analytics (star schema, Data Vault, Medallion/Lakehouse patterns).
- Knowledge of Medicare Stars Patient Safety is a strong plus.
