Eiji Dougal

Scottsdale, AZ | linkedin.com/in/eiji-dougal | github.com/ameijin | eijidougal.com

Summary

Senior software engineer specializing in data platforms and applied AI. Builds governed cloud data platforms on Snowflake and Databricks, including PHI-regulated healthcare data, and AI-native engineering workflows using Claude Code, MCP, Claude Skills and subagents, and adversarial agentic code review. Currently migrating an enterprise warehouse from Redshift to Snowflake with dbt and Fivetran; previously led the consolidation of 32 repositories and 23 databases into a Unity Catalog-governed Databricks lakehouse supporting 100+ analysts. Also ships full-stack web applications for consulting clients (Next.js, TypeScript, MongoDB, PostgreSQL). Strong hands-on Python and SQL, with emphasis on data quality, CI/CD automation, and governance enforced in production.

Skills

Programming Languages: Python, SQL, TypeScript, JavaScript, PHP
Data Engineering: Snowflake, Databricks (Delta Lake, Unity Catalog, Auto Loader, Lakeflow, PySpark, Databricks SQL), Amazon Redshift, Apache Spark, DuckDB, Polars, Parquet
Databases: PostgreSQL, Azure SQL Server, MySQL, Supabase, MongoDB, Vector Databases (Pinecone)
Transformation/Modeling: dbt Core, Data Modeling (Dimensional Modeling, Medallion Architecture), Star Schemas, Semantic Layer Modeling
Ingestion/Orchestration: Fivetran, Dagster, Databricks Jobs, Azure Data Factory, Hightouch (Reverse ETL), Change Data Capture (CDC), REST API Integration
Data Governance & Quality: Data Quality Testing, Data Lineage, SSO, Unity Catalog, IAM, Role-Based Access Control (RBAC), Healthcare Data, PHI, HIPAA, Column Level Security
Cloud & DevOps: Microsoft Azure, Docker, AWS (S3, Bedrock), CI/CD (GitHub Actions, Azure DevOps, Databricks Asset Bundles)
AI & LLM Engineering: Claude Code, CodeRabbit, RAG, AWS Bedrock, Model Context Protocol (MCP), Claude Skills, Subagents, Agentic Workflows, Adversarial Multi-Agent Code Review, Snowflake Cortex, Embedding Pipelines, Semantic Search
Software & Web Engineering: Next.js, React, REST API Design, Multi-Tenant SaaS Architecture, Background Workers, Technical SEO, Server-Side Rendering, Google Analytics 4
BI: Omni Analytics, Tableau, Power BI

Professional Experience

EverCommerce (EverHealth)

Senior Software Engineer, DataRemote · Apr 2026 - Present

Architected the Snowflake environment for a Redshift-to-Snowflake migration on a two-person data platform team: account and role-based access design, SSO and private network connectivity, and Fivetran ELT adjustments to run both warehouses in parallel with zero disruption to production reporting.
Drove the move off Redshift Serverless to regain full admin and cost control, running both warehouses in parallel before decommissioning Redshift.
Maintain a dbt warehouse consolidating 9 source systems (Salesforce, HubSpot, Zuora, ChurnZero, DrChrono, and others) through staging, intermediate, snapshot, mart, and reporting layers.
Integrate DrChrono EHR and practice-management data containing PHI into production pipelines, enforcing HIPAA-aligned access controls, environment separation, and de-identified or aggregated marts that never carry raw PHI.
Migrating the 237-model dbt warehouse: refactored 45 models and expanded test coverage from 951 to 1,468 tests (+54%) in five months, with model documentation and lineage maintained in dbt docs.
Manage ELT pipelines from Salesforce, HubSpot, Zuora, and ChurnZero via Fivetran, and reverse ETL syncs via Hightouch back into ChurnZero, HubSpot, and Salesforce, supporting revenue, billing, and customer health reporting.
Built AI-assisted engineering workflows with Claude Code and AWS Bedrock, authoring Claude Skills and subagents that codify team standards for dbt modeling, testing, and Snowflake development.
Integrated Model Context Protocol (MCP) servers into the team's AI tooling, giving coding agents structured access to platform context such as warehouse metadata and repositories.
Designed an adversarial agentic code review process in which independent reviewer agents challenge each change, layered with CodeRabbit automated review, sustaining code quality and delivery speed on a two-person team.
Deliver governed data and self-service analytics to business users through Omni Analytics; grew the semantic layer from 3 to 12 modeled topics.

Wells Fargo

Lead Data EngineerChandler, AZ · Feb 2024 - Apr 2026

Led consolidation of 32 legacy repositories and 23 databases into a unified Databricks lakehouse (Bronze/Silver/Gold) on ADLS, improving governance, scalability, and cross-team data access.
Designed Unity Catalog-governed medallion architecture with column-level RBAC across storage, compute, and analytics layers, standardizing secure data access for a multi-team lakehouse platform.
Built and standardized dbt-based dimensional models and star schemas with automated testing gates, improving data quality and reproducibility across reporting domains.
Engineered PySpark and Delta Lake transformation workflows in Databricks across medallion layers, delivering curated analytical datasets to 100+ analysts with enforced data quality standards.
Implemented CI/CD pipelines for data infrastructure and dbt deployments using GitHub Actions and Databricks Asset Bundles (DABs), reducing manual release processes and increasing deployment reliability.
Defined reusable pipeline patterns, environment separation strategies, and modular transformation standards to accelerate new data product development.
Mentored junior and senior data engineers on medallion architecture standards, dbt modeling patterns, and Databricks best practices, accelerating team ramp-up on the unified lakehouse platform.

Senior Data EngineerChandler, AZ · Aug 2021 - Feb 2024

Automated and maintained 100+ ETL pipelines in Python, eliminating over 1,600 hours of manual effort annually and improving data reliability.
Optimized stored procedures and schemas across multiple business-critical SQL Server databases to improve query performance and stability.
Delivered analytics-ready datasets through structured modeling and transformation workflows supporting enterprise reporting needs.
Introduced CI/CD processes with Azure DevOps for data deployments, reducing release time from hours to minutes and improving consistency across environments.

Data EngineerChandler, AZ · Jan 2020 - Aug 2021

Converted 50+ ETL jobs from PowerShell to Python, creating a reusable codebase that reduced development time for new pipelines by ~30%.
Consumed and integrated REST APIs to ingest data sources into enterprise pipelines.
Collaborated closely with analysts to ensure reliable, well-prepared datasets for downstream reporting.

SoftPoint

Software EngineerScottsdale, AZ · May 2019 - Dec 2019

Built backend systems in PHP/MySQL and developed REST APIs powering POS platforms and Android applications handling thousands of daily transactions across hospitality clients.
Designed ETL processes consolidating customer and transactional data into MySQL for operational reporting.
Delivered SQL-driven dashboards used to track employee performance and operational metrics.

Arizona Specialty Motors

Software EngineerTempe, AZ · Jun 2017 - May 2019

Built and maintained company web systems using PHP and MySQL, increasing inbound leads by ~25%.
Automated internal reporting and data entry workflows using custom scripts to reduce manual effort.

Education

Arizona State University

Bachelor of Science, InformaticsTempe, AZ

Achievements: Dean's List

Projects

QuickETL

Built an open-source, configuration-driven Python ETL framework on Ibis that runs the same YAML-defined pipeline across DuckDB, Polars, Spark, Snowflake, and BigQuery without code changes; published on PyPI with a CLI and built-in data quality checks.

Docuscry

Built a multi-tenant document knowledge platform with ingestion pipelines, background workers, and embedding-based semantic search using PostgreSQL and external vector databases.
Designed workspace isolation, permission controls, and usage tracking; deployed via containerized CI/CD on managed cloud infrastructure.

Eiji Dougal

Data Platform & AI Engineer

Scottsdale, AZ|[email protected]|LinkedIn|GitHub|Website

Download PDF

Summary

Experience

Senior Software Engineer, Data

EverCommerce (EverHealth) · Remote

Apr 2026 - Present

·Architected the Snowflake environment for a Redshift-to-Snowflake migration on a two-person data platform team: account and role-based access design, SSO and private network connectivity, and Fivetran ELT adjustments to run both warehouses in parallel with zero disruption to production reporting.
·Drove the move off Redshift Serverless to regain full admin and cost control, running both warehouses in parallel before decommissioning Redshift.
·Maintain a dbt warehouse consolidating 9 source systems (Salesforce, HubSpot, Zuora, ChurnZero, DrChrono, and others) through staging, intermediate, snapshot, mart, and reporting layers.
·Integrate DrChrono EHR and practice-management data containing PHI into production pipelines, enforcing HIPAA-aligned access controls, environment separation, and de-identified or aggregated marts that never carry raw PHI.
·Migrating the 237-model dbt warehouse: refactored 45 models and expanded test coverage from 951 to 1,468 tests (+54%) in five months, with model documentation and lineage maintained in dbt docs.
·Manage ELT pipelines from Salesforce, HubSpot, Zuora, and ChurnZero via Fivetran, and reverse ETL syncs via Hightouch back into ChurnZero, HubSpot, and Salesforce, supporting revenue, billing, and customer health reporting.
·Built AI-assisted engineering workflows with Claude Code and AWS Bedrock, authoring Claude Skills and subagents that codify team standards for dbt modeling, testing, and Snowflake development.
·Integrated Model Context Protocol (MCP) servers into the team's AI tooling, giving coding agents structured access to platform context such as warehouse metadata and repositories.
·Designed an adversarial agentic code review process in which independent reviewer agents challenge each change, layered with CodeRabbit automated review, sustaining code quality and delivery speed on a two-person team.
·Deliver governed data and self-service analytics to business users through Omni Analytics; grew the semantic layer from 3 to 12 modeled topics.

Lead Data Engineer

Wells Fargo · Chandler, AZ

Feb 2024 - Apr 2026

·Led consolidation of 32 legacy repositories and 23 databases into a unified Databricks lakehouse (Bronze/Silver/Gold) on ADLS, improving governance, scalability, and cross-team data access.
·Designed Unity Catalog-governed medallion architecture with column-level RBAC across storage, compute, and analytics layers, standardizing secure data access for a multi-team lakehouse platform.
·Built and standardized dbt-based dimensional models and star schemas with automated testing gates, improving data quality and reproducibility across reporting domains.
·Engineered PySpark and Delta Lake transformation workflows in Databricks across medallion layers, delivering curated analytical datasets to 100+ analysts with enforced data quality standards.
·Implemented CI/CD pipelines for data infrastructure and dbt deployments using GitHub Actions and Databricks Asset Bundles (DABs), reducing manual release processes and increasing deployment reliability.
·Defined reusable pipeline patterns, environment separation strategies, and modular transformation standards to accelerate new data product development.
·Mentored junior and senior data engineers on medallion architecture standards, dbt modeling patterns, and Databricks best practices, accelerating team ramp-up on the unified lakehouse platform.

Senior Data Engineer

Wells Fargo · Chandler, AZ

Aug 2021 - Feb 2024

·Automated and maintained 100+ ETL pipelines in Python, eliminating over 1,600 hours of manual effort annually and improving data reliability.
·Optimized stored procedures and schemas across multiple business-critical SQL Server databases to improve query performance and stability.
·Delivered analytics-ready datasets through structured modeling and transformation workflows supporting enterprise reporting needs.
·Introduced CI/CD processes with Azure DevOps for data deployments, reducing release time from hours to minutes and improving consistency across environments.

Data Engineer

Wells Fargo · Chandler, AZ

Jan 2020 - Aug 2021

·Converted 50+ ETL jobs from PowerShell to Python, creating a reusable codebase that reduced development time for new pipelines by ~30%.
·Consumed and integrated REST APIs to ingest data sources into enterprise pipelines.
·Collaborated closely with analysts to ensure reliable, well-prepared datasets for downstream reporting.

Software Engineer

SoftPoint · Scottsdale, AZ

May 2019 - Dec 2019

·Built backend systems in PHP/MySQL and developed REST APIs powering POS platforms and Android applications handling thousands of daily transactions across hospitality clients.
·Designed ETL processes consolidating customer and transactional data into MySQL for operational reporting.
·Delivered SQL-driven dashboards used to track employee performance and operational metrics.

Software Engineer

Arizona Specialty Motors · Tempe, AZ

Jun 2017 - May 2019

·Built and maintained company web systems using PHP and MySQL, increasing inbound leads by ~25%.
·Automated internal reporting and data entry workflows using custom scripts to reduce manual effort.

Skills

Programming Languages

PythonSQLTypeScriptJavaScriptPHP

Data Engineering

SnowflakeDatabricks (Delta Lake, Unity Catalog, Auto Loader, Lakeflow, PySpark, Databricks SQL)Amazon RedshiftApache SparkDuckDBPolarsParquet

Databases

PostgreSQLAzure SQL ServerMySQLSupabaseMongoDBVector Databases (Pinecone)

Transformation/Modeling

dbt CoreData Modeling (Dimensional Modeling, Medallion Architecture)Star SchemasSemantic Layer Modeling

Ingestion/Orchestration

FivetranDagsterDatabricks JobsAzure Data FactoryHightouch (Reverse ETL)Change Data Capture (CDC)REST API Integration

Data Governance & Quality

Data Quality TestingData LineageSSOUnity CatalogIAMRole-Based Access Control (RBAC)Healthcare DataPHIHIPAAColumn Level Security

Cloud & DevOps

Microsoft AzureDockerAWS (S3, Bedrock)CI/CD (GitHub Actions, Azure DevOps, Databricks Asset Bundles)

AI & LLM Engineering

Claude CodeCodeRabbitRAGAWS BedrockModel Context Protocol (MCP)Claude SkillsSubagentsAgentic WorkflowsAdversarial Multi-Agent Code ReviewSnowflake CortexEmbedding PipelinesSemantic Search

Software & Web Engineering

Next.jsReactREST API DesignMulti-Tenant SaaS ArchitectureBackground WorkersTechnical SEOServer-Side RenderingGoogle Analytics 4

BI

Omni AnalyticsTableauPower BI

Projects

EverCommerce | Redshift to Snowflake Migration

Architected the Snowflake environment for an enterprise Redshift-to-Snowflake migration on a two-person data platform team, covering account and role-based access design, SSO and private network connectivity, and Fivetran ELT adjustments that run both warehouses in parallel with zero disruption to production reporting.

Snowflakedbt CoreFivetranAmazon Redshift

QuickETL

Built an open-source, configuration-driven Python ETL framework using Ibis as the abstraction layer, enabling the same YAML-defined pipeline to run across local backends (DuckDB, Polars) and distributed/cloud backends (Spark, Snowflake, BigQuery) without code changes.

PythonIbisDuckDBPolars

Docuscry

Built a multi-tenant document knowledge platform with ingestion pipelines, background workers, and embedding-based semantic search. Implemented document chunking, embedding workflows, and vector-based retrieval using PostgreSQL and external vector databases.

Next.jsSupabaseFly.ioOpenAI

Wells Fargo | Data Platform Modernization

Multi-year initiative to modernize an enterprise analytics and ETL ecosystem on Azure and Databricks.

PythonDatabricksDelta LakeUnity Catalog

Education

Arizona State University

Bachelor of Science, Informatics

2016

Dean's List

Certifications

Microsoft Certified: Azure Fundamentals