Are you an experienced Data Engineer with expertise in Snowflake, AWS, Python, and modern data infrastructure? The Motley Fool is hiring a Senior Data Engineer to help transform its investment operations through scalable data platforms, automation, analytics, and AI-driven initiatives.
This fully remote U.S.-based position offers the opportunity to work at the intersection of financial data, cloud engineering, machine learning, and business intelligence while helping power smarter investment decisions.
About The Motley Fool
For more than 30 years, The Motley Fool has helped individuals make better financial decisions through investment research, education, and data-driven insights. The company is dedicated to helping people become smarter, happier, and richer through trusted financial guidance and innovative technology.
As part of a mission-driven organization, you’ll join a collaborative team that values curiosity, innovation, ownership, and continuous improvement.
About the Role
The Senior Data Engineer will own the complete data lifecycle, from ingestion and transformation to warehousing, analytics, reporting, and AI enablement.
You’ll play a critical role in modernizing data operations by replacing manual processes and spreadsheets with scalable, governed, cloud-based data platforms that support investment operations and strategic decision-making.
This role combines data engineering, cloud architecture, analytics, and machine learning to build the foundation for future AI initiatives across the organization.
Key Strategic Initiatives
Golden Source Data Transformation
Lead the migration from spreadsheet-based workflows to a centralized Snowflake data warehouse with:
- Data governance
- Automated quality controls
- Data lineage tracking
- Self-service analytics
Automated Data Pipelines
Develop event-driven workflows that:
- Ingest data from external providers
- Validate and transform incoming datasets
- Deliver near real-time insights
- Reduce manual intervention
Infrastructure as Code
Build reproducible environments using:
- Terraform
- AWS CDK
- Automated deployments
- Version-controlled infrastructure
AI and Machine Learning Enablement
Establish clean, trusted datasets that support:
- AI agents
- Natural language interfaces
- Forecasting models
- Anomaly detection systems
- Intelligent automation
Core Responsibilities
Data Engineering & ETL (35%)
- Design and maintain ETL and ELT pipelines.
- Build Apache Airflow workflows using AWS MWAA.
- Integrate data from APIs, SFTP feeds, flat files, and financial data vendors.
- Create automated data validation and monitoring systems.
- Implement serverless workflows using AWS Lambda.
- Maintain comprehensive data documentation.
Snowflake Data Warehouse (35%)
- Design and optimize Snowflake architecture.
- Manage data loading with Snowpipe and Stages.
- Implement role-based access controls.
- Develop advanced SQL queries and analytical models.
- Optimize warehouse performance and reduce compute costs.
Cloud Infrastructure & DevOps (10%)
- Manage cloud infrastructure using Infrastructure as Code.
- Deploy AWS resources using Terraform or AWS CDK.
- Build CI/CD pipelines with GitHub Actions.
- Automate testing and deployment workflows.
Analytics, Reporting & AI (20%)
- Develop dashboards and business intelligence solutions.
- Build automated reporting systems.
- Support Tableau analytics initiatives.
- Enable secure AI access to investment data.
- Assist with machine learning and predictive analytics projects.
Required Qualifications
Data Engineering Expertise
- 5+ years of professional Python development experience.
- Strong knowledge of pandas, NumPy, and modern data engineering practices.
- Experience designing and operating ETL/ELT pipelines.
- Experience with Apache Airflow or similar orchestration platforms.
Snowflake & SQL
- Deep understanding of Snowflake architecture.
- Experience with clustering keys and micro-partitions.
- Expertise with Snowpipe and data stages.
- Advanced SQL development and optimization skills.
- Experience building analytical and reporting solutions.
Cloud & Infrastructure
- Experience with Terraform or AWS CDK.
- Infrastructure as Code expertise.
- Cloud-native architecture experience.
- CI/CD automation experience.
Financial Data Experience
Experience working with financial data providers such as:
- Bloomberg
- FactSet
- Capital IQ
- Refinitiv
- Morningstar
- MSCI
- Russell
Preferred Qualifications
AWS Technologies
- AWS Lambda
- ECS Fargate
- Step Functions
- EventBridge
- CloudWatch
- S3
- RDS
Analytics & Visualization
- Tableau
- Streamlit
- Business Intelligence Platforms
- Self-Service Analytics
Artificial Intelligence
- LLM integrations
- Retrieval-Augmented Generation (RAG)
- Embeddings
- Knowledge bases
- Prompt engineering
Machine Learning
- Scikit-learn
- XGBoost
- Predictive modeling
- Anomaly detection
- Forecasting systems
Compensation
Hourly Rate
- $90 – $125 USD per hour
The Motley Fool is open to conversations with exceptional candidates whose compensation expectations may fall outside the stated range.
Why Join The Motley Fool?
This role offers the opportunity to build modern data infrastructure that directly impacts investment operations, analytics, and future AI initiatives.
You’ll work with cutting-edge technologies including Snowflake, AWS, Airflow, Terraform, machine learning frameworks, and AI systems while helping create the next generation of data-driven financial intelligence platforms.
For experienced data engineers seeking ownership, technical challenges, and meaningful impact, this is an exceptional career opportunity.