Skip to main content
Thomas CrowderTC
Open to opportunities

Thomas Crowder

@thomascrowder

Senior Data Engineer at American Express who governed card transaction pipelines and curated analytics datasets.

United States
Message

At American Express, I own ingestion, transformation, and modeling for card transaction and account feeds in Azure Synapse. I define data contracts and curated marts for BI consumers, with a 30-minute SLA.

I’ve built batch and streaming pipelines for fraud events, transactions, and customer updates, and addressed schema drift with versioned contracts and controlled evolution. I also established partitioning, workload controls, and retention rules that reduced compute waste by about 22% while preserving recovery and backfill capability.

Across American Express, Fortress Information Security, Comcast, and other teams, I’ve worked on governed data products, security and telemetry pipelines, and application data workflows. I lead architecture reviews and mentor engineers on pipeline design, testing, and ML feature readiness.

Experience

Work history, roles, and key accomplishments

American Express logoAE
Current

Data Engineer III

Jan 2025 - Present (1 year 10 months)

Owned ingestion, transformation, and modeling of card transaction and account feeds in Azure Synapse using ADF, defining data contracts and curated marts that served BI consumers within a 30-minute SLA. Designed batch and near-real-time pipelines from APIs, flat files, and operational databases into ADLS and Synapse, applying SQL views and stored procedures to distribute governed datasets to analy

American Express logoAE

Data Engineer II

Oct 2021 - Jan 2025 (3 years 3 months)

Built reusable Python and Spark ingestion pipelines for fraud events, card transactions, and customer updates, moving batch and streaming sources through ADF into Synapse models for risk analytics. Implemented CDC and incremental SQL transformations across operational tables, handling late records with watermarks and idempotent merges before exposing refreshed datasets to BI consumers.

FS

Data Engineer

Fortress Information Security

Nov 2020 - Oct 2021 (11 months)

Ingested security logs, asset records, and operational files with Python and Kinesis into S3, transforming them with PySpark and publishing query-ready RDS tables for reporting consumers. Orchestrated development, staging, and production batch workflows in Airflow, using retries, backoff, and parameterized S3 paths to recover failed ingestion and maintain repeatable operational processing.

Comcast logoCO

Data Engineer

May 2020 - Nov 2020 (6 months)

Ingested network telemetry from AWS S3 into Databricks with PySpark, transforming device metrics into analytics tables that supported data science investigations and performance monitoring. Improved telemetry pipelines through partitioned Spark processing and controlled retries, keeping ingestion, transformation, and Grafana metric refreshes within daily operational windows.

Discovery Inc logoDI

Python Developer

Discovery Inc

Dec 2018 - May 2020 (1 year 5 months)

Processed programming schedules, media metadata, and flat files with Python and CLI tools, transforming inputs into Snowflake and SQL-ready datasets for downstream analytics users. Integrated REST APIs with Hadoop file workflows, validating payloads before ingestion and shaping normalized records for reporting applications with explicit handling for missing and malformed values.

ME

Software Engineer

Minerva Engineering

Feb 2018 - Nov 2018 (9 months)

Developed Python components that ingested service requests through REST APIs, transformed validated payloads, and persisted operational records in SQL workflows for application consumers. Resolved invalid inputs and inconsistent database values with validation routines and SQL constraints, connecting ingestion, transformation, and reporting behavior through documented process flows.

General Dynamics Information Technology logoGT

Software Developer / Infrastructure and Operations

Mar 2017 - Feb 2018 (11 months)

Automated ingestion of operational files with Python and shell scripting, transformed records through SQL utilities, and scheduled distribution jobs across Linux environments with documented controls. Investigated monitoring and logging alerts affecting database utilities and file transfers, tracing diagnosis through remediation and recovery procedures while preserving backup and access requiremen

Tenable logoTE

Cloud Services QA Intern

Jun 2017 - Aug 2017 (2 months)

Designed and executed functional, integration, and regression tests for cloud service APIs, validating payload schemas and SQL records before release validation across over 40 scenarios. Diagnosed authorization and negative-test defects through application logs and REST responses, documenting reproducible evidence and verifying fixes during release validation with zero missed severity-one issues.

EL

Software Developer Intern

Envieta Systems LLC

Dec 2016 - Mar 2017 (3 months)

Built Python routines that ingested API and flat-file records, transformed values through parsing and validation, and persisted results with SQL while documenting over 25 repeatable test cases. Automated CLI development tasks and database troubleshooting with Python and shell scripts, connecting source-control changes, unit testing, and deployment support for application components.

AI

Computer Network Technician

Advantage Technical Resourcing, Inc.

Feb 2014 - Apr 2015 (1 year 2 months)

Diagnosed TCP/IP, DNS, routing, and switching faults across workstations and network devices, applying configuration and remediation procedures that restored service for over 30 monthly incidents. Installed and patched Windows and Linux systems, configured accounts and permissions, and documented monitoring findings and reusable command-line troubleshooting steps for support teams.

Education

Degrees, certifications, and relevant coursework

Amazon Web Services logoAS

Amazon Web Services

AWS Certified Solutions Architect - Associate, Cloud Architecture

2025 - 2025

AWS Certified Solutions Architect - Associate certification obtained in 2025.

Amazon Web Services logoAS

Amazon Web Services

AWS Certified Developer - Associate, Cloud Development

2024 - 2024

AWS Certified Developer - Associate certification obtained in 2024.

The Johns Hopkins University logoTU

The Johns Hopkins University

Master of Science, Computer Science

Master of Science in Computer Science from The Johns Hopkins University, completed in 2019.

Towson University logoTU

Towson University

Bachelor of Science, Computer Science

Bachelor of Science in Computer Science from Towson University, completed in 2017.

OffSec logoOF

OffSec

Offensive Security Wireless Professional (OSWP), Wireless Security

Offensive Security Wireless Professional (OSWP) certification from OffSec.

Amazon Web Services logoAS

Amazon Web Services

AWS Certified Cloud Practitioner, Cloud Fundamentals

2019 - 2019

AWS Certified Cloud Practitioner certification obtained in 2019.

CompTIA logoCO

CompTIA

CompTIA Security+, Security

CompTIA Security+ certification.

OffSec logoOF

OffSec

Offensive Security Certified Professional (OSCP), Offensive Security

Offensive Security Certified Professional (OSCP) certification from OffSec.

CompTIA logoCO

CompTIA

CompTIA Network+, Networking

CompTIA Network+ certification.

Interested in hiring Thomas?

You can contact Thomas and 600K+ other talented remote workers on Himalayas.

Message Thomas

People also viewed

View all talent

Get matched with your dream remote job

Sign up now and join over 1,000,000+ remote workers who receive personalized job alerts, curated job matches, and more for free!

Sign up
Himalayas profile for an example user named Frankie Sullivan