Ben W.

Ben W.

Senior Data Engineer

New York, United States of America
Hire Ben W. Hire Ben W. Hire Ben W.

About Me

Ben is a Senior Data Engineer specializing in SQL, Python, and UNIX/Linux and providing technical expertise and leadership in solution implementation within OLTP and OLAP environments. He is hands-on in the development and deployment of robust data processing pipelines and streams, handling ETL processes, architecture, storage, reliability, accuracy, monitoring, and infrastructure on different workflow projects.

Work history

UpStack
UpStack
Senior Data Engineer
2020 - Present (4 years)
Remote
  • Building and improving databases, acquiring data, ETL/ELT, Big Data pipelines, and deploying cloud services on projects.

  • Administering infrastructure solutions to improve data models, increase data accessibility, and foster data-driven solutions for clients.

  • Implementing monitoring solutions to ensure data integrity and working closely with engineers, product managers, and other stakeholders.

Tracer
Tracer
Senior Data Engineer
2022 - Present (2 years)
New York, United States of America

Working on a data intelligence platform that revolutionizes modern data stack management by eliminating technical complexity, consolidating data sources, and enriching data with business insights.

Google
Google
SQL Business Analyst
2018 - 2020 (2 years)
New York, United States of America
  • Created ETL workflows to migrate data from Big Query to Google's internal Dremel SQL environment for use in performance dashboards.

  • Developed an operations dashboard to pull data on live bugs and report on KPIs and refactored the “milestone” workflow to notify users of progress more accurately.

  • Built an audience sizing dashboard solution to give stakeholders a better understanding of their markets on the “Perk” campaign project.

Big QueryPythonSeleniumETLGoogle AnalyticsSQLDashboards Analytical Dashboards Key Performance Indicators (KPIs)
Truveris
Truveris
Data Engineer | Data Analyst
2014 - 2018 (4 years)
New York, United States of America
  • Led processes to remove legacy data-importer applications from Truveris' infrastructure and replaced them with the latest Foreign Data Wrappers (FDW).

  • Designed a claims reversal algorithm to identify pairs of positive and negative transactions within a dataset using PostgreSQL window functions.

  • Gathered and isolated slow and problematic queries for refactoring, reducing a long-running query's runtime by 46%.

Meridian-IQ (now Discovery Data)
Meridian-IQ (now Discovery Data)
Data Analyst
2011 - 2014 (3 years)
New York, United States of America
  • Migrated a product database to AWS RDS MySQL instance, improving the existing data schema with proper indexing for app performance, and logged data anomalies to MongoDB.

  • Recommended solutions to align with business goals, interfacing with Salesforce systems for data hygiene and matching inconsistent client CRM data through SAS macros.

  • Scheduled automated data transfers on the project via Shell Scripting.

  • Analyzed financial adviser markets through proprietary data models and established data feeds for clients.

  • Generated ROI reports on various trade shows.

  • Established and managed FTP server for secure data transfer.

MEDTRX
MEDTRX
Database Analyst
2009 - 2011 (2 years)
Paramus, NJ, United States of America
  • Wrote ad hoc queries and T-SQL stored procedures to meet client needs, migrating time-sensitive claims into the adjudication system.

  • Handled and managed FTP data feeds from various sites, maintaining client connectivity to MEDTRX systems.

  • Produced final output reports for clients using Visual Studio 2005 Reporting Services and oversaw the printing of time-sensitive claims with legal deadlines.

T-SQLMicrosoft Visual StudioSQLSQL Server Reporting Services (SSRS) FTP Microsoft AccessDesktop Support SQL Stored Procedures

Portfolio

Data Engineer - Foreign Data Wrapper
Data Engineer - Foreign Data Wrapper

Led an initiative to remove old data loader applications from Python codebase and introduced the use of Postgres Foreign Data Wrappers, refactoring referential data loaders on the solution.

SQL Business Analyst - Perk Automation
SQL Business Analyst - Perk Automation

Developed an email and notification system that sends rewards to Google Maps users. The solution was built within Google's internal Dremel and Plx environments.

Education

PostgreSQL 10 Database Administration
PostgreSQL 10 Database Administration
PostgresCourse.com
2018 - 2018
BSc Information Systems (minored in Business and IT)
BSc Information Systems (minored in Business and IT)
Marist College
2005 - 2009 (4 years)