Senior Data Engineer

Business Intelligence & Data Management
New York, New York, 10013
Contract
Ref.: 140893
Job Summary:
Our client is seeking a Senior Data Engineer to join their team! This position is located in New York, New York or Bristol, Connecticut. 
 
Duties:
  • Design, build, and optimize large-scale data pipelines using Python, Spark, and Scala, maintaining strict uptime SLAs
  • Architect and develop reusable shared libraries that abstract complex business logic to ensure consistency across data pipelines
  • Maintain and enhance distributed data processing systems in production environments
  • Partner cross-functionally with Product Managers, Architects, and Engineering teams to deliver reliable and scalable data solutions
  • Develop and document standards for pipeline configuration, naming conventions, partitioning strategies, and governance best practices
  • Ensure high operational excellence, data quality, and reliability across datasets consumed by Engineering, Analytics, Data Science, and Operations teams
  • Identify performance bottlenecks and optimize for scale, cost efficiency, and reliability
  • Participate actively in Agile/Scrum ceremonies and contribute to continuous team improvement
  • Build strong relationships with internal stakeholders to understand evolving data needs and prioritize impactful enhancements
  • Maintain detailed documentation to support data governance, lineage, and compliance requirements
Desired Skills/Experience:
  • Bachelor’s degree in Computer Science, Engineering, or a related technical field 
  • 5+ years of experience building and maintaining large-scale data pipelines in production environments
  • Strong Python programming expertise with solid software engineering fundamentals
  • Hands-on experience with distributed processing frameworks such as Apache Spark
  • Experience with workflow orchestration tools such as Apache Airflow
  • Strong SQL skills with the ability to analyze and optimize complex datasets
  • Experience working in cloud environments 
  • Strong problem-solving and algorithmic thinking skills
  • Experience operating in production environments with uptime and reliability expectations
  • Excellent analytical, documentation, and communication skills
  • Self-starter with the ability to quickly learn new technologies and frameworks
Benefits:
  • Medical, Dental, & Vision Insurance Plans
  • Employee-Owned Profit Sharing (ESOP)
  • 401K offered
The approximate pay range for this position is between $62.00 and $89.00. Please note that the pay range provided is a good faith estimate. Final compensation may vary based on factors including but not limited to background, knowledge, skills, and location. We comply with local wage minimums.

At KellyMitchell, our culture is world class. We’re movers and shakers! We don’t mind a bit of friendly competition, and we reward hard work with unlimited potential for growth. This is an exciting opportunity to join a company known for innovative solutions and unsurpassed customer service. We're passionate about helping companies solve their biggest IT staffing & project solutions challenges. As an employee-owned, women-led organization serving Fortune 500 companies nationwide, we deliver expert service at a moment's notice.

By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from KellyMitchell and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy at https://www.careers.kellymitchell.com/privacy-policy
 
 
 
Apply Now
Use this form to submit your contact information & resume.
Share this job

Continue Browsing Similar Jobs

Senior Data Engineer
Business Intelligence & Data Manage...
New York, New York
Contract
Job Summary: Our client is seeking a Senior Data Engineer to join their team! This position is located in New York, New York or Bristol, Connecticut.    Duties: Design, build, and optimize large-scale data pipelines using Python...
Senior Application Security Architect
Business Intelligence & Data Manage...
Chicago, IL
Contract
Job Summary: Our client is seeking a Senior Application Security Architect to join their team! This position is remote.    Duties: Design, integrate, and implement information systems security infrastructure Assess potential sy...
Data Analyst
Business Intelligence & Data Manage...
Maryland Heights, Missouri
Contract
Job Summary: Our client is seeking a Data Analyst to join their team! This position is located hybrid in Maryland Heights, Missouri.    Duties: Perform detailed data analysis and validation across multiple systems to support ent...
AEM Cloud DevOps Engineer
Business Intelligence & Data Manage...
Remote, Oregon
Contract
Job Summary: Our client is seeking a AEM Cloud DevOps Engineer to join their team! This position is Remote.    Duties: Manage and support company websites built using Adobe Experience Manager Ensure content updates go live smoo...
SAP FICA Consultant
Business Intelligence & Data Manage...
Minneapolis, Minnesota
Contract
Job Summary: Our client is seeking a SAP FICA Consultant to join their team! This position is located in Minneapolis, Minnesota or Denver, Colorado.    Duties: Review and recommend improvements for SAP FICA module design artifac...
Data Engineer
Business Intelligence & Data Manage...
Santa Monica, California
Contract
Job Summary: Our client is seeking a Data Engineer to join their team! This position is located in Santa Monica, California.    Duties: Design, build, and maintain scalable data platform components for real-time and batch proces...
Business Analyst
Business Intelligence & Data Manage...
Indianapolis, IN
Contract
Job Summary: Our client is seeking a Business Analyst to join their team! This position is located in Indianapolis, Indiana. Duties: Create and support the documentation across key projects Write technical requirements and doc...
Client Engagement Tester
Business Intelligence & Data Manage...
Irving, Alaska
Contract
Job Summary: Our client is seeking a Senior Software Engineer to join their team! This position is located in Burbank, California.    Duties: Lead and contribute to software development initiatives from architectural design thro...
Lead Data Engineer
Business Intelligence & Data Manage...
Greenwood Village, Colorado
Contract
Job Summary: Our client is seeking a Lead Data Engineer to join their team! This position is located in Denver, Colorado.    Duties: Perform hands-on engineering and provide lead-level ownership to data engineering teams Collabor...
Network Operations Analyst
Business Intelligence & Data Manage...
Blue Ash, Ohio
Contract To Hire
Job Summary: Our client is seeking a Network Operations Analyst to join their team! This position is located in Blue Ash, Ohio.    Duties: Use experience and knowledge of WAN, LAN, and WLAN infrastructure to triage, diagnose, and...
Azure Data Engineer
Business Intelligence & Data Manage...
Irving, Texas
Contract
Job Summary: Our client is seeking an Azure Data Engineer to join their team! This position is located in Irving, Texas.    Duties: Lead the design, architecture, and implementation of key data initiatives and platform capabilit...
Information Security Architect
Business Intelligence & Data Manage...
Hopkins, Minnesota
Contract
Job Summary: Our client is seeking an Information Security Architect to join their team! This position is located in Hopkins, Minnesota.    Duties: Validate the design and operational effectiveness of IT General Controls and Clou...
Senior Marketing Data Analyst
Business Intelligence & Data Manage...
Irvine, California
Contract
Job Summary: Our client is seeking a Senior Marketing Data Analyst to join their team! This position is remote.   Duties: Design and implement test/control group frameworks for paperless billing campaigns Partner with marketing s...
Cloud Operations Manager
Business Intelligence & Data Manage...
Philadelphia, Pennsylvania
Contract
Job Summary: Our client is seeking a Cloud Operations Manager to join their team! This position is located in Philadelphia, Pennsylvania.    Duties: Develop long-term cloud strategies aligned with business goals, including migrat...
Technical Business Analyst
Business Intelligence & Data Manage...
Atlanta, Georgia
Contract
Job Summary: Our client is seeking a Technical Business Analyst to join their team! This position is remote.    Duties: Serve as the liaison between business units, technology, and support teams to ensure alignment on goals and r...
Business/Systems Analyst
Business Intelligence & Data Manage...
Maryland Heights, Missouri
Contract
Job Summary: Our client is seeking a Business/Systems Analyst to join their team! This position is located in Maryland Heights, Missouri.    Duties: Reviews, analyzes, and evaluates information technology systems operations Deter...
PostgreSQL Database Admin
Business Intelligence & Data Manage...
Saint Paul, Minnesota
Contract
Job Summary: Our client is seeking a PostgreSQL Database Admin to join their team! This position is located in Saint Paul, Minnesota.   Duties: Analyze, tune, and optimize database performance, including query analysis, indexing,...
Data and Analytics Manager
Business Intelligence & Data Manage...
Basking Ridge, New Jersey
Contract
Job Summary: Our client is seeking a Data and Analytics Manager to join their team! This position is located in Basking Ridge, New Jersey.    Duties: Structure, manage, and extract data from various business applications and sys...
Support Lead, ServiceNow IRM and GRC
Business Intelligence & Data Manage...
Chicago, Illinois
Contract
Job Summary: Our client is seeking a Support Lead, ServiceNow IRM and GRC to join their team! This position is located in Chicago, Illinois.    Duties: Lead the production support, enhancement delivery, and defect resolution for...
Senior Solution Architect (ServiceNow IRM)
Business Intelligence & Data Manage...
Chicago, Illinois
Contract
Job Summary: Our client is seeking a Senior Solution Architect (ServiceNow IRM) to join their team! This position is located in Chicago, Illinois.    Duties: Provide strategic vision for data architecture, platforms, and governa...
Senior Business Analyst, ServiceNow GRC/IRM
Business Intelligence & Data Manage...
Chicago, Illinois
Contract
Job Summary: Our client is seeking a Senior Business Analyst, ServiceNow GRC/IRM to join their team! This position is located in Chicago, Illinois.    Duties: Lead workshops and conduct interviews with business stakeholders to d...
Business Intelligence Developer
Business Intelligence & Data Manage...
Alpharetta , Georgia
Contract
Job Summary: Our client is seeking a Business Intelligence Developer to join their team! This position is located in Alpharetta, GA; Irving, TX and Basking Ridge, NJ.   Duties: Define business enhancement and reporting requiremen...
Data Modeler
Business Intelligence & Data Manage...
Atlanta, Georgia
Contract
Job Summary: Our client is seeking a Data Modeler to join their team! This position is located in Atlanta, Georgia.    Duties: Develop, maintain, and enhance conceptual, logical, and physical data models for various business doma...
System Analyst
Business Intelligence & Data Manage...
Irving, Texas
Contract
Job Summary: Our client is seeking a System Analyst to join their team! This position is remote.    Duties: Lead strategic projects and initiatives to enhance global supply chain systems and processes Act as liaison between busin...
LTE Protocol Engineer
Business Intelligence & Data Manage...
Bedminster, New Jersey
Contract
Job Summary: Our client is seeking a LTE Protocol Engineer to join their team! This position is located in Bedminster, New Jersey.    Duties: Develop and validate 5G and LTE new features and KPIs based on NR 5G and LTE protocols ...
OSP Project Coordinator
Business Intelligence & Data Manage...
Reston, Virginia
Contract
Job Summary: Our client is seeking a OSP Project Coordinator to join their team! This position is located in Reston, Virginia or Halethorpe, Maryland.    Duties: Develop and maintain project schedules and calendars with the input...
Data Scientist
Business Intelligence & Data Manage...
Irving, Texas
Contract
Job Summary: Our client is seeking a Data Scientist to join their team! This position is located in Irving, Texas.    Duties: Lead end-to-end data science projects, delivering innovative, data-driven solutions that address comple...
Database Engineering Manager
Business Intelligence & Data Manage...
Greenwood Village, Colorado
Contract To Hire
Job Summary: Our client is seeking a Database Engineering Manager to join their team! This position is located in Denver, Colorado.    Duties: Building and maintaining ETL process from various sources into company data environmen...
Senior Director, Business Strategy
Business Intelligence & Data Manage...
Basking Ridge, New Jersey
Contract
Job Summary: Our client is seeking a Senior Director, Business Strategy to join their team! This position is located in Basking Ridge, New Jersey.    Duties: Lead a team to drive end-to-end strategic projects for the business Dri...