Senior Data Engineer (ML Ops)

Accrete AI · New York City, NY

Company

Accrete AI

Location

New York City, NY

Type

Full Time

Job Description

  • The U.S. Government agencies we work with have contracts that require all personnel working on their corresponding contracts to have U.S. citizenship - do you meet this requirement?

Accrete AI is looking for a Senior Data Engineer (ML Ops) that will be responsible for supporting production data pipelines, developing the foundation for the Accrete data lake, and implementing best practices from data engineering at Accrete. This will support new and existing applications running on Linux and Windows operating systems in private and public cloud infrastructures. The Data Engineering team at Accrete designs, develops, and maintains data pipelines, batch data analytics, and data stores of various kinds, including analytics and stores in support of artificial intelligence workloads for Accrete AI systems and applications.

Accrete is an AI prime defense contractor with the U.S. government that creates AI software, enabling its customers to make better decisions, faster. Accrete is on a mission to create AI so powerful it amplifies human reasoning and enables enterprises to grow in previously unimaginable ways. Prior to launching Accrete in 2017, Prashant Bhuyan, Accrete's Founder and CEO, spent over a decade in high-frequency trading where he and a core team experimented with and developed AI technology that ultimately became the early underpinnings of Accrete.

Accrete's solutions enable the Department of Defense to predict covert behavior from foreign adversaries seeking to influence the supply chain; the U.S. Air Force to identify vulnerabilities in microprocessor firmware; major music labels to identify superstars before competitors; auto dealers to automatically generate marketing content from vehicle feature lists; employee benefits brokers to identify the shortest path to the hottest leads; and more.

To learn more about Accrete, please visit our website: Accrete.ai

Responsibilities:

  • Design, code, and debug software, data pipelines, and analytics
  • Provide technical guidance in software design and development activities.
  • Supervising and overseeing all aspects of data engineering on multiple projects.
  • Work with other Engineers in planning, prioritizing and executing assigned tasks within deadlines.
  • Be the backstop ensuring that Accrete data pipelines are bug-free, high-quality, scalable, and available to support Accrete customers
  • Provide training and mentor other Engineers.
  • Recommend new technologies to ensure quality and productivity.
  • Work closely with other teams, tech leads, architects, and Product Management to bring new data-backed products to market.

Requirements

  • 6+ years of expertise with a data-oriented language, such as Python or Scala
  • 5+ years experience in cloud computing, with AWS, Azure or GCP
  • Expertise deploying analytics and machine learning algorithms through Airflow, Kubeflow, Sagemaker, or similar
  • Experience with deep learning frameworks and managing deep learning models in production
  • 5+ years experience designing and building scalable, reliable data pipelines using the following technologies: Hadoop, Hive, Spark, Kafka, Airflow, or similar services
  • Experiencing designing for and implementing in cloud-native systems
  • Expertise in matching APIs, data access patterns, and data storage formats
  • Detailed knowledge of event processing systems such as Apache Kafka or similar
  • Detailed knowledge of the following databases or equivalent: Postgres, MongoDB, Neo4J, Redis
  • High collaborative, values mentoring, teaching, pair-programming, and teaching software development best practices to other engineers
  • Excellent problem-solving and critical-thinking skills
  • Ability to build and maintain effective, trusting partnerships with product managers, architects, and technical leads for individual products and applications
  • Excellent communication and leadership skills

The base salary range for this position is: $160,000 - $210,000 USD

Benefits

We offer a competitive salary, benefits package, and opportunities for growth and advancement within the company. If you are an innovative and results-driven leader, we encourage you to apply for this exciting opportunity.

Accrete is an equal opportunity/affirmative action employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.

Date Posted

04/18/2023

Views

0

Back to Job Listings Add To Job List Company Profile View Company Reviews
Positive
Subjectivity Score: 0.9

Similar Jobs

Senior Software Engineer, Devices Automation - Block

Views in the last 30 days - 0

Square a company that has evolved since its inception in 2009 is seeking a Software Engineer with extensive experience in embedded devices and test en...

View Details

Senior HRIS Analyst - Madison Square Garden Entertainment Corp.

Views in the last 30 days - 0

Madison Square Garden Entertainment Corp MSG Entertainment is a leading live entertainment company operating renowned venues such as Madison Square Ga...

View Details

IT Support Engineer (Contract) - Informa

Views in the last 30 days - 0

Curinos a company with decades of expertise in the financial services industry is seeking an IT Support Engineer for their New York office The role in...

View Details

Engineer, Quality Assurance – BBU (EQA1) - JMA Wireless

Views in the last 30 days - 0

JMA is a leading company in wireless technology particularly in 5G with its advanced softwarebased platform manufactured in Syracuse NY The companys t...

View Details

Staff Editor, Current Events - Dotdash Meredith

Views in the last 30 days - 0

The Staff Editor role involves coordinating crossplatform content across multiple verticals managing daily and breaking news and writingediting storie...

View Details

Software Engineering Lead - Dotdash Meredith

Views in the last 30 days - 0

Dotdash Meredith is seeking a skilled Engineering Lead for a missioncritical role in designing and scaling their nextgeneration publishing platform Th...

View Details