Senior Data Engineer

• The U.S. Government agencies we work with have contracts that require all personnel working on their corresponding contracts to have U.S. citizenship - do you meet this requirement?

Accrete AI is looking for a Senior Data Engineer that will be responsible for supporting production data pipelines, developing the foundation for the Accrete data lake, and implementing best practices from data engineering at Accrete. This will support new and existing applications running on Linux and Windows operating systems in private and public cloud infrastructures. The Data Engineering team at Accrete designs, develops, and maintains data pipelines, batch data analytics, and data stores of various kinds, including analytics and stores in support of artificial intelligence workloads for Accrete AI systems and applications.

Accrete is an AI prime defense contractor with the U.S. government that creates AI software, enabling its customers to make better decisions, faster. Accrete is on a mission to create AI so powerful it amplifies human reasoning and enables enterprises to grow in previously unimaginable ways. Prior to launching Accrete in 2017, Prashant Bhuyan, Accrete's Founder and CEO, spent over a decade in high-frequency trading where he and a core team experimented with and developed AI technology that ultimately became the early underpinnings of Accrete.

Accrete's solutions enable the Department of Defense to predict covert behavior from foreign adversaries seeking to influence the supply chain; the U.S. Air Force to identify vulnerabilities in microprocessor firmware; major music labels to identify superstars before competitors; auto dealers to automatically generate marketing content from vehicle feature lists; employee benefits brokers to identify the shortest path to the hottest leads; and more.

To learn more about Accrete, please visit our website: Accrete.ai

Responsibilities:

• Design, code, and debug software, data pipelines, and analytics
• Provide technical guidance in software design and development activities.
• Supervising and overseeing all aspects of data engineering on multiple projects.
• Work with other Engineers in planning, prioritizing and executing assigned tasks within deadlines.
• Be the backstop ensuring that Accrete data pipelines are bug-free, high-quality, scalable, and available to support Accrete customers
• Recommend new technologies to ensure quality and productivity.
• Work closely with other teams, tech leads, architects, and Product Management to bring new data-backed products to market.

Requirements

• 5+ years of expertise with a data-oriented language, such as Python or Scala
• 5+ years experience in cloud computing, with AWS, Azure or GCP
• 5+ years experience designing and building scalable, reliable data pipelines using the following technologies: Hadoop, Hive, Spark, Kafka, Airflow, or similar services
• Experiencing designing for and implementing in cloud-native systems
• Expertise in matching APIs, data access patterns, and data storage formats
• Detailed knowledge of event processing systems such as Apache Kafka or similar
• Detailed knowledge of the following databases or equivalent: Postgres, MongoDB, Neo4J, Redis
• High collaborative, values mentoring, teaching, pair-programming, and teaching software development best practices to other engineers
• Excellent problem-solving and critical-thinking skills
• Ability to build and maintain effective, trusting partnerships with product managers, architects, and technical leads for individual products and applications
• Excellent communication and leadership skills

The base salary range for this position is: $160,000 - $180,000 USD

Benefits

We offer a competitive salary, benefits package, and opportunities for growth and advancement within the company. If you are an innovative and results-driven leader, we encourage you to apply for this exciting opportunity.

Accrete is an equal opportunity/affirmative action employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.