Software Engineer, AI and LLM Applications

At Airbyte, we are revolutionizing how data is moved and we give every Airbyte customers the ability to effectively manage their data. With the release of tools like ChatGPT and other LLM solutions, we believe every organization can get even more value from their data by leveraging Airbyte for their AI data pipelines. Airbyte is in a unique position to lead with the most robust featureset, while also delivering a simple and capable no-code UI experience for our customers.

As we expand our horizons into the AI space, we are seeking a Senior Engineer adept in AI and LLM applications who can help us develop the most compelling features to empower companies to reach the full potential of their data - and who can help us present these technologies through their writings and through other presentation methods. This is a unique opportunity to not just be at the forefront of an emerging technology, but also to discover and champion best practices for Airbyte customers and non-customers across the industry.

• Drive projects that reinforce Airbyte's reputation as a leader in data integration and AI solutions.
• Act as a developer advocate, writing impactful articles that elucidate best practices at the confluence of AI and data engineering.
• Lead the charge in expanding Airbyte's support for unstructured and text-based data sources and Vectorstores.
• Elevate Airbyte’s Connector Development Kits (CDKs) in the realm of LLM/AI applications.
• Innovate and lead in building robust support for Vectorstores as Airbyte destinations.
• Develop internal LLM/AI applications and proof-of-concepts that set the direction for our technological advancements.
• Collaborate across teams, ensuring alignment, quality, and swift delivery of projects.
• Advocate for Airbyte and our mission by crafting influential articles, attending conferences, and engaging with the community, especially within the San Francisco Bay Area.
• Engage with the open-source community via Github, Slack, and community events.

• 6+ years of software engineering experience
• A minimum of 3 years of experience in ML, with a demonstrable track record of successful projects.
• Hands-on experience with one or more LLM projects.
• Proficiency in Python is mandatory. Knowledge of Java/Kotlin will be an added advantage.
• Familiarity with ML and AI frameworks, for instance with TensorFlow, PyTorch, Langchain, LlamaIndex, or similar AI/ML framworks.
• Excellent communication skills, both written and verbal.
• Residing in or willing to relocate to the San Francisco Bay Area.
• Belief in our values

Location

• San Francisco. Hybrid, twice per week.