Platform - Ingest - Senior Software Engineer (Java/Ruby)

The Platform Ingest team at Elastic build tools to collect and ingest data easily efficiently and quickly . Learn more about them on our website here or by testing the data ingestion user experience yourself on Elastic Cloud . We are responsible for Elastic Agent as a unified data collector for Elastic solutions Fleet as a central management platform Integrations platform as a marketplace experience to discover and build third party integrations to bring data into the Elastic Stack and the data transformation and processing tooling of Logstash ingest pipelines and runtime fields. We are also working to embed the OpenTelemetry collector within the Elastic Stack to promote data interoperability and enable OTel users to get the benefit of Elastic’s battle-tested visualizations analytics and machine learning capabilities.

As an Engineer on the Logstash/Data Processing team you will be part of a team working on development of the core Logstash platform and plugins and contributing to the OpenTelemetry collector.

The Logstash project is an open source streaming ETL (extract-transform-load) tool that collects data from multiple sources reshaping and enriching it and pushing it to multiple destinations. It is structured around a set of more than 200 plugins and a core platform that wires these plugins together into one or multiple continuously processing pipelines. The project is written in a mix of JRuby and Java.

Our team is small and distributed across the globe and we communicate mostly through Slack GitHub email and Zoom.

What you'll be doing:

• Designing and implementing new features for Logstash and its plugins in Java and JRuby.

• Maintaining updating and improving existing code and dependencies while ensuring automated test coverage.

• Adding new features and making contributions to the Open Telemetry Collector.

• Engaging with multiple public GitHub repositories and community forums.

• Providing Pull Request reviews and guidance to your peers.

• Caring for the needs of our users and enterprise customers.

• Collaborating with other teams to drive product goals.

• Working together with the support organization to help our customers.

What you'll bring:

• Ability to work in a remote-first environment with excellent verbal and written communication.

• Critical thinking positivity autonomy and adaptability.

• A track record of developing distributed applications preferably in Java and/or Ruby and willingness to learn additional languages.

• Experience with test-driven development and/or software delivery backed by comprehensive testing continuous integration and automation.

• Experience in back-end distributed application development (cloud orchestration Linux/Windows services etc).

• Knowledge of stream processing platforms (such as Kafka) database technologies (e.g. Postgres or MySQL) and network technologies (e.g. TCP UDP and HTTP).

• 5+ years of industry experience.

What would help:

• Hands-on experience with Docker and Kubernetes.

• Exposure to the Elastic stack.

• Go development.

• Open source software development.

• Experience with or interest in OpenTelemetry.