Senior Data Engineer - Real-Time Aviation Data Systems (ETLs)

About the company

Big Blue Analytics revolutionizes airline operations with our advanced cloud computing and AI solutions. Our sophisticated SaaS platform addresses real-time disruptions, setting the standard for resource management and punctuality. Our goal: to ensure timely arrivals for millions of passengers worldwide.

About the position

You'll be our first dedicated Data Engineer, laying the foundation for our data infrastructure as we scale. This is a unique opportunity to shape how we process gigabytes of real-time aviation data daily, build our data lake architecture, and enable data-driven decision making across the organization.

What You'll Own

• Architect Our Data Future: Design and implement scalable ETL pipelines using Airflow, migrating existing Python applications while ensuring zero downtime
• Real-Time Data Processing: Build systems to ingest, process, and analyze GB-scale daily aviation data streams, detecting and restructuring data changes for optimal queryability
• Data Lake Development: Lead the implementation of our data lake architecture, potentially incorporating DuckDB for analytical workloads
• Integration Excellence: Connect with diverse airline systems and data formats, ensuring seamless data flow from multiple sources
• Data Quality Guardian: Establish monitoring, validation, and alerting systems to guarantee data accuracy and reliability
• Security & Compliance: Implement robust data security practices and ensure compliance with aviation industry standards

Technical Requirements

Must-Have Skills

• Experience: 3+ years in senior data engineering roles with demonstrable impact
• Core Technologies:
  • Expert-level SQL and Python programming
  • Production experience with PostgreSQL and SQL Server
  • Hands-on experience with Apache Airflow or similar orchestration tools
  • Basic AWS services (S3, RDS, etc.)
  • Basic Docker and Kubernetes for containerized deployments
  • Monitoring and observability tools (Grafana experience preferred)

Nice-to-Have Skills

• Aviation industry knowledge (IATA/ICAO standards, airline operations)
• Experience with real-time data processing and change data capture
• DuckDB or similar analytical databases
• Advanced observability platforms (OpenTelemetry, Datadog)
• Experience with data lake architectures
• LLM/GenAI applications in data processing

Essential Qualities

• Problem Solver: You thrive on complex data challenges and find elegant solutions
• Quality Obsessed: You believe data quality is non-negotiable and build accordingly
• Autonomous: You take ownership and drive projects from concept to production
• Communicator: Fluent English with excellent written communication for async collaboration
• Detail-Oriented: You catch issues others miss and think through edge cases
• Learning Mindset: Excited to work with cutting-edge technologies and optimization algorithms

How do we work

We are a remote first company with an asynchronous methodology. We use Basecamp as the main communication tool, and we take some of their handbook as an inspiration. On this line, we work with a take on the ShapeUp methodology.

We offer

• Full-time position.
• Full remote company.
• Attractive salary (between €40k-€60k).
• Stock option program.
• Capacity to shape the future of the company.
• Flexible working hours.
• The opportunity to make an impact in the World of Airline Travel.