Data Engineer

Etraveli is now recruiting an experienced Data Engineer. The mission is to tie the departments together, and data is the rope.

Etraveli is the leading flight centric online travel agent (OTA) in the Nordic region. The core business is airline tickets and travel related services, targeted towards high volumes of price sensitive consumers. Expertise in travel e-commerce and economies of scale together with an impressive proprietary IT platform enables Etraveli to apply a scalable and profitable business model.

The core of the technical platform, the Internet Booking Engine (IBE), serves price comparison sites and customers with attractive travel options retrieved from centralised flight market places. Every minute, four million travel options are automatically assessed, compiled, and re-priced. Intense data analysis, price optimisation, and configuration automation is crucial in order to keep our margins high.

Bisam (Business Intelligence Statistical Analysis and Modelling) is our data science team. The Bisam initiative is still in the formation phase, but it is already an integral part of the company's operation and vision and has shown rewarding. The team is split across the offices in Uppsala and Göteborg and acts cross functional and cross department. The engaged roles span developers, analysts, database managers, and information engineers. You will sort under the Development department, which is managed from Göteborg.

The work as Data Engineer will centre around data integration and software configuration description for our operational data store. In accordance with Etraveli's data strategy we are in the process of introducing a massive parallel processing database in the information chain, building on the Cloudera Hadoop Distribution. You will be responsible for data description, integration of data streams and reference tables from the IBE, data normalisation and more. But it does not stop there. Etraveli's data stock with internal and external data is impressive and still rapidly growing in dimensions and volume.

Yourself, you are a computer scientist, mathematician, statistician, or similar by education with proved experience from data transformation in the Hadoop environment. You have a solid technical background in software development and configuration. Your role will be as a developer in the Development department, but you will work in close cooperation with database and system administrators in Operations. You have strong communication skills. Our team is small but strong, so you appreciate and are prepared to roll up your sleeves and dig in where there is need, whether that is internally, attending some random system configuration, or externally with requirement management or information engineering.

All in all, times will be great. You'll find yourself in a highly creative environment, surrounded by awesome coworkers, challenging problems, and demanding, rewarding customers.

Responsibilities

Data description, normalisation, and transformation
Data acquisition
Integration of data streams and other data sources into the operational data store
Configuration of data management software including streaming and scheduling software
Outreach review of technologies for data engineering
Integration of such technologies into existing environment
Information engineering

Required qualifications

University master degree in computer science, mathematics or comparable
Demonstrated database experience, SQL and NoSQL
Demonstrated experience from data definition and description
Demonstrated programming experience

Meriting experiences

Distributed storage and data layer tools (Hadoop, Hive, Kite)
Cluster computing and massive parallel processing (Spark, SQL, Cloudera Impala, HP Vertica)
Data stream transfer and aggregation technologies (Sqoop, Flume, Kafka)
Scheduling and data flow management (Oozie, Airflow)
System configuration (Windows server, GNU/Linux tool sets)
Scientific programming languages and frameworks (R, NumPy derivatives , Matlab)
Agile software development processes (Scrum)

Location. Sweden. Both Göteborg and Uppsala are possible.

Travels. Regular national commutes.

Keywords. MPP, SQL, Impala, Spark, Flume, Sqoop, Hadoop, OLAP