Software Engineer

We are looking for a Data Engineer to join the Metadata Distribution squad within the Content Platform engineering organization. Our mission is to make content metadata accessible and useful by providing interfaces to unlock the creativity of internal teams and power core Spotify functionally. Content Platform brings content metadata to Spotify from music and podcast providers. We then model this metadata as Spotify’s core catalog entities – artists, albums, tracks, shows and episodes and make them available via datasets to the rest of the company.

You might already know us through the Metadata Entities product portfolio or Golden Datasets program. The team was one of the first squads at Spotify to develop a set of golden grade data products paving the road for other squads to adopt the practice. As we wrap up the company wide migration to the new generation of Track, Album and Artist entities, we’ll be switching our focus to podcast space and re-imagining our offering for podcast and new formats.

We keep pushing the quality standards to help our customers streamline their interactions with content metadata. Join us in this exciting space where you will get the chance to work with experienced data engineers and domain specialists, driving improvements in the quality of data at the source.

• Build large-scale batch and real-time data pipelines with data processing frameworks like Scio and Dataflow on Google Cloud Platform.
• Take an active role in evolving and promoting the new generation of metadata datasets being used by hundreds of users in Spotify everyday
• Initiate and drive projects that involve Golden Datasets, data quality, domain driven design and modelling in the metadata space
• Help craft and define standard practices for data production and consumption in areas such as data modeling, integrity controls, documentation, interface stability, versioning and flexibility
• Promote the value of Golden Dataset production/consumption across the company
• Collaborate with other software engineers, data scientists, ML specialists, and taking learning and leadership opportunities that will arise every single day
• Work in multi-functional agile teams to continuously experiment, iterate and deliver on new product objectives
• You’ll have the ability to impact other squads' efficiency, across the entire company

• You have professional experience working in a product creation environment
• You have strong coding skills preferably in Scala, Python and Java
• You are experienced with JVM-based data processing frameworks such as Beam and Spark
• You are knowledgeable about data modeling, data access, and data storage techniques and are passionate about evangelizing their standard methodologies
• You value building meaningful relationships with colleagues and partners
• You know how to deal with high volume heterogeneous data, preferably with distributed systems such as Hadoop, BigTable, and Cassandra.
• You have a deep understanding of system design, data structures, and algorithms.
• You care about agile software processes, data informed development, reliability, and responsible experimentation