Senior Data Engineer (f/m/d)

Berlin / Headquarters or remote working, Full-time

Who we are looking for

We are looking for a solution-oriented Senior Data Engineer with strong communication skills to join our team. The right candidate will become the owner of multiple projects & processes on our Data Platform and will help us build a state of the art data processing solution. You will work in cross-functional, feature-oriented squads such as the Spotify model and you will support your colleagues and team members in sharing knowledge in pair-programming and coding review sessions.

What we offer

  • Be part of a growing team making fast decisions, where you can watch your ideas and actions come to fruition. This is what adds up to time well-spent – not mere billable hours
  • Diversity: intellectual as well as cultural – join a welcoming international team of smart and open-minded people, where it’s easy to make friends
  • A Personal Development Plan, along with access to dedicated resources to ensure that you can be the best in your role
  • Work-family-friends balance – step off the treadmill and feel like a human again: our office is all about maintaining a healthy balance between a results-driven work environment and your all-around wellbeing
  • An opportunity to be the change you want to see: at CrossLend you can use your skills to not only make a good living, but to enhance the transparency of the financial ecosystem
  • Creative ownership – drive the business forward with your ideas, launch projects from the ground up and see them through from inception to completion, giving your input and galvanising your colleagues while you bring out the best in each other

What you bring on board

  • 3-5 years of professional experience as a data engineer in a fast-paced environment
  • Master’s degree in Computer Sciences, or Master’s degree of Sciences in Engineering, or Physics and 2+ years of engineering exp and 1+ years of management exp, OR regardless of uni degree, 5+ years of engineering exp and 2+ years of management experience
  • Expert knowledge in Python and SQL
  • Ability to make decisions to ensure the software which is built, is architecturally consistent and of high quality
  • In-depth understanding of data structures and data pipelines (incl. performance related dependencies)
  • Experience with data integration, data transformation and database Schema Design and Evolution
  • Experience in building RESTful APIs (e.g., Flask or FastAPI)
  • Knowledge in CI/CD and DevOps practices
  • Experience with Docker and Kubernetes is a plus
  • Background in software testing
  • Ability to communicate with our Data Scientists (being able to read R is a plus)
  • Familiarity in distributed processing (Apache Spark/Apache Flink)
  • Good knowledge of Linux and Shell
  • Ability to develop data pipelines/workflows (Apache Airflow)

Why do we need you

  • Model ETL processes, transform and sanitise data, schedule workflows, transform and transition data with Apache Airflow
  • Connect our internal data warehouse with external sources
  • Assure reliability, consistency and availability of data flows
  • Create a robust and scalable framework for connecting external interfaces
  • Ensure data science models and algorithms can be run on production level
  • Support the data science and backend teams in terms of SLA
  • Support your colleagues and team members, working collaboratively and sharing knowledge in pair-programming and coding review sessions
  • Report directly to the Engineering Manager Data

What we are doing

CrossLend is developing a platform to connect institutional sellers (originators) and buyers (investors) of loans on a large scale. Originators are providing historical data that are used to create prediction models. Based on the predictions, investors can run several types of analytics to define their investment criteria. Once an investment is done, the platform will be fed with updates about the loan performance to provide further portfolio analysis. This provides investors with a high level of transparency to prevent crashes like the one that happened in 2008. In an additional step, the purchased loans can be resold on the platform to create a liquid market for loans to enable a better flow of capital between countries in the European Union.