Data Engineer
Permanent employee, Full-time · Berlin
Your mission
- Build brand new unified Learning Analytics platform with Lakehouse approach using S3 Storage, Apache Iceberg, Dremio, Spark and Superset.
- Maintain & Deliver reports from existing Learning Analytics Platform based on AWS services such as Lambdas, RDS.
- Implement the Lakehouse Architecture in Cloud Agnostic way using open-source tools to be able to handle factor 200 and more than we handle today, run it in a European based sovereign cloud.
- Define, enhance and implement new data collections, transfer and analysis processes.
- Work Closely in cross-functional teams with people of different expertise areas
- Opportunities to work on cross-functional topic to support product development, business development and educational scientists
Your profile
- Python expert in development, package management, test driven development and continuous deployment.
- While maintaining our infrastructure, you need to utilize “Infrastructure as Code” (IaC) via Terraform and typescript.
- Strong knowledge about Data Lake and Data Lakehouse Architectures
- Base knowledge about Data Warehouse concepts & tools, as also data models (3rd NF vs. Star Schema).
- Proficiency in PostgreSQL & SQL.
- Experience with S3 based storages (minIO) & Apache Iceberg.
- Explicit knowledge about Parquet/AVRO/ORC, Apache Arrow, Hive, spark or dremio & superset is a heavy plus
- programming and scripting skills in shell, typescript and JavaScript is a plus
- very good understanding of Kubernetes, docker, docker-compose, *NIX / Linux
- knowledge about CQRS/event sourcing
- practicing & advocating CI/CD, using git (GitHub)
- Data-oriented personality: From origin, consuming, processing, harmonizing & cleaning, historization, to presentation and insights - an analytical mind and inclination for problem-solving
- Strong verbal and written communication skills, attention to detail
- Alignment with our code of conduct and company values: Take Action, Create Impact, Use Data, Take Ownership, and Learn & Improve.
Don't worry if you don't match every single qualification listed. Remember, "jack-of-all-trades" or "unicorns" are rare. If you have a strong background in data analysis, developer competencies, and the right mindset, we'd love to hear from you.
Why us?
- we are purpose driven and want to make an impact in digital education
- from developer to C-level we have decades of experience in building digital products, thinking in agile ways for reacting to fast changing environments
- we foster a strong DevOps, Software-Crafting and QA culture
- on a day-to-day basis, we try to work in TDD mode with pair programming and code reviews
- we have a radical data privacy commitment
- our development environment is Linux or MacOS based - with M365 ¯\\_(ツ)_/¯
You should definitely apply, if you’re part of a diversity/minority group, we strive to be the best possible environment for working with great people
Apply for this job
About us
bettermarks is a Berlin based EdTech startup which was founded in 2008.
Our goal is to improve math learning and teaching in schools worldwide.
We offer aan adaptive learning platform for highly interactive math books which enable students to learn from their mistakes.
With bettermarks students solve millions of exercises each week and in doing so experience hundreds of thousands of aha! effects.
Apply for this job
Your application!
We appreciate your interest in bettermarks GmbH. Please fill in the following short form. Should you have any difficulties in uploading your files, please contact us by mail at jobs@bettermarks.com.
I hereby confirm that I have read and understood the .*
Uploading document. Please wait.
Send application Please add all mandatory information with a * to send your application.
Cancel
