Senior Big Data Engineer, Team Leader, Fintech
Optasia, Greece
Job Description
Optasia is a fully-integrated B2B2X financial technology platform covering scoring, financial decisioning, disbursement amp; collection. We provide a versatile AI Platform powering financial inclusion, delivering responsible financing decision-making and driving a superior business model amp; strong customer experience with presence in 30 Countries anchored by 7 Regional Offices.
We are seeking for enthusiastic professionals, with energy, who are results driven and have can-do attitude, who want to be part of a team of likeminded individuals who are delivering solutions in an innovative and exciting environment.
Data is at the core of Optasia's growth plan and the Data Engineering team is a significant contributor to data-driven automated decision making. We are currently leveraging and ingesting data from multiple sources into our large-scale big data clusters and we are in the process of optimizing and modernizing our processes and infrastructure as the company scales.
As a Team Leader of a small Data Engineering team (approx. 2 members) you will be responsible for building, supervising, managing and motivating team members on a daily basis. Apart from that you need to be able to design and implement highly scalable end-to-end batch and streaming data pipelines and contribute to company’s success.
What you will do
- Lead the team technically in improving scalability, stability, accuracy, speed and efficiency of our existing Data systems
- Set clear team goals, delegate tasks and set deadlines, oversee day-to-day operation
- Discover training needs and provide coaching, listen to team members’ feedback and resolve any issues or conflicts
- Be comfortable navigating the following technology stack: Scala, Spark, java, Golang, Python3, scripting (Bash/Python), Hadoop, SQL, S3 etc
- Design, build, test and deploy new libraries, frameworks or full systems for our core systems while keeping to the highest standards of testing and code quality
- Work closely with experienced Data Engineers, Solution Architects, ML engineers and System Administrators for the design, delivery and support of the company’s end-to-end data processing workflows
- Develop, maintain and optimize our core libraries for batch processing and ingestion of large volumes of data to the big data infrastructure
- Build and maintain CI/CD orchestration
- Design and develop end-to-end data processing pipelines
What you will bring
- Bachelor's or Master's degree in Computer Science or Informatics
- 5+ years of experience in Data engineering
- Proven work experience as a team leader or supervisor
- Working experience in software/data engineering and/or operations/DevOps/DataOps
- Working experience with the Apache Hadoop ecosystem (YARN, HDFS, HBase, Spark)
- Working experience with relational and NoSQL technologies
- Systems administration skills in Linux
- Experience with the deployment, configuration and maintenance of distributed systems and data/software engineering tools
Optional requirements (will be considered a plus):
- Familiarity with infrastructure as code, e.g. Ansible
- Good understanding of Hadoop ecosystems
- Experience with data and ML flow engines and tools, e.g. Apache Airflow, Apache NiFi
- Passion for learning new technologies and eagerness to collaborate with other creative minds.
- Experience in working with secure code development guidelines and coding practices (i.e. OWASP, NIST)
Why you should apply
What we offer:
Competitive remuneration package
Extra day off on your birthday
Performance-based bonus scheme
Comprehensive private healthcare insurance
All the tech gear you need to work smart
Optasia’s Perks:
Be a part of a multicultural working environment
Meet a very unique and promising business and industry
Gain insights for tomorrow market’s foreground
A solid career path within our working family is ready for you
Continuous training and access to online training platforms
CSR activities and festive events within any possible occasion
Enjoy comfortable open space restaurant with varied meal options every day
Wellbeing activities access such as free on-site yoga classes, plus available squash court on our premises
Optasia’s Values
#1 Drive to Thrive: Fully dedicated to evolving. We welcome all challenges and learning opportunities.
#2 Customer-First Mindset: We go above and beyond to meet our partners’ and clients’ expectations.
#3 Bridge the Gap: Knowledge is shared, information is exchanged and every opinion counts.
#4 Go-Getter Spirit: We