Your new role At NewDay
As the Senior Kafka Engineer, you will lead the architecture, design, and implementation of Kafka in a multi-tenant environment. You will ensure that the platform meets the needs of multiple teams while maintaining high levels of performance, reliability, and security. The role holder will work with Platform Engineers, Technical Architects, Data Engineers, and Analysts at NewDay and with B2B customers of the Data Platform.
0-12 months you’ll deliver
- Confluent Kafka platform configuration, deployment, administration and support.
- Ensuring all steps in these processes are automated and observable - IaC (Terraform).
- Troubleshoot Kafka platform in multiple type of environments.
- Ownership of problem isolation, resolution and bug reporting.
- Configure Kafka connectors for mainframe and enterprise database systems.
- Fine tune brokers for various use cases.
- Version upgrades, setting up DR solution and strategy with HA.
- Design and implement Kafka topics, data schemas (Avro), and ksqlDB objects.
- Work with Data Engineers to design and test performant event streaming applications and data pipelines.
- Work with AWS and Azure Security engineers to build security into the core of all deployments.
What you’ll bring
- Experience in building Kafka producer and consumer applications.
- Configuration and administration of Confluent Kafka in AWS and Azure.
- Integration of Kafka connectors with various sources of data.
- Experience of working with distributed data systems.
- Experienced Terraform developer; understanding of Infrastructure-as-Code and its application in modern cloud computing.
- Strong knowledge of computer networks including cloud networks, corporate networks (Firewalls, Proxies) and VPCs.
- AWS networks (VPC, VPN, Direct Connect, Route 53, Auto scaling, CloudWatch, GuardDuty, Network Firewall).
- Account management (IAM, AD integration).
- Good knowledge of virtualisation/containerisation.
- Strong knowledge of Continuous Integration & Deployment methodologies.
- Installation and configuration of ELK (Elastic, Fluentd, Kibana).
- EKS/Kubernetes experience.
- Python functional development experience.
- Linux scripting skills.
- Experience with SQL and NoSQL technologies.
- Working in Agile environments (mostly in Sprint teams).
- A strong and enthusiastic commitment to resolving customer problems in a high quality and timely manner.
And would love you to know or learn:
- Certifications on Confluent Kafka and Cloud Technologies are a plus
- Snowflake Experience
- Understanding of Data Vault design pattern
About NewDay
We help people move forward with credit,
and help our colleagues to move their careers forward too.
We use our highly flexible, scalable, and multi-product digital credit engine to power over 120 million transactions every year. Our brands include Aqua, marbles, fluid and Bip. We partner with leading brands such as John Lewis, AO, Argos and DEKO.
Over 5 million UK customers are supported by our award-winning customer service.
At NewDay, we value all types of diversity. We’re an equal opportunity employer and believe that our differences create a vibrant, authentic working culture. We want all our colleagues to feel able to bring their whole selves to work. We don’t discriminate on the basis of age, physical or mental disability, gender reassignment, marriage and civil partnership, pregnancy and carer status, race (including colour, nationality, and ethnic or national origin), religion or belief, sex and sexual orientation. We make sure that every job is crafted to be inclusive and that people with disabilities or caring responsibilities can take part in the application and interview process. Tell us if you need accommodations: we’ll put reasonable adjustments in place to support you.
Our dynamic NewDay culture
We’re focused on what will drive impact in helping people move forward with credit. Our distinctive culture is geared to spark innovation and team working – with lots of open doors for development. Our customers can rely on us because we aim high, support each other, do the right thing and build for the future.
We invest in our colleagues. On top of a strong market competitive salary, you get a bonus opportunity that matches the impact (delivery + values) you drive in your role. We also help you retire better with market leading pensions.
At NewDay, #yourwellbeing matters: You get 26 days holiday and can buy up to 5 more after probation. Then you’ll get extra days as you build your career with us.
NewWork, our flexible, hybrid working approach, helps you to manage your work/life balance - and even bolt on work time in other countries before or after your holiday. And when you’re in the office, you get free healthy breakfast, fresh juices, lunch, barista coffee etc
Our tax efficient green car and cycle to work schemes save you money (and help the planet).
Ask your Talent Acquisition Partner to tell you more about any of our perks.
Where next?
We work with Textio to make our job design and hiring inclusive
In the NewDay Tech team, you’ll join an Expert or Leader career pathway. This will guide you on what your next step here could look like, with regular and open feedback to help you build capabilities to move forward.
Let’s talk about this role – contact talent@newday.co.uk
#LI-JP1