Back to search
Mandatory Skills
You need to have the below skills.
路 At least 12+ Years of IT Experience with Deep understanding of component understanding around Spark Data Integration (PySpark, scripting, variable setting etc.), Spark SQL, Spark Explain plans.
路 Spark SME - Be able to analyse Spark code failures through Spark Plans and make correcting recommendations.
路 To be able to traverse and explain the architecture you have been a part of and why any particular tool/technology was used.
路 Spark SME - Be able to review PySpark and Spark SQL jobs and make performance improvement recommendations.
路 Spark - SME Be able to understand Data Frames / Resilient Distributed Data Sets and understand any memory related problems and make corrective recommendations.
路 Monitoring -Spark jobs using wider tools such as Grafana to see whether there are Cluster level failures.
路 Cloudera (CDP) Spark and how the run time libraries are used by PySpark code.
路 Prophecy - High level understanding of Low-Code No-Code prophecy set up and its use to generate PySpark code.
路 Ready to work at least three days from Sheffield (UK) office and accept changes as per customer policies.
Good to have skills.
Ideally, you should be familiar with
路 Collaboration with multiple customer stakeholders
路 Knowledge of working with Cloud Databases
路 Excellent communication and solution presentation skills.
