Peter Powell
- Data Engineer
- Lydney, GL15 6QA, UK
Personal Summary
I have over 20 years’ experience in providing a variety of Data Management solutions in Big Data environments (mainly Teradata), based on SQL scripting from multiple data sources including: -
- Reviewing established data processes to suggest solutions on data quality improvements.
- Designing, building & maintaining data acquisition pipelines.
- Providing input to requirements gathering in relation to DWH migrations and data remediations.
- Reverse engineering a QlikView dashboard; transitioning the data manipulation to the DWH to improve both performance & functionality of the Dashboard.
- Stakeholder management in relation to data requests.
- Delivery of data to be used to remediate customers when balances have been affected by product or tariff reference data issues.
- Working collaboratively with data visualization experts to establish data selection and cleansing rules for BI & MI Dashboards.
- Transformation of core database data into user specific tables; adding detail from DWH & alternatively sourced datasets.
- Design of data tables and data manipulation processes for ETL delivery of semantic layer data used within BI reporting and databases.
- Documenting data sources and processing methodologies.
- Performance tuning and bug fixing SQL code.
- Ad-hoc reporting from diverse databases as required.
- Supporting the Change Management Process by investigating data quality issues through knowledge gathering from business & industry experts.
Work Experience
Responsibilities: -
• Review & triage the SQL processes in Commercial Banking suggesting solutions on data quality & performance improvements.
• Impart knowledge of Teradata SQL and DBA table specific data with colleagues.
• Manage Stakeholder expectations during the project.
• Liaise with LBG DBA's to ensure revised SQL meets company standards.
Heathrow
Responsibilities: -
• Continuation of monthly report delivery utilising data from five company databases.
• Investigate the existing reports to determine their suitability and functionality; i.e. are they fit for purpose.
• Triage of existing SQL scripts to improve performance through changes to SQL processing, improvements in indexation and statistics collection.
• Input from the data perspective in relation to ongoing and pending projects for major clients.
(Contract position)
Heathrow
Responsibilities: -
• Conversion to alternative reporting tools, more suited to purpose, for on-going reporting requirements; PowerBI & an Azure database were chosen and initiated.
• Continuation of monthly report delivery aggregating data from five separate company databases following the departure of the incumbent Data Analyst.
• Creation of the documentation pertaining to the delivery of these reports.
• Investigate the existing reports to determine their suitability and functionality; i.e. are they fit for purpose.
• Creation of the data flow and report integration documentation pertaining to the existing reporting structure.
Responsibilities: -
• Triaging ECL code on the HPCC system in regard to bug fixes and epics raised in the Jira ticketing system.
• Supporting the Jira ticketing system & Gitlab code repository.
• Performing Code reviews on colleagues Jira tickets.
• Raising Jira tickets where coding bugs need to be investigated on the HPCC ECL scripts.
Responsibilities: -
• Taking business requirements and interpreting these to design, build and deliver prototype solutions into the Teradata Data Warehouse & then into DataStage ETL scripts.
• Designing models and then implementing ETL solutions (typically Teradata, IBM DataStage) to provide the structured data to the wider business.
• Working with off-shore colleagues to ensure smooth transition from prototype coding through the route to live ETL process in DataStage.
Responsibilities: -
• Performance tune SQL, in a Teradata environment, used in ETL processing of BI & MI Dashboard data to improve performance and accuracy.
• Reverse engineer an existing QlikView dashboard, transitioning the data manipulation to the DWH to improve both performance & functionality of the Dashboard.
• Review DWH Master and Reference Data tables for accuracy, providing feedback for future requirements gathering.
• Assist in aesthetic design of Executive Dashboard on Parcels Traffic metrics.
• Liaise with Third Party data providers to remediate issues found in Master Data and Reference Data tables; proposing, as necessary, the transition of metric calculations from Qlik to Teradata, correction of data types, improvements to table indexation and statistics collection.
Responsibilities: -
• Determine the degree of performance tuning possible on the clients existing Teradata tables, views and SQL scripts based on DBC performance data.
• Performance tune SQL scripts and Teradata views in clients Teradata Data Warehouse environment.
• Reporting on SQL code determined to be long running (i.e. over 2 mins in duration); could it be improved; do we have users who consistently abuse the system etc.
Nov 2015 - Mar 2016 Vacation and honeymoon in New Zealand
Mar 2011 - May 2011 Setting up contracting company and awaiting first contract.
New Zealand
Customer Data & Insight Team - EDF Energy
Doxford & Worthing
BCA (Temporary position)
Royal Portbury Dock
Responsibilities: -
• Safely transitioning vehicles across site, following company & dock company protocols regarding speed, safety and parking standards.
• Correctly assigning new vehicle location into hand held terminals so that next operative can easily locate the vehicle for onward delivery.
in New Zealand
followed by visa application
prior to job search and visa application.