UCOVI Stage 3: Organise
Business Strategy & People Management: ★☆☆☆☆ Technical Work: ★★★★★ Analytical/Scientific: ★★☆☆☆
Business Strategy & People Management: ★☆☆☆☆
Technical Work: ★★★★★
Organise your data into a trustworthy analytical model that respects data management principles and best practice but fits the needs of your business. Design and build the model so that processing errors are simple to flag up and rectify, and new features are straightforward to build.
What manual processes can we automate? What checks are in place for errors and gaps in data? Do we have a warehouse load error reporting system? How do we validate the values in our lookup tables and minimise data redundancy?
IT and security teams, data engineers, data scientists and analysts.
Coding and engineering with data: designing data models and architecture that derive insightful features from raw data points.
Debugging and fixing ETL failures, designing incremental data processing systems, building history and dimension tables in ways that minimise storage and maximise information retained.
SQL, Python, Alteryx, DBT, Data Bricks. Database normalisation principles, batch processing, debugging, query optimisation.