Application
This unit describes the skills and knowledge required to capture and store transactional and non-transactional big data obtained from a variety of sources. It involves using methodologies and techniques to obtain big data sets. It also involves analysing and storing the captured big data according to industry practices and organisational policies, procedures and protocols.
It applies to those in a broad range of industries and job roles who, under some supervision and guidance, are responsible for obtaining, preparing and storing big data.
No licensing, legislative or certification requirements apply to this unit at the time of publication.
Elements and Performance Criteria
ELEMENT | PERFORMANCE CRITERIA |
1. Determine scope of big data capture | 1.1 Identify business need for big data capture 1.2 Determine timelines for capturing big data 1.3 Identify volume and variety of big data to be captured 1.4 Identify data storage and archive requirements |
2. Capture big data | 2.1 Develop a plan for big data capture according to organisational policies and procedures 2.2 Identify sources of big data relevant to business need 2.3 Obtain big data from identified sources according to legislative requirements and organisational policies and procedures 2.4 Apply big data cleansing methodologies 2.5 Re-create and recover big data lost during capture process according to organisational policies and procedures 2.6 Conduct data offload and archiving on big data and create report |
3. Store captured big data | 3.1 Organise obtained big data sets in a retrievable format 3.2 Confirm that big data is accurate, up-to-date, and comprehensive 3.3 Securely store big data and data capture report according to organisational procedures, legislative requirements, and industry practices |
Evidence of Performance
The candidate must demonstrate the ability to complete the tasks outlined in the elements, performance criteria and foundation skills of this unit, including evidence of the ability to:
capture, apply data cleansing, and store one set of transactional and one set of non-transactional big data relating to specific workplace needs
create a report relating to data capture for a specific workplace need for at least one set of transactional and one set of non-transactional big data.
Evidence of Knowledge
The candidate must be able to demonstrate knowledge to complete the tasks outlined in the elements, performance criteria and foundation skills of this unit, including knowledge of:
legislative requirements relating to big data capture and storage, including data protection, security and privacy laws and regulations
organisational policies and procedures relating to big data capture and storage, including for:
capturing, storing and reporting transactional and non-transactional sources of big data
cleansing methodologies when capturing big data
business intent of big data capture
re-creating and recovering big data lost during capture process
privacy concerns of predictive analytics organising security and retrieval of big data
quality assuring captured big data
data capture techniques to produce analytic ready data and datasets
big data features and their impact on data capture and storage, including velocity, volume, variety, value, and veracity
variability and complexity of big data:
structured and unstructured
transactional and non-transactional
framework for distributed storage of big data
platform solutions for capturing and storing big data
key features of organisational products and services related to big data capture
technologies, techniques and protocols for capturing, storing and retrieving big data
secure data access and control mechanisms of captured and stored big data
high availability and scalability challenges with big data.
Assessment Conditions
Skills must be assessed in a workplace or simulated environment where conditions are typical of a work environment that uses big data.
Access is required to:
information and data sources to inform big data capture
information and telecommunications equipment required to capture and store big data
industry standards, organisational procedures, and legislative requirements required to demonstrate the performance evidence.
Assessors of this unit must satisfy the requirements for assessors in applicable vocational education and training legislation, frameworks and/or standards.
Foundation Skills
Skill | Description |
Learning | Modifies behaviour following exposure to new information |
Numeracy | Interprets numerical data Completes at times complex calculations and records numerical data |
Oral communication | Asks open and closed probing questions and actively listens to identify work requirements |
Reading | Recognises and interprets information from relevant sources to determine organisational expectations and legal requirements |
Writing | Uses clear, specific and industry-related terminology to report on big data capture and storage |
Planning and organising | Efficiently and logically sequences the stages of big data capture and storage |
Technology | Uses appropriate technology platforms to capture and store big data |
Sectors
Data Literacy – Data Literacy