Big Data: Architecture & infrastructure
Big Data is seen today as the oil of the 21st century. Fueled by the massive use of social networks, the boom in connected objects, the adoption of the quantified self and the digital transformation of businesses, the big data market continues to grow. By 2020, the value of the personal data of European consumers could approach 1 trillion euros according to the Boston Consulting Group. This training will allow you to consider the implementation of big data in your company.
Introduction to Big Data
Trainer and participants presentations
Big Data principles and challenges
The key numbers
The challenges (ROI / Confidentiality)
Big Data Architecture Concept
Big Data technologies
Market tools (MapR, Watson, Oracle Exalead, Microsoft, Teradata, Talend, Qlik Sense, AWS...)
Storage methods
Hot data
Lukewarm data
Archiving
Languages:
Python, Matlab, R, …
State of the art of Big Data
The main actors
The different professions of Big Data
Hardware Architecture
Storage
CPU/GPU
Memory
Network
Distributed Systems
Technical Architecture
Data Quality: use of an Open Data flow operation with Talend Data Quality
Data storage: Hadoop (HDFS), NoSQL (Cassandra, MongoDB)
Data dissemination
Streaming with Apache Kafka, Amazon AWS Kinesis
Real-time or deferred processing
Apache Spark
ELK
ElasticSearch
Logstash
Kibana
Distributed architectures: Hadoop clustering
Platform supervision: App Dynamix, Ambari
Application Architecture (case study)
The different stages of data management
Ingestion from the source
The transformation
Restitution / visualization
Predictive analysis
Workshop: 360 customer analysis
Business applications (use cases)
Text Analytics
Fraud detection
Customer targeting
Risks of the Big Data project
Business risks related to the framing of the scope
Strategic risks and lack of sponsorship
The KPIs
The maturity of market solutions
Safety, ethics & legal issues
Ensure data protection
The anonymization of data
Integrity check
Encryption of data
What is the blockchain?
Use case: Bitcoin
Conclusion (global debrief)
Interested to attend this training?
Your personal data will not be published. Required fields are marked *