优百课栈

标题: 《Spark Streaming技术内幕及源码剖析》 [打印本页]

作者: aixure    时间: 2023-1-22 10:56
标题: 《Spark Streaming技术内幕及源码剖析》
图书简介[url=]编辑[/url][url=] 播报[/url]
本书以大数据处理引擎Spark的稳定版本1.6.x为基础,从应用案例、原理、源码、流程、调优等多个角度剖析Spark上的实时计算框架SparkStreaming。在勾勒出SparkStreaming架构轮廓的基础上,从基本源码开始进行剖析,由浅入深地引导已具有Spark和SparkStreaming基础技术知识的读者进行SparkStreaming的进阶学习,理解SparkStreaming的原理和运行机制,为流数据处理的决策和应用提供了技术参考;结合SparkStreaming的深入应用的需要,对SparkStreaming的性能调优进行了分析,也对SparkStreaming功能的改造和扩展提供了指导。 [2]
本书适合大数据领域CTO、架构师、高级软件工程师,尤其是Spark领域已有SparkStreaming基础知识的从业人员阅读,也可供需要深入学习Spark、SparkStreaming的高校研究生和高年级本科生参考。 [1-2]

基本信息[url=]编辑[/url][url=] 播报[/url]
定价:49元
印次:1-1
ISBN:9787302464914
出版日期:2017.05.01
印刷日期:2017.03.24 [1]

图书目录[url=]编辑[/url][url=] 播报[/url]
第1章 Spark Streaming应用概述 ······1
1.1 Spark Streaming应用案例 ·······2
1.2 Spark Streaming应用剖析 ·····13
第2章 Spark Streaming基本原理 ····15
2.1 Spark Core简介 ··················16
2.2 Spark Streaming设计思想 ·····26
2.3 Spark Streaming整体架构 ·····30
2.4 编程接口 ·························33
第3章 Spark Streaming运行流程详解·············39
3.1 从StreamingContext的初始化到启动 ··········40
3.2 数据接收 ·························54
3.3 数据处理 ·························91
3.4 数据清理 ························115
3.5 容错机制 ························127
3.5.1 容错原理 ·························128
3.5.2 Driver容错机制 ·················152
3.5.3 Executor容错机制 ··············161
3.6 No Receiver方式 ···············167... [1]
3.7输出不重复·····················175
3.8消费速率的动态控制·········176
3.9状态操作························189
3.10窗口操作·······················212
3.11页面展示·······················216
3.12SparkStreaming应用程序的停止··········227
第4章SparkStreaming性能调优机制···········237
4.1并行度解析·····················238
4.1.1数据接收的并行度·············238
4.1.2数据处理的并行度·············240
4.2内存······························240
4.3序列化···························240
4.4BatchInterval···················241
4.5Task·······························242
4.6JVMGC·························242
第5章Spark2.0中的流计算··········245
5.1连续应用程序··················246
5.2无边界表unboundedtable····248
5.3增量输出模式··················249
5.4API简化··························250
5.5其他改进························250 [3]






欢迎光临 优百课栈 (https://www.ubkz.com/) Powered by Discuz! X3.4