|
@ -18,7 +18,12 @@ import java.util.List;
|
18
|
18
|
* Spark统计单词个数示例
|
19
|
19
|
*
|
20
|
20
|
* @author lilb3@asiainfo.com
|
21
|
|
* @since 2019-07-01 15:36
|
|
21
|
* @since 2019-05-24 17:10
|
|
22
|
* 部署服务器方式:
|
|
23
|
* a) SpringBoot打包部署 需要在pom指定startClass为com.ai.ipu.example.spark.SparkExample
|
|
24
|
* $SPARK_HOME/bin/spark-submit --class org.springframework.boot.loader.JarLauncher --master local[4] /home/mysql/test/comp-example-1.0.jar iZm5e5xe1w25avi0io1f5aZ
|
|
25
|
* b) 普通打包部署 需要上传原包和依赖包 如框架日志ipu-basic-3.1-SNAPSHOT.jar, 多个jar以逗号隔开
|
|
26
|
* $SPARK_HOME/bin/spark-submit --class com.ai.ipu.example.spark.SparkExample --master local[4] --jars /home/mysql/test/ipu-basic-3.1-SNAPSHOT.jar /home/mysql/test/comp-example-1.0.jar.original iZm5e5xe1w25avi0io1f5aZ
|
22
|
27
|
**/
|
23
|
28
|
public class SparkExample {
|
24
|
29
|
public static void main(String[] args) {
|