Java 类名：com.alibaba.alink.operator.stream.dataproc.SplitStreamOp
Python 类名：SplitStreamOp

功能介绍

将数据集按比例拆分为两部分

参数说明

| 名称 | 中文名称 | 描述 | 类型 | 是否必须？ | 取值范围 | 默认值 | | —- | —- | —- | —- | —- | —- | —- |

| fraction | 拆分到左端的数据比例 | 拆分到左端的数据比例 | Double | ✓ | [0.0, 1.0] | |

| randomSeed | 随机数种子 | 随机数种子 | Integer | | | null |

代码示例

Python 代码

  1. from pyalink.alink import *
  3. import pandas as pd
  5. useLocalEnv(1)
  7. df_data = pd.DataFrame([
  8.     ['Ohio', 2000, 1.5],
  9.     ['Ohio', 2001, 1.7],
  10.     ['Ohio', 2002, 3.6],
  11.     ['Nevada', 2001, 2.4],
  12.     ['Nevada', 2002, 2.9],
  13.     ['Nevada', 2003,3.2]
  14. ])
  16. stream_data = StreamOperator.fromDataframe(df_data, schemaStr='f1 string, f2 bigint, f3 double')
  18. spliter = SplitStreamOp().setFraction(0.5)
  20. spliter.linkFrom(stream_data).print()
  22. StreamOperator.execute()

Java 代码

  1. import org.apache.flink.types.Row;
  3. import com.alibaba.alink.operator.stream.StreamOperator;
  4. import com.alibaba.alink.operator.stream.dataproc.SplitStreamOp;
  5. import com.alibaba.alink.operator.stream.source.MemSourceStreamOp;
  6. import org.junit.Test;
  8. import java.util.Arrays;
  9. import java.util.List;
  11. public class SplitStreamOpTest {
  12.     @Test
  13.     public void testSplitStreamOp() throws Exception {
  14.         List <Row> df_data = Arrays.asList(
  15.             Row.of("Ohio", 2000, 1.5),
  16.             Row.of("Ohio", 2001, 1.7),
  17.             Row.of("Ohio", 2002, 3.6),
  18.             Row.of("Nevada", 2001, 2.4),
  19.             Row.of("Nevada", 2002, 2.9),
  20.             Row.of("Nevada", 2003, 3.2)
  21.         );
  22.         StreamOperator <?> stream_data = new MemSourceStreamOp(df_data, "f1 string, f2 int, f3 double");
  23.         StreamOperator <?> spliter = new SplitStreamOp().setFraction(0.5);
  24.         spliter.linkFrom(stream_data).print();
  25.         StreamOperator.execute();
  26.     }
  27. }

运行结果

| f1 | f2 | f3 | | —- | —- | —- |

| Nevada | 2003 | 3.2000 |

| Ohio | 2000 | 1.5000 |

| Ohio | 2001 | 1.7000 |

| Ohio | 2002 | 3.6000 |

| Nevada | 2001 | 2.4000 |

| Nevada | 2002 | 2.9000 |