Java 类名:com.alibaba.alink.operator.batch.dataproc.StratifiedSampleWithSizeBatchOp
Python 类名:StratifiedSampleWithSizeBatchOp
功能介绍
本算子对输入数据的每个类别进行指定个数的分层随机抽样。
参数说明
| 名称 | 中文名称 | 描述 | 类型 | 是否必须? | 取值范围 | 默认值 |
|---|---|---|---|---|---|---|
| strataCol | 分层列 | 分层列 | String | ✓ | ||
| strataSizes | 采样个数 | 采样个数, eg, a:10,b:30 | String | ✓ | ||
| strataSize | 采样个数 | 采样个数 | Integer | -1 | ||
| withReplacement | 是否放回 | 是否有放回的采样,默认不放回 | Boolean | false |
代码示例
Python 代码
from pyalink.alink import *import pandas as pduseLocalEnv(1)df = pd.DataFrame([['a',0.0,0.0],['a',0.2,0.1],['b',0.2,0.8],['b',9.5,9.7],['b',9.1,9.6],['b',9.3,9.9]])batchData = BatchOperator.fromDataframe(df, schemaStr='x1 string, x2 double, x3 double')sampleOp = StratifiedSampleWithSizeBatchOp() \.setStrataCol("x1") \.setStrataSizes("a:1,b:2")batchData.link(sampleOp).print()
Java 代码
import org.apache.flink.types.Row;import com.alibaba.alink.operator.batch.BatchOperator;import com.alibaba.alink.operator.batch.dataproc.StratifiedSampleWithSizeBatchOp;import com.alibaba.alink.operator.batch.source.MemSourceBatchOp;import org.junit.Test;import java.util.Arrays;import java.util.List;public class StratifiedSampleWithSizeBatchOpTest {@Testpublic void testStratifiedSampleWithSizeBatchOp() throws Exception {List <Row> df = Arrays.asList(Row.of("a", 0.0, 0.0),Row.of("a", 0.2, 0.1),Row.of("b", 0.2, 0.8),Row.of("b", 9.5, 9.7),Row.of("b", 9.1, 9.6),Row.of("b", 9.3, 9.9));BatchOperator <?> batchData = new MemSourceBatchOp(df, "x1 string, x2 double, x3 double");BatchOperator <?> sampleOp = new StratifiedSampleWithSizeBatchOp().setStrataCol("x1").setStrataSizes("a:1,b:2");batchData.link(sampleOp).print();}}
运行结果
| x1 | x2 | x3 | | —- | —- | —- |
| a | 0.0000 | 0.0000 |
| b | 9.1000 | 9.6000 |
| b | 0.2000 | 0.8000 |
