Package org.apache.storm.perf
Class KafkaClientHdfsTopo
java.lang.Object
org.apache.storm.perf.KafkaClientHdfsTopo
This topo helps measure speed of reading from Kafka and writing to Hdfs.
 
Spout Reads from Kafka.
Bolt writes to Hdfs.
- 
Nested Class SummaryNested Classes
- 
Field SummaryFields
- 
Constructor SummaryConstructors
- 
Method Summary
- 
Field Details- 
SPOUT_NUM- See Also:
 
- 
BOLT_NUM- See Also:
 
- 
KAFKA_TOPIC- See Also:
 
- 
KAFKA_BOOTSTRAP_HOSTS- See Also:
 
- 
HDFS_URI- See Also:
 
- 
HDFS_PATH- See Also:
 
- 
HDFS_BATCH- See Also:
 
- 
DEFAULT_SPOUT_NUMpublic static final int DEFAULT_SPOUT_NUM- See Also:
 
- 
DEFAULT_BOLT_NUMpublic static final int DEFAULT_BOLT_NUM- See Also:
 
- 
DEFAULT_HDFS_BATCHpublic static final int DEFAULT_HDFS_BATCH- See Also:
 
- 
TOPOLOGY_NAME- See Also:
 
- 
SPOUT_ID- See Also:
 
- 
BOLT_ID- See Also:
 
 
- 
- 
Constructor Details- 
KafkaClientHdfsTopopublic KafkaClientHdfsTopo()
 
- 
- 
Method Details- 
getInt
- 
getStr
- 
mainCopies text file content from sourceDir to destinationDir. Moves source files into sourceDir after its done consuming.- Throws:
- Exception
 
 
-