hadoop - 有没有办法在为纱线构建的 giraph 中激活 Giraph Stats？

Question

似乎 Giraph Stas 仅使用 map-reduce （使用 -Phadoop2 mvn 配置文件构建的 giraph-1.3.0-snapshot ）写入日志。

有没有办法使用纱线在日志中激活 Giraph Stats（使用 -Phadoop_yarn mvn 配置文件构建的 giraph-1.3.0-snapshot）？

遵循 Giraph Stats 的示例。

2018-09-08 16:03:01,604 INFO org.apache.hadoop.mapreduce.Job: Counters:   42
File System Counters
    FILE: Number of bytes read=74623213
    FILE: Number of bytes written=75518013
    FILE: Number of read operations=0
    FILE: Number of large read operations=0
    FILE: Number of write operations=0
Map-Reduce Framework
    Map input records=1
    Map output records=0
    Input split bytes=44
    Spilled Records=0
    Failed Shuffles=0
    Merged Map outputs=0
    GC time elapsed (ms)=100
    CPU time spent (ms)=0
    Physical memory (bytes) snapshot=0
    Virtual memory (bytes) snapshot=0
    Total committed heap usage (bytes)=3087007744
Giraph Stats
    Aggregate bytes loaded from local disks (out-of-core)=0
    Aggregate bytes stored to local disks (out-of-core)=0
    Aggregate edges=12
    Aggregate finished vertices=0
    Aggregate sent message bytes=3154
    Aggregate sent messages=24
    Aggregate vertices=5
    Current master task partition=0
    Current workers=1
    Last checkpointed superstep=0
    Lowest percentage of graph in memory so far (out-of-core)=100
    Sent message bytes=1701
    Sent messages=12
    Superstep=2
Giraph Timers
    Initialize (ms)=653
    Input superstep (ms)=599
    Setup (ms)=58
    Shutdown (ms)=8967
    Superstep 0 Worker_Superstep0 (ms)=295
    Superstep 1 Worker_Superstep1 (ms)=605
    Total (ms)=10538
Zookeeper base path
    /_hadoopBsp/job_local881103217_0001=0
Zookeeper halt node
    /_hadoopBsp/job_local881103217_0001/_haltComputation=0
Zookeeper server:port
    cri:22181=0
File Input Format Counters
    Bytes Read=0
File Output Format Counters
    Bytes Written=0

标签： hadoopmapreducehadoop-yarngiraph

Answer 1

利用

-ca giraph.metrics.enable=true

如http://giraph.apache.org/options.html中所述