![Page 1: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/1.jpg)
![Page 2: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/2.jpg)
●
●
![Page 3: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/3.jpg)
●●●●●●
![Page 4: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/4.jpg)
●
●
○○○
![Page 5: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/5.jpg)
●
●●●●●●
![Page 6: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/6.jpg)
HDFS
HBase
Impala
HDFS
RecordService
Spark
Linux Linux
Hive
![Page 7: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/7.jpg)
●●●
![Page 8: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/8.jpg)
DataNode
DataNode
DataNode
HBase client DFSClient
NameNode
![Page 9: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/9.jpg)
DataNode
DataNode
SLOW DataNode
HBase client DFSClient
NameNode
![Page 10: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/10.jpg)
●
○○○○
●●
![Page 11: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/11.jpg)
●●
○
●○ …
![Page 12: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/12.jpg)
●○○○
●●
![Page 13: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/13.jpg)
●
●
●●
○
![Page 14: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/14.jpg)
●○
○
○
![Page 15: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/15.jpg)
●●
○
●○
●
![Page 16: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/16.jpg)
●○
●●●●
![Page 17: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/17.jpg)
●●
●
getFileInfo
Globber#globFileSystem#createFileSystem
copyFromLocal
![Page 18: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/18.jpg)
●○○○○
○○○○
![Page 19: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/19.jpg)
●
●
●●
![Page 20: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/20.jpg)
Distributed System(HDFS, HBase, etc.)
htrace4-core API
SpanReceiver
htrace-web
●
●
●
![Page 21: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/21.jpg)
●
●
NameNode DataNode
DataNode
/local/file /local/file
/local/file
DataNode
/local/file
![Page 22: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/22.jpg)
![Page 23: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/23.jpg)
●
● htraced
NameNode DataNode
DataNode DataNode
![Page 24: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/24.jpg)
●●
○○
○○
![Page 25: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/25.jpg)
●○○
○
○
![Page 26: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/26.jpg)
![Page 27: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/27.jpg)
●●●
![Page 28: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/28.jpg)
●
●
●●
![Page 29: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/29.jpg)
●
FSClient DataNodeparent trace ID
![Page 30: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/30.jpg)
●○○○
Tracer tracer = new Tracer.Builder("FsShell"). conf(TraceUtils.wrapHadoopConf( SHELL_HTRACE_PREFIX, getConf())).build();
![Page 31: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/31.jpg)
●○
TraceScope piScope = tracer.newScope("calculatePi");try { calculatePi();} finally { piScope.close();}
![Page 32: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/32.jpg)
●○Span piSpan = piScope.getSpan();if (piSpan != null) { piSpan.addKVAnnotation(“piDigits”, Integer.toString(numPiDigits));}
![Page 33: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/33.jpg)
●○○○
Runnable myRunnable = tracer.wrap(myPiRunnable, “calculatePi”);
![Page 34: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/34.jpg)
●○
●○
●○○
![Page 35: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/35.jpg)
Tracer TraceScope
Span
TraceRunnableTracerPool
SpanIDSamplerowns
owns
creates
creates
creates
owns
owns
![Page 36: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/36.jpg)
●●●
![Page 37: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/37.jpg)
●
●
●●
![Page 38: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/38.jpg)
●○○
○
![Page 39: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/39.jpg)
●○○○○○
![Page 40: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/40.jpg)
●●●●●
●
![Page 41: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/41.jpg)
●
●●●
![Page 42: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/42.jpg)
●●
●●●●
![Page 43: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/43.jpg)
![Page 44: · Distributed System (HDFS, HBase, etc.) htrace4-core API SpanReceiver htrace-web](https://reader030.vdocuments.site/reader030/viewer/2022041010/5eb87b5796dc1938ca155bd9/html5/thumbnails/44.jpg)