multithreading - 同一工人上的螺栓的 Apache Storm 问题

Question

我有一个关于 Apache Storm 以及多线程如何工作的问题。

我们有 2 个螺栓相互传输数据： Prediction Bolt 到 FragmentFilter 螺栓 两个螺栓都在使用端口 6705 的同一个工人上，如图所示： worker_description

当我打开日志时，我注意到预测螺栓停止工作以让 FragmentFilter 螺栓完成他的工作，根据以下日志和信息，它们没有并行运行：

2021-10-01 15:26:12.492 oastShellBolt Thread-20 [INFO] ShellLog pid:28655, name:predictions start process 2021-10-01 15:26:12.492 oastShellBolt Thread-20 [INFO] ShellLog pid:28655, name :predictions end process 2021-10-01 15:26:12.492 oastShellBolt Thread-20 [INFO] ShellLog pid:28655, name:predictions start process 2021-10-01 15:26:12.492 oastShellBolt Thread-20 [INFO] ShellLog pid ：28655，名称：预测结束进程 2021-10-01 15:26:12.492 oastShellBolt Thread-20 [INFO] ShellLog pid:28655，名称：预测开始进程 2021-10-01 15:26:12.493 oastShellBolt Thread-20 [ INFO] ShellLog pid:28655, name:predictions end process 2021-10-01 15:26:12.545 STDIO Thread-11-FragmentFilter-executor[4 4] [INFO] Emitted values: [227aea40-2e7e-421c-91b3-da8259b8bd15 , ] 2021-10-01 15:26:12。635 STDIO Thread-11-FragmentFilter-executor[4 4] [INFO] 发出的值：[7255c225-a8c5-41bc-8b4e-7f640063a0ee，] 2021-10-01 15:26:12.643 STDIO Thread-11-FragmentFilter-executor[ 4 4] [INFO] 发出的值：[66665829-f708-4f2e-8e5d-ee8866d91662，] 2021-10-01 15:26:12.857 STDIO Thread-11-FragmentFilter-executor[4 4] [INFO] 发出的值：[ e2b8bde1-747a-4546-8e19-30c7623ab0a1，] 2021-10-01 15:26:12.974 STDIO Thread-11-FragmentFilter-executor[4 4] [INFO] 发出的值：[17278f27-ae05-4bb0-a20c-9ca6a0ccdab1， ] 2021-10-01 15:26:13.156 STDIO Thread-11-FragmentFilter-executor[4 4] [INFO] 发出的值：[24715630-93c4-40bd-9086-0671c486e692，] 2021-10-01 15:26： 13.180 STDIO Thread-11-FragmentFilter-executor[4 4] [INFO] 发出的值：[501ca1e5-c2ed-45b0-ae90-313f4103548c，] 2021-10-01 15:26:13。611 STDIO Thread-11-FragmentFilter-executor[4 4] [INFO] 发射值：[c575e479-53c5-47cd-b3bb-521e75c83028, ] 2021-10-01 15:26:13.844 STDIO Thread-11-FragmentFilter-executor[ 4 4] [INFO] 发出的值：[e5d6ee4d-6202-43f9-a9ef-17d9be5b02f7，] 2021-10-01 15:26:13.916 STDIO Thread-11-FragmentFilter-executor[4 4] [INFO] 发出的值：[ 4b04c06c-b92d-439c-b5ed-64bb52b1d7fc，] 2021-10-01 15:26:14.091 STDIO Thread-11-FragmentFilter-executor[4 4] [INFO] 发射值：[28c9a824-fedf-4478-8d2d-fade0289438e， ] 2021-10-01 15:26:14.435 STDIO Thread-11-FragmentFilter-executor[4 4] [INFO] 发出的值：[675a05f0-7f88-4f65-a26e-6f25723db0ae，] 2021-10-01 15:26： 14.781 STDIO Thread-11-FragmentFilter-executor[4 4] [INFO] 发出的值：[1547c67f-6e37-4f24-aabc-cedd11a050ff，] 2021-10-01 15:26:14。816 STDIO Thread-11-FragmentFilter-executor[4 4] [INFO] 发射值：[d037c364-35c8-4364-b305-403d48fb0f77，] 2021-10-01 15:26:14.816 STDIO Thread-11-FragmentFilter-executor[ 4 4] [INFO] 发出的值：[369b8eee-f8ac-43bf-af81-f087f6de62f6，] 2021-10-01 15:26:15.095 STDIO Thread-11-FragmentFilter-executor[4 4] [INFO] 发出的值：[ 9a85a64f-0261-41bc-9672-27d039cbab5c, ] 2021-10-01 15:26:15.234 STDIO Thread-11-FragmentFilter-executor[4 4] [INFO] 发出的值：[4d306b23-06a6-42b0-88e2-28ba9deaaad9, ] 2021-10-01 15:26:15.260 STDIO Thread-11-FragmentFilter-executor[4 4] [INFO] 发出的值：[9b6aaa36-2223-4f1b-9653-1e60ede94f8b，] 2021-10-01 15:26： 15.285 STDIO Thread-11-FragmentFilter-executor[4 4] [INFO] 发出的值：[76d3dbb4-1546-45ad-993b-5fa3efad8087，] 2021-10-01 15:26:15。399 STDIO Thread-11-FragmentFilter-executor[4 4] [INFO] 发射值：[d9644f1a-85e0-46e1-bbfd-faa85cd145b7，] 2021-10-01 15:26:15.479 STDIO Thread-11-FragmentFilter-executor[ 4 4] [INFO] 发出的值：[894a12fb-7b06-4c1c-9976-386b0100fd71，] 2021-10-01 15:26:15.693 STDIO Thread-11-FragmentFilter-executor[4 4] [INFO] 发出的值：[ 6bad7162-d811-4712-8049-3ed2c5b69f29, ] 2021-10-01 15:26:15.697 STDIO Thread-11-FragmentFilter-executor[4 4] [INFO] 发射值：[8dfb1d95-c869-4b1f-b660-9d4cc7320a30, ] 2021-10-01 15:26:15.711 STDIO Thread-11-FragmentFilter-executor[4 4] [INFO] 发出的值：[1c102b77-da2b-4af9-bb11-bfc04dedad24，] 2021-10-01 15:26： 15.728 STDIO Thread-11-FragmentFilter-executor[4 4] [INFO] 发出的值：[f66c2bc0-ba67-45a7-9c41-cd64b7ae70d5，] 2021-10-01 15:26:15。855 STDIO Thread-11-FragmentFilter-executor[4 4] [INFO] 发出的值：[ca2679b1-13d0-405b-ab76-9ff89cfc3729，] 2021-10-01 15:26:15.975 STDIO Thread-11-FragmentFilter-executor[ 4 4] [INFO] 发出的值：[75b20990-12b7-4d88-a2e1-23541e5b1b78，] 2021-10-01 15:26:15.991 STDIO Thread-11-FragmentFilter-executor[4 4] [INFO] 发出的值：[ bf7c2551-3a63-46bd-906e-e403a4a6a26b, ] 2021-10-01 15:26:16.095 STDIO Thread-11-FragmentFilter-executor[4 4] [INFO] 发射值：[b360b50a-1a31-4e05-ac23-a798740d8d5d5 ] 2021-10-01 15:26:16.168 STDIO Thread-11-FragmentFilter-executor[4 4] [INFO] 发出的值：[033862c7-ac16-49ef-bb82-eb1c87739508，] 2021-10-01 15:26： 16.257 oastShellBolt Thread-20 [INFO] ShellLog pid:28655，名称：预测启动过程 2021-10-01 15:26:16.257 oastShellBolt Thread-20 [INFO] ShellLog pid:28655，名称：预测开始 add_row 2021-10-01 15:26:16.333 oastShellBolt Thread-20 [INFO] ShellLog pid:28655, name:predictions end add_row 2021-10-01 15:26:16.333 oastShellBolt Thread-20 [INFO] ShellLog pid： 28655，名称：预测结束进程 2021-10-01 15:26:16.334 oastShellBolt Thread-20 [INFO] ShellLog pid:28655，名称：预测开始进程 2021-10-01 15:26:16.334 oastShellBolt Thread-20 [INFO ] ShellLog pid:28655, name:predictions start update 2021-10-01 15:26:16.337 oastShellBolt Thread-20 [INFO] ShellLog pid:28655, name:predictions end update 2021-10-01 15:26:16.337 oastShellBolt Thread -20 [INFO] ShellLog pid:28655, name:predictions end process 2021-10-01 15:26:16.337 oastShellBolt Thread-20 [INFO] ShellLog pid:28655, name:predictions start processShellBolt Thread-20 [INFO] ShellLog pid:28655, name:predictions end add_row 2021-10-01 15:26:16.333 oastShellBolt Thread-20 [INFO] ShellLog pid:28655, name:predictions end process 2021-10-01 15 :26:16.334 oastShellBolt Thread-20 [INFO] ShellLog pid:28655, name:predictions start process 2021-10-01 15:26:16.334 oastShellBolt Thread-20 [INFO] ShellLog pid:28655, name:predictions start update 2021- 10-01 15:26:16.337 oastShellBolt Thread-20 [INFO] ShellLog pid:28655, name:predictions end update 2021-10-01 15:26:16.337 oastShellBolt Thread-20 [INFO] ShellLog pid:28655, name:predictions结束进程 2021-10-01 15:26:16.337 oastShellBolt Thread-20 [INFO] ShellLog pid:28655, name:predictions start processShellBolt Thread-20 [INFO] ShellLog pid:28655, name:predictions end add_row 2021-10-01 15:26:16.333 oastShellBolt Thread-20 [INFO] ShellLog pid:28655, name:predictions end process 2021-10-01 15 :26:16.334 oastShellBolt Thread-20 [INFO] ShellLog pid:28655, name:predictions start process 2021-10-01 15:26:16.334 oastShellBolt Thread-20 [INFO] ShellLog pid:28655, name:predictions start update 2021- 10-01 15:26:16.337 oastShellBolt Thread-20 [INFO] ShellLog pid:28655, name:predictions end update 2021-10-01 15:26:16.337 oastShellBolt Thread-20 [INFO] ShellLog pid:28655, name:predictions结束进程 2021-10-01 15:26:16.337 oastShellBolt Thread-20 [INFO] ShellLog pid:28655, name:predictions start process预测结束进程 2021-10-01 15:26:16.334 oastShellBolt Thread-20 [INFO] ShellLog pid:28655，名称：预测开始进程 2021-10-01 15:26:16.334 oastShellBolt Thread-20 [INFO] ShellLog pid： 28655，名称：预测开始更新 2021-10-01 15:26:16.337 oastShellBolt Thread-20 [INFO] ShellLog pid:28655，名称：预测结束更新 2021-10-01 15:26:16.337 oastShellBolt Thread-20 [INFO ] ShellLog pid:28655, name:predictions end process 2021-10-01 15:26:16.337 oastShellBolt Thread-20 [INFO] ShellLog pid:28655, name:predictions start process预测结束进程 2021-10-01 15:26:16.334 oastShellBolt Thread-20 [INFO] ShellLog pid:28655，名称：预测开始进程 2021-10-01 15:26:16.334 oastShellBolt Thread-20 [INFO] ShellLog pid： 28655，名称：预测开始更新 2021-10-01 15:26:16.337 oastShellBolt Thread-20 [INFO] ShellLog pid:28655，名称：预测结束更新 2021-10-01 15:26:16.337 oastShellBolt Thread-20 [INFO ] ShellLog pid:28655, name:predictions end process 2021-10-01 15:26:16.337 oastShellBolt Thread-20 [INFO] ShellLog pid:28655, name:predictions start processShellBolt Thread-20 [INFO] ShellLog pid:28655, name:predictions end update 2021-10-01 15:26:16.337 oastShellBolt Thread-20 [INFO] ShellLog pid:28655, name:predictions end process 2021-10-01 15 :26:16.337 oastShellBolt Thread-20 [INFO] ShellLog pid:28655, name:predictions start processShellBolt Thread-20 [INFO] ShellLog pid:28655, name:predictions end update 2021-10-01 15:26:16.337 oastShellBolt Thread-20 [INFO] ShellLog pid:28655, name:predictions end process 2021-10-01 15 :26:16.337 oastShellBolt Thread-20 [INFO] ShellLog pid:28655, name:predictions start process

预测螺栓的 Thread-20 似乎在 2021-10-01 15:26:12.493 停止，让 thread-11（FragmentFilter Bolt）处理信息，然后 Bolt 预测在 2021-10-01 15:26:16.257 重新开始工作在这个过程中损失了 4 秒。这给我们带来了巨大的延迟问题。

这正常吗？我们该如何解决？

标签： multithreadingapache-storm