Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [............X..X.....................X...X.................X] duration: 1m0.002800894s FAIL (2025-07-09 20:16:27 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== 24703004s) [seg_pos={0 0}, upload=316107]: Done begin upload segment. Jul 9 20:15:28.354085705 (395h5m3.12472705s) [noise=true , address=77.90.31.14:4666 , piece_id=4NTPCRYJ3MMEYTVKBZASYXZJNI7J2Y4D7JYB3IK7SPNSA7DQ7DRQ, seg_pos={0 0}, upload=316107]: Uploading piece... Jul 9 20:15:28.354107226 (395h5m3.124748621s) [noise=true , address=104.36.82.50:4014 , piece_id=MWSNFZUMBSXH7IQOWA5GHJXERMPSNV7CAGDZK2WAQ7SKSY4TPXCQ, seg_pos={0 0}, upload=316107]: Uploading piece... Jul 9 20:15:28.354433671 (395h5m3.125075006s) [noise=true , address=45.91.116.5:4323 , piece_id=VANTB7HW3WAU52KGGOTJOTNI5IRLUC7P3BM5QTGYL2DLYLETJ7AQ, seg_pos={0 0}, upload=316107]: Uploading piece... Jul 9 20:15:28.354477955 (395h5m3.12511929s) [noise=true , address=104.36.82.20:4468 , piece_id=QZADCJXOZB477PIURC4DPSTMDSZEE4HAF5M54BZVO5ZKK33WJRQQ, seg_pos={0 0}, upload=316107]: Uploading piece... Jul 9 20:15:28.354684851 (395h5m3.125326187s) [noise=true , address=79.127.219.48:4089 , piece_id=XSFMISWRKNJGMXD6POZDJV77TOS4HIFIIJNWYCD7F3QD4YNPCCHA, seg_pos={0 0}, upload=316107]: Uploading piece... Jul 9 20:15:28.354841150 (395h5m3.125482485s) [noise=true , address=104.36.82.44:4875 , piece_id=RAA4ORE323ZYLZLTRHPZZ32M4XTXC3PFNTRQE5J6KGR2FALMRCMQ, seg_pos={0 0}, upload=316107]: Uploading piece... Jul 9 20:15:28.354937394 (395h5m3.12557872s) [noise=true , address=79.127.205.233:4633 , piece_id=LPLD4G65ERLJR36ONQAHHOGIQNRMJ7CKIWKRF2WC4GQCBR4UWN3A, seg_pos={0 0}, upload=316107]: Uploading piece... Jul 9 20:15:28.355137778 (395h5m3.125779113s) [noise=true , address=104.36.82.34:4554 , piece_id=ZGY4RCMBDQVQES4AEP2ITNRY5P42A7SMHSD3VLDHPXJPCUQLIUKA, seg_pos={0 0}, upload=316107]: Uploading piece... Jul 9 20:15:28.355146354 (395h5m3.125787679s) [noise=true , address=104.36.82.40:4951 , piece_id=7GTZS2VFRD4JUZ2I3FFCKQAWHDVIDUT46POQEMFXH42TNAHL7AMQ, seg_pos={0 0}, upload=316107]: Uploading piece... Jul 9 20:15:28.355189166 (395h5m3.125830501s) [noise=true , address=77.90.31.21:4896 , piece_id=IQGUHALMX6TDIJPQOLQBZBFHUXBM2WEJO66OCVTV7H3423FKSNQQ, seg_pos={0 0}, upload=316107]: Uploading piece... Jul 9 20:15:28.355432642 (395h5m3.126073977s) [noise=true , address=77.90.31.18:4835 , piece_id=WKKOVEZYYRXIN2R5EELYEMGZS5NMONMW5XNRSCTHG2IYG5IENQPQ, seg_pos={0 0}, upload=316107]: Uploading piece... Jul 9 20:15:28.355669475 (395h5m3.12631081s) [noise=true , address=104.36.82.38:4695 , piece_id=TGOA66MQSGUWULI7LWDHCY7B4ULVB24LTDZHXBNMMVAM5HAOFKNQ, seg_pos={0 0}, upload=316107]: Uploading piece... Jul 9 20:15:28.355953709 (395h5m3.126595034s) [noise=true , address=77.90.31.21:4904 , piece_id=Q34VHLPRJWDZ7X3YHVY7HQQEMRG4IS3NAIPABDCLGSRQDOSGQUCQ, seg_pos={0 0}, upload=316107]: Uploading piece... Jul 9 20:15:28.356143542 (395h5m3.126784877s) [noise=true , address=104.36.82.3:4782 , piece_id=FT4TGHH5FWESYDKQ2RNW45XV6A2PXRQJYT6R62EFOWQT2PJBDHYQ, seg_pos={0 0}, upload=316107]: Uploading piece... Jul 9 20:15:28.356324498 (395h5m3.126965823s) [noise=true , address=104.36.82.17:4344 , piece_id=KCKPDZFMVYCBEQ4MSKQAMMSLVDOS4ON3MTEIZTZST3EVF3CGARTQ, seg_pos={0 0}, upload=316107]: Uploading piece... Jul 9 20:15:28.356551963 (395h5m3.127193298s) [noise=true , address=79.127.219.38:4016 , piece_id=QD4KB7NR7ZEQGTD7OR7MDM6YHUWQQEPWNGWKIMVXICCDN5NKUGKQ, seg_pos={0 0}, upload=316107]: Uploading piece... Jul 9 20:15:28.356640383 (395h5m3.127281708s) [noise=true , address=104.36.82.19:4408 , piece_id=GVGLSGYMRPEIVFDXEU5OJNIR3XUATE775URSPPCQHQAQPWABDHQA, seg_pos={0 0}, upload=316107]: Uploading piece... Jul 9 20:15:28.356880492 (395h5m3.127521827s) [noise=true , address=77.90.31.18:4829 , piece_id=A4RGZPI74L7IA3B7Y6N5NXDK4QO67XPWYPWWDVLNY43S2TISDTTA, seg_pos={0 0}, upload=316107]: Uploading piece... Jul 9 20:15:29.454660652 (395h5m4.225301987s) [upload=316107]: Next returned nil segment Jul 9 20:15:29.454678505 (395h5m4.22531984s) [upload=316107]: Waiting for error group managing segments... Jul 9 20:15:30.205151183 (395h5m4.975792518s) [noise=true , address=79.127.205.233:4633 , piece_id=LPLD4G65ERLJR36ONQAHHOGIQNRMJ7CKIWKRF2WC4GQCBR4UWN3A, seg_pos={0 0}, upload=316107]: Done uploading piece. err: <nil> Jul 9 20:15:30.246442359 (395h5m5.017083694s) [noise=true , address=79.127.219.38:4016 , piece_id=QD4KB7NR7ZEQGTD7OR7MDM6YHUWQQEPWNGWKIMVXICCDN5NKUGKQ, seg_pos={0 0}, upload=316107]: Done uploading piece. err: <nil> Jul 9 20:15:30.357472457 (395h5m5.128113792s) [noise=true , address=77.90.31.21:4904 , piece_id=Q34VHLPRJWDZ7X3YHVY7HQQEMRG4IS3NAIPABDCLGSRQDOSGQUCQ, seg_pos={0 0}, upload=316107]: Done uploading piece. err: <nil> Jul 9 20:15:30.357712226 (395h5m5.128353561s) [noise=true , address=77.90.31.14:4666 , piece_id=4NTPCRYJ3MMEYTVKBZASYXZJNI7J2Y4D7JYB3IK7SPNSA7DQ7DRQ, seg_pos={0 0}, upload=316107]: Done uploading piece. err: <nil> Jul 9 20:15:30.360319754 (395h5m5.130961089s) [noise=true , address=77.90.31.18:4835 , piece_id=WKKOVEZYYRXIN2R5EELYEMGZS5NMONMW5XNRSCTHG2IYG5IENQPQ, seg_pos={0 0}, upload=316107]: Done uploading piece. err: <nil> Jul 9 20:15:30.362608853 (395h5m5.133250189s) [noise=true , address=77.90.31.21:4896 , piece_id=IQGUHALMX6TDIJPQOLQBZBFHUXBM2WEJO66OCVTV7H3423FKSNQQ, seg_pos={0 0}, upload=316107]: Done uploading piece. err: <nil> Jul 9 20:15:30.369459720 (395h5m5.140101045s) [noise=true , address=77.90.31.18:4829 , piece_id=A4RGZPI74L7IA3B7Y6N5NXDK4QO67XPWYPWWDVLNY43S2TISDTTA, seg_pos={0 0}, upload=316107]: Done uploading piece. err: <nil> Jul 9 20:15:30.644973279 (395h5m5.415614614s) [noise=true , address=79.127.219.48:4089 , piece_id=XSFMISWRKNJGMXD6POZDJV77TOS4HIFIIJNWYCD7F3QD4YNPCCHA, seg_pos={0 0}, upload=316107]: Done uploading piece. err: <nil> Jul 9 20:15:32.136707691 (395h5m6.907349026s) [noise=true , address=45.91.116.5:4323 , piece_id=VANTB7HW3WAU52KGGOTJOTNI5IRLUC7P3BM5QTGYL2DLYLETJ7AQ, seg_pos={0 0}, upload=316107]: Done uploading piece. err: <nil> Jul 9 20:15:51.298396021 (395h5m26.069037356s) [noise=true , address=104.36.82.40:4951 , piece_id=7GTZS2VFRD4JUZ2I3FFCKQAWHDVIDUT46POQEMFXH42TNAHL7AMQ, seg_pos={0 0}, upload=316107]: Done uploading piece. err: <nil> Jul 9 20:15:58.535132852 (395h5m33.305774217s) [noise=true , address=104.36.82.50:4014 , piece_id=MWSNFZUMBSXH7IQOWA5GHJXERMPSNV7CAGDZK2WAQ7SKSY4TPXCQ, seg_pos={0 0}, upload=316107]: Done uploading piece. err: <nil> Jul 9 20:16:13.418388583 (395h5m48.189029918s) [noise=true , address=104.36.82.20:4468 , piece_id=QZADCJXOZB477PIURC4DPSTMDSZEE4HAF5M54BZVO5ZKK33WJRQQ, seg_pos={0 0}, upload=316107]: Done uploading piece. err: <nil> Jul 9 20:16:17.321265215 (395h5m52.091906541s) [noise=true , address=104.36.82.3:4782 , piece_id=FT4TGHH5FWESYDKQ2RNW45XV6A2PXRQJYT6R62EFOWQT2PJBDHYQ, seg_pos={0 0}, upload=316107]: Done uploading piece. err: <nil> Jul 9 20:16:20.782378120 (395h5m55.553019455s) [noise=true , address=104.36.82.17:4344 , piece_id=KCKPDZFMVYCBEQ4MSKQAMMSLVDOS4ON3MTEIZTZST3EVF3CGARTQ, seg_pos={0 0}, upload=316107]: Done uploading piece. err: <nil> Jul 9 20:16:20.782395263 (395h5m55.553036598s) [seg_pos={0 0}, upload=316107]: Segment reached optimal threshold of 14 pieces. Jul 9 20:16:20.782501565 (395h5m55.5531429s) [noise=true , address=104.36.82.34:4554 , piece_id=ZGY4RCMBDQVQES4AEP2ITNRY5P42A7SMHSD3VLDHPXJPCUQLIUKA, seg_pos={0 0}, upload=316107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12rSDkPXm47w73hry9W6BWwAiwNpB3cJuwedNt1JuSEEtd3Sup7): protocol: expected piece hash; context canceled; EOF Jul 9 20:16:20.782746023 (395h5m55.553387358s) [noise=true , address=104.36.82.38:4695 , piece_id=TGOA66MQSGUWULI7LWDHCY7B4ULVB24LTDZHXBNMMVAM5HAOFKNQ, seg_pos={0 0}, upload=316107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1scGuKGuDJCYuUGp5nDdU1Sxr23L7EEPChWtLAhZ52i3RpiF6y): protocol: write tcp 188.166.225.170:35004->104.36.82.38:4695: use of closed network connection; write tcp 188.166.225.170:35004->104.36.82.38:4695: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:35004->104.36.82.38:4695: use of closed network connection Jul 9 20:16:20.782793695 (395h5m55.55343503s) [noise=true , address=104.36.82.19:4408 , piece_id=GVGLSGYMRPEIVFDXEU5OJNIR3XUATE775URSPPCQHQAQPWABDHQA, seg_pos={0 0}, upload=316107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12evzqLGVaxayKpKejqBXNLwqTKyKNKa94NZYJBUCdvyUo3vhGJ): protocol: write tcp 188.166.225.170:39994->104.36.82.19:4408: use of closed network connection; write tcp 188.166.225.170:39994->104.36.82.19:4408: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39994->104.36.82.19:4408: use of closed network connection Jul 9 20:16:20.782826888 (395h5m55.553468223s) [noise=true , address=104.36.82.44:4875 , piece_id=RAA4ORE323ZYLZLTRHPZZ32M4XTXC3PFNTRQE5J6KGR2FALMRCMQ, seg_pos={0 0}, upload=316107]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ijEJgYouyMkUqpLWWz7eH2NGvvs9XpN2ujDjupPykDe5eWcB1): protocol: write tcp 188.166.225.170:49956->104.36.82.44:4875: use of closed network connection; write tcp 188.166.225.170:49956->104.36.82.44:4875: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:49956->104.36.82.44:4875: use of closed network connection Jul 9 20:16:20.782840114 (395h5m55.553481449s) [seg_pos={0 0}, upload=316107]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 20:16:20.782895189 (395h5m55.553536524s) [upload=316107]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 20:16:20.782898896 (395h5m55.553540221s) [upload=316107]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 20:16:21.238682565 (395h5m56.00932391s) [upload=316107]: Done uploading segments... Jul 9 20:16:21.238705379 (395h5m56.009346764s) [upload=316107]: Upload finished. err: <nil> Duration: 1m0.002823929s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 6.282982093s FAIL (2025-07-09 20:16:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.283002983s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.............X..X.....................X...X.................] duration: 26.596318224s FAIL (2025-07-09 20:15:27 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== . Jul 9 20:02:23.780217498 (394h51m58.550858883s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780676316 (394h51m58.551317641s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780936945 (394h51m58.55157827s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781177245 (394h51m58.55181858s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781413888 (394h51m58.552055213s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781644208 (394h51m58.552285543s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781895629 (394h51m58.552536954s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782135739 (394h51m58.552777074s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782318628 (394h51m58.552959953s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782512379 (394h51m58.553153714s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782777476 (394h51m58.553418801s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783024369 (394h51m58.553665704s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783212469 (394h51m58.553853804s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783488777 (394h51m58.554130102s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783681907 (394h51m58.554323232s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783865978 (394h51m58.554507313s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784048738 (394h51m58.554690073s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784240856 (394h51m58.554882191s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:24.899970585 (394h51m59.67061192s) [upload=315928]: Next returned nil segment Jul 9 20:02:24.899992798 (394h51m59.670634133s) [upload=315928]: Waiting for error group managing segments... Jul 9 20:02:25.204965397 (394h51m59.975606732s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.767637823 (394h52m0.538279158s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.775539020 (394h52m0.546180355s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.784443085 (394h52m0.55508442s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.786360713 (394h52m0.557002048s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.790650711 (394h52m0.561292046s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.795596423 (394h52m0.566237758s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.800154773 (394h52m0.570796108s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.809266435 (394h52m0.57990776s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:33.323814508 (394h52m8.094455843s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:54.619833778 (394h52m29.390475153s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:03.031749677 (394h52m37.802391012s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:08.267656661 (394h52m43.038297996s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696211223 (394h52m52.466852548s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696238234 (394h52m52.466879569s) [seg_pos={0 0}, upload=315928]: Segment reached optimal threshold of 14 pieces. Jul 9 20:03:17.696433668 (394h52m52.467075003s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f73dFC5Avj5HvkthE72J8wsV8b6xWAH9gVLqGEThS2b9rTjPk): protocol: expected piece hash; context canceled; EOF Jul 9 20:03:17.696504703 (394h52m52.467146038s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw): protocol: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection Jul 9 20:03:17.696540202 (394h52m52.467181537s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection Jul 9 20:03:17.696549359 (394h52m52.467190694s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vXrkhLqCofhR4Fmfqb98gxnqWQF6vMV4q3ATbRvPfcqi82WSo): protocol: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection Jul 9 20:03:17.696563035 (394h52m52.46720437s) [seg_pos={0 0}, upload=315928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 20:03:17.696661103 (394h52m52.467302428s) [upload=315928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 20:03:17.696665161 (394h52m52.467306496s) [upload=315928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 20:03:18.153388631 (394h52m52.924029966s) [upload=315928]: Done uploading segments... Jul 9 20:03:18.153408019 (394h52m52.924049354s) [upload=315928]: Upload finished. err: <nil> Duration: 26.59633675s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [........................X.........X..X...X........XX........] duration: 42.8322959s FAIL (2025-07-09 20:15:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 42.832332049s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 6.698093953s FAIL (2025-07-09 20:15:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.698114834s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [..............X..X.....................X...X................] duration: 54.110141318s FAIL (2025-07-09 20:15:00 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== . Jul 9 20:02:23.780217498 (394h51m58.550858883s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780676316 (394h51m58.551317641s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780936945 (394h51m58.55157827s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781177245 (394h51m58.55181858s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781413888 (394h51m58.552055213s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781644208 (394h51m58.552285543s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781895629 (394h51m58.552536954s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782135739 (394h51m58.552777074s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782318628 (394h51m58.552959953s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782512379 (394h51m58.553153714s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782777476 (394h51m58.553418801s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783024369 (394h51m58.553665704s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783212469 (394h51m58.553853804s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783488777 (394h51m58.554130102s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783681907 (394h51m58.554323232s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783865978 (394h51m58.554507313s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784048738 (394h51m58.554690073s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784240856 (394h51m58.554882191s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:24.899970585 (394h51m59.67061192s) [upload=315928]: Next returned nil segment Jul 9 20:02:24.899992798 (394h51m59.670634133s) [upload=315928]: Waiting for error group managing segments... Jul 9 20:02:25.204965397 (394h51m59.975606732s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.767637823 (394h52m0.538279158s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.775539020 (394h52m0.546180355s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.784443085 (394h52m0.55508442s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.786360713 (394h52m0.557002048s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.790650711 (394h52m0.561292046s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.795596423 (394h52m0.566237758s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.800154773 (394h52m0.570796108s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.809266435 (394h52m0.57990776s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:33.323814508 (394h52m8.094455843s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:54.619833778 (394h52m29.390475153s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:03.031749677 (394h52m37.802391012s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:08.267656661 (394h52m43.038297996s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696211223 (394h52m52.466852548s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696238234 (394h52m52.466879569s) [seg_pos={0 0}, upload=315928]: Segment reached optimal threshold of 14 pieces. Jul 9 20:03:17.696433668 (394h52m52.467075003s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f73dFC5Avj5HvkthE72J8wsV8b6xWAH9gVLqGEThS2b9rTjPk): protocol: expected piece hash; context canceled; EOF Jul 9 20:03:17.696504703 (394h52m52.467146038s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw): protocol: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection Jul 9 20:03:17.696540202 (394h52m52.467181537s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection Jul 9 20:03:17.696549359 (394h52m52.467190694s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vXrkhLqCofhR4Fmfqb98gxnqWQF6vMV4q3ATbRvPfcqi82WSo): protocol: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection Jul 9 20:03:17.696563035 (394h52m52.46720437s) [seg_pos={0 0}, upload=315928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 20:03:17.696661103 (394h52m52.467302428s) [upload=315928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 20:03:17.696665161 (394h52m52.467306496s) [upload=315928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 20:03:18.153388631 (394h52m52.924029966s) [upload=315928]: Done uploading segments... Jul 9 20:03:18.153408019 (394h52m52.924049354s) [upload=315928]: Upload finished. err: <nil> Duration: 54.110176114s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 6.366392139s FAIL (2025-07-09 20:14:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.36641385s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [.........................X.........X..X...X........XX.......] duration: 41.459815413s FAIL (2025-07-09 20:14:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 41.459914073s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 6.153917624s FAIL (2025-07-09 20:13:49 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.153938745s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [...............X..X.....................X...X...............] duration: 8.75724736s FAIL (2025-07-09 20:13:46 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== . Jul 9 20:02:23.780217498 (394h51m58.550858883s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780676316 (394h51m58.551317641s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780936945 (394h51m58.55157827s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781177245 (394h51m58.55181858s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781413888 (394h51m58.552055213s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781644208 (394h51m58.552285543s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781895629 (394h51m58.552536954s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782135739 (394h51m58.552777074s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782318628 (394h51m58.552959953s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782512379 (394h51m58.553153714s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782777476 (394h51m58.553418801s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783024369 (394h51m58.553665704s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783212469 (394h51m58.553853804s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783488777 (394h51m58.554130102s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783681907 (394h51m58.554323232s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783865978 (394h51m58.554507313s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784048738 (394h51m58.554690073s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784240856 (394h51m58.554882191s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:24.899970585 (394h51m59.67061192s) [upload=315928]: Next returned nil segment Jul 9 20:02:24.899992798 (394h51m59.670634133s) [upload=315928]: Waiting for error group managing segments... Jul 9 20:02:25.204965397 (394h51m59.975606732s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.767637823 (394h52m0.538279158s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.775539020 (394h52m0.546180355s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.784443085 (394h52m0.55508442s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.786360713 (394h52m0.557002048s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.790650711 (394h52m0.561292046s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.795596423 (394h52m0.566237758s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.800154773 (394h52m0.570796108s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.809266435 (394h52m0.57990776s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:33.323814508 (394h52m8.094455843s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:54.619833778 (394h52m29.390475153s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:03.031749677 (394h52m37.802391012s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:08.267656661 (394h52m43.038297996s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696211223 (394h52m52.466852548s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696238234 (394h52m52.466879569s) [seg_pos={0 0}, upload=315928]: Segment reached optimal threshold of 14 pieces. Jul 9 20:03:17.696433668 (394h52m52.467075003s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f73dFC5Avj5HvkthE72J8wsV8b6xWAH9gVLqGEThS2b9rTjPk): protocol: expected piece hash; context canceled; EOF Jul 9 20:03:17.696504703 (394h52m52.467146038s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw): protocol: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection Jul 9 20:03:17.696540202 (394h52m52.467181537s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection Jul 9 20:03:17.696549359 (394h52m52.467190694s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vXrkhLqCofhR4Fmfqb98gxnqWQF6vMV4q3ATbRvPfcqi82WSo): protocol: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection Jul 9 20:03:17.696563035 (394h52m52.46720437s) [seg_pos={0 0}, upload=315928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 20:03:17.696661103 (394h52m52.467302428s) [upload=315928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 20:03:17.696665161 (394h52m52.467306496s) [upload=315928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 20:03:18.153388631 (394h52m52.924029966s) [upload=315928]: Done uploading segments... Jul 9 20:03:18.153408019 (394h52m52.924049354s) [upload=315928]: Upload finished. err: <nil> Duration: 8.757275795s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [..........................X.........X..X...X........XX......] duration: 46.831699666s FAIL (2025-07-09 20:13:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 46.831711047s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [................X..X.....................X...X..............] duration: 56.362345866s FAIL (2025-07-09 20:13:37 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== . Jul 9 20:02:23.780217498 (394h51m58.550858883s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780676316 (394h51m58.551317641s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780936945 (394h51m58.55157827s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781177245 (394h51m58.55181858s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781413888 (394h51m58.552055213s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781644208 (394h51m58.552285543s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781895629 (394h51m58.552536954s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782135739 (394h51m58.552777074s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782318628 (394h51m58.552959953s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782512379 (394h51m58.553153714s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782777476 (394h51m58.553418801s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783024369 (394h51m58.553665704s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783212469 (394h51m58.553853804s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783488777 (394h51m58.554130102s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783681907 (394h51m58.554323232s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783865978 (394h51m58.554507313s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784048738 (394h51m58.554690073s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784240856 (394h51m58.554882191s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:24.899970585 (394h51m59.67061192s) [upload=315928]: Next returned nil segment Jul 9 20:02:24.899992798 (394h51m59.670634133s) [upload=315928]: Waiting for error group managing segments... Jul 9 20:02:25.204965397 (394h51m59.975606732s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.767637823 (394h52m0.538279158s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.775539020 (394h52m0.546180355s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.784443085 (394h52m0.55508442s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.786360713 (394h52m0.557002048s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.790650711 (394h52m0.561292046s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.795596423 (394h52m0.566237758s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.800154773 (394h52m0.570796108s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.809266435 (394h52m0.57990776s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:33.323814508 (394h52m8.094455843s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:54.619833778 (394h52m29.390475153s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:03.031749677 (394h52m37.802391012s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:08.267656661 (394h52m43.038297996s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696211223 (394h52m52.466852548s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696238234 (394h52m52.466879569s) [seg_pos={0 0}, upload=315928]: Segment reached optimal threshold of 14 pieces. Jul 9 20:03:17.696433668 (394h52m52.467075003s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f73dFC5Avj5HvkthE72J8wsV8b6xWAH9gVLqGEThS2b9rTjPk): protocol: expected piece hash; context canceled; EOF Jul 9 20:03:17.696504703 (394h52m52.467146038s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw): protocol: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection Jul 9 20:03:17.696540202 (394h52m52.467181537s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection Jul 9 20:03:17.696549359 (394h52m52.467190694s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vXrkhLqCofhR4Fmfqb98gxnqWQF6vMV4q3ATbRvPfcqi82WSo): protocol: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection Jul 9 20:03:17.696563035 (394h52m52.46720437s) [seg_pos={0 0}, upload=315928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 20:03:17.696661103 (394h52m52.467302428s) [upload=315928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 20:03:17.696665161 (394h52m52.467306496s) [upload=315928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 20:03:18.153388631 (394h52m52.924029966s) [upload=315928]: Done uploading segments... Jul 9 20:03:18.153408019 (394h52m52.924049354s) [upload=315928]: Upload finished. err: <nil> Duration: 56.362362398s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [...........................X.........X..X...X........XX.....] duration: 47.55569312s FAIL (2025-07-09 20:12:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 47.555734849s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 6.294954195s FAIL (2025-07-09 20:12:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.294980536s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.................X..X.....................X...X.............] duration: 49.300433044s FAIL (2025-07-09 20:12:41 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== . Jul 9 20:02:23.780217498 (394h51m58.550858883s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780676316 (394h51m58.551317641s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780936945 (394h51m58.55157827s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781177245 (394h51m58.55181858s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781413888 (394h51m58.552055213s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781644208 (394h51m58.552285543s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781895629 (394h51m58.552536954s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782135739 (394h51m58.552777074s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782318628 (394h51m58.552959953s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782512379 (394h51m58.553153714s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782777476 (394h51m58.553418801s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783024369 (394h51m58.553665704s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783212469 (394h51m58.553853804s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783488777 (394h51m58.554130102s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783681907 (394h51m58.554323232s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783865978 (394h51m58.554507313s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784048738 (394h51m58.554690073s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784240856 (394h51m58.554882191s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:24.899970585 (394h51m59.67061192s) [upload=315928]: Next returned nil segment Jul 9 20:02:24.899992798 (394h51m59.670634133s) [upload=315928]: Waiting for error group managing segments... Jul 9 20:02:25.204965397 (394h51m59.975606732s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.767637823 (394h52m0.538279158s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.775539020 (394h52m0.546180355s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.784443085 (394h52m0.55508442s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.786360713 (394h52m0.557002048s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.790650711 (394h52m0.561292046s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.795596423 (394h52m0.566237758s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.800154773 (394h52m0.570796108s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.809266435 (394h52m0.57990776s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:33.323814508 (394h52m8.094455843s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:54.619833778 (394h52m29.390475153s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:03.031749677 (394h52m37.802391012s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:08.267656661 (394h52m43.038297996s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696211223 (394h52m52.466852548s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696238234 (394h52m52.466879569s) [seg_pos={0 0}, upload=315928]: Segment reached optimal threshold of 14 pieces. Jul 9 20:03:17.696433668 (394h52m52.467075003s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f73dFC5Avj5HvkthE72J8wsV8b6xWAH9gVLqGEThS2b9rTjPk): protocol: expected piece hash; context canceled; EOF Jul 9 20:03:17.696504703 (394h52m52.467146038s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw): protocol: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection Jul 9 20:03:17.696540202 (394h52m52.467181537s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection Jul 9 20:03:17.696549359 (394h52m52.467190694s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vXrkhLqCofhR4Fmfqb98gxnqWQF6vMV4q3ATbRvPfcqi82WSo): protocol: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection Jul 9 20:03:17.696563035 (394h52m52.46720437s) [seg_pos={0 0}, upload=315928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 20:03:17.696661103 (394h52m52.467302428s) [upload=315928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 20:03:17.696665161 (394h52m52.467306496s) [upload=315928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 20:03:18.153388631 (394h52m52.924029966s) [upload=315928]: Done uploading segments... Jul 9 20:03:18.153408019 (394h52m52.924049354s) [upload=315928]: Upload finished. err: <nil> Duration: 49.300463122s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 6.613862297s FAIL (2025-07-09 20:12:19 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.613886393s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [..................X..X.....................X...X............] duration: 24.971066042s FAIL (2025-07-09 20:11:31 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== . Jul 9 20:02:23.780217498 (394h51m58.550858883s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780676316 (394h51m58.551317641s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780936945 (394h51m58.55157827s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781177245 (394h51m58.55181858s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781413888 (394h51m58.552055213s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781644208 (394h51m58.552285543s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781895629 (394h51m58.552536954s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782135739 (394h51m58.552777074s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782318628 (394h51m58.552959953s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782512379 (394h51m58.553153714s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782777476 (394h51m58.553418801s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783024369 (394h51m58.553665704s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783212469 (394h51m58.553853804s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783488777 (394h51m58.554130102s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783681907 (394h51m58.554323232s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783865978 (394h51m58.554507313s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784048738 (394h51m58.554690073s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784240856 (394h51m58.554882191s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:24.899970585 (394h51m59.67061192s) [upload=315928]: Next returned nil segment Jul 9 20:02:24.899992798 (394h51m59.670634133s) [upload=315928]: Waiting for error group managing segments... Jul 9 20:02:25.204965397 (394h51m59.975606732s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.767637823 (394h52m0.538279158s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.775539020 (394h52m0.546180355s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.784443085 (394h52m0.55508442s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.786360713 (394h52m0.557002048s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.790650711 (394h52m0.561292046s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.795596423 (394h52m0.566237758s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.800154773 (394h52m0.570796108s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.809266435 (394h52m0.57990776s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:33.323814508 (394h52m8.094455843s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:54.619833778 (394h52m29.390475153s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:03.031749677 (394h52m37.802391012s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:08.267656661 (394h52m43.038297996s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696211223 (394h52m52.466852548s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696238234 (394h52m52.466879569s) [seg_pos={0 0}, upload=315928]: Segment reached optimal threshold of 14 pieces. Jul 9 20:03:17.696433668 (394h52m52.467075003s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f73dFC5Avj5HvkthE72J8wsV8b6xWAH9gVLqGEThS2b9rTjPk): protocol: expected piece hash; context canceled; EOF Jul 9 20:03:17.696504703 (394h52m52.467146038s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw): protocol: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection Jul 9 20:03:17.696540202 (394h52m52.467181537s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection Jul 9 20:03:17.696549359 (394h52m52.467190694s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vXrkhLqCofhR4Fmfqb98gxnqWQF6vMV4q3ATbRvPfcqi82WSo): protocol: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection Jul 9 20:03:17.696563035 (394h52m52.46720437s) [seg_pos={0 0}, upload=315928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 20:03:17.696661103 (394h52m52.467302428s) [upload=315928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 20:03:17.696665161 (394h52m52.467306496s) [upload=315928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 20:03:18.153388631 (394h52m52.924029966s) [upload=315928]: Done uploading segments... Jul 9 20:03:18.153408019 (394h52m52.924049354s) [upload=315928]: Upload finished. err: <nil> Duration: 24.971096501s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [X.......................X...................................] duration: 6.139496514s FAIL (2025-07-09 20:11:31 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.13952552s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [............................X.........X..X...X........XX....] duration: 31.249343541s FAIL (2025-07-09 20:11:23 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 31.24935355s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [...................X..X.....................X...X...........] duration: 17.24921977s FAIL (2025-07-09 20:11:03 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== . Jul 9 20:02:23.780217498 (394h51m58.550858883s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780676316 (394h51m58.551317641s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780936945 (394h51m58.55157827s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781177245 (394h51m58.55181858s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781413888 (394h51m58.552055213s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781644208 (394h51m58.552285543s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781895629 (394h51m58.552536954s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782135739 (394h51m58.552777074s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782318628 (394h51m58.552959953s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782512379 (394h51m58.553153714s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782777476 (394h51m58.553418801s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783024369 (394h51m58.553665704s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783212469 (394h51m58.553853804s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783488777 (394h51m58.554130102s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783681907 (394h51m58.554323232s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783865978 (394h51m58.554507313s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784048738 (394h51m58.554690073s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784240856 (394h51m58.554882191s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:24.899970585 (394h51m59.67061192s) [upload=315928]: Next returned nil segment Jul 9 20:02:24.899992798 (394h51m59.670634133s) [upload=315928]: Waiting for error group managing segments... Jul 9 20:02:25.204965397 (394h51m59.975606732s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.767637823 (394h52m0.538279158s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.775539020 (394h52m0.546180355s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.784443085 (394h52m0.55508442s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.786360713 (394h52m0.557002048s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.790650711 (394h52m0.561292046s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.795596423 (394h52m0.566237758s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.800154773 (394h52m0.570796108s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.809266435 (394h52m0.57990776s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:33.323814508 (394h52m8.094455843s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:54.619833778 (394h52m29.390475153s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:03.031749677 (394h52m37.802391012s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:08.267656661 (394h52m43.038297996s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696211223 (394h52m52.466852548s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696238234 (394h52m52.466879569s) [seg_pos={0 0}, upload=315928]: Segment reached optimal threshold of 14 pieces. Jul 9 20:03:17.696433668 (394h52m52.467075003s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f73dFC5Avj5HvkthE72J8wsV8b6xWAH9gVLqGEThS2b9rTjPk): protocol: expected piece hash; context canceled; EOF Jul 9 20:03:17.696504703 (394h52m52.467146038s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw): protocol: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection Jul 9 20:03:17.696540202 (394h52m52.467181537s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection Jul 9 20:03:17.696549359 (394h52m52.467190694s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vXrkhLqCofhR4Fmfqb98gxnqWQF6vMV4q3ATbRvPfcqi82WSo): protocol: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection Jul 9 20:03:17.696563035 (394h52m52.46720437s) [seg_pos={0 0}, upload=315928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 20:03:17.696661103 (394h52m52.467302428s) [upload=315928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 20:03:17.696665161 (394h52m52.467306496s) [upload=315928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 20:03:18.153388631 (394h52m52.924029966s) [upload=315928]: Done uploading segments... Jul 9 20:03:18.153408019 (394h52m52.924049354s) [upload=315928]: Upload finished. err: <nil> Duration: 17.249245789s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [.............................X.........X..X...X........XX...] duration: 55.401683293s FAIL (2025-07-09 20:10:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 55.401711195s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.X.......................X..................................] duration: 6.452117786s FAIL (2025-07-09 20:10:42 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.452140178s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [....................X..X.....................X...X..........] duration: 17.927221864s FAIL (2025-07-09 20:10:37 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== . Jul 9 20:02:23.780217498 (394h51m58.550858883s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780676316 (394h51m58.551317641s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780936945 (394h51m58.55157827s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781177245 (394h51m58.55181858s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781413888 (394h51m58.552055213s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781644208 (394h51m58.552285543s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781895629 (394h51m58.552536954s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782135739 (394h51m58.552777074s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782318628 (394h51m58.552959953s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782512379 (394h51m58.553153714s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782777476 (394h51m58.553418801s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783024369 (394h51m58.553665704s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783212469 (394h51m58.553853804s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783488777 (394h51m58.554130102s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783681907 (394h51m58.554323232s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783865978 (394h51m58.554507313s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784048738 (394h51m58.554690073s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784240856 (394h51m58.554882191s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:24.899970585 (394h51m59.67061192s) [upload=315928]: Next returned nil segment Jul 9 20:02:24.899992798 (394h51m59.670634133s) [upload=315928]: Waiting for error group managing segments... Jul 9 20:02:25.204965397 (394h51m59.975606732s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.767637823 (394h52m0.538279158s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.775539020 (394h52m0.546180355s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.784443085 (394h52m0.55508442s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.786360713 (394h52m0.557002048s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.790650711 (394h52m0.561292046s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.795596423 (394h52m0.566237758s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.800154773 (394h52m0.570796108s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.809266435 (394h52m0.57990776s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:33.323814508 (394h52m8.094455843s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:54.619833778 (394h52m29.390475153s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:03.031749677 (394h52m37.802391012s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:08.267656661 (394h52m43.038297996s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696211223 (394h52m52.466852548s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696238234 (394h52m52.466879569s) [seg_pos={0 0}, upload=315928]: Segment reached optimal threshold of 14 pieces. Jul 9 20:03:17.696433668 (394h52m52.467075003s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f73dFC5Avj5HvkthE72J8wsV8b6xWAH9gVLqGEThS2b9rTjPk): protocol: expected piece hash; context canceled; EOF Jul 9 20:03:17.696504703 (394h52m52.467146038s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw): protocol: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection Jul 9 20:03:17.696540202 (394h52m52.467181537s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection Jul 9 20:03:17.696549359 (394h52m52.467190694s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vXrkhLqCofhR4Fmfqb98gxnqWQF6vMV4q3ATbRvPfcqi82WSo): protocol: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection Jul 9 20:03:17.696563035 (394h52m52.46720437s) [seg_pos={0 0}, upload=315928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 20:03:17.696661103 (394h52m52.467302428s) [upload=315928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 20:03:17.696665161 (394h52m52.467306496s) [upload=315928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 20:03:18.153388631 (394h52m52.924029966s) [upload=315928]: Done uploading segments... Jul 9 20:03:18.153408019 (394h52m52.924049354s) [upload=315928]: Upload finished. err: <nil> Duration: 17.927237235s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.....................X..X.....................X...X.........] duration: 50.796982672s FAIL (2025-07-09 20:10:18 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== . Jul 9 20:02:23.780217498 (394h51m58.550858883s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780676316 (394h51m58.551317641s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780936945 (394h51m58.55157827s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781177245 (394h51m58.55181858s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781413888 (394h51m58.552055213s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781644208 (394h51m58.552285543s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781895629 (394h51m58.552536954s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782135739 (394h51m58.552777074s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782318628 (394h51m58.552959953s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782512379 (394h51m58.553153714s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782777476 (394h51m58.553418801s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783024369 (394h51m58.553665704s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783212469 (394h51m58.553853804s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783488777 (394h51m58.554130102s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783681907 (394h51m58.554323232s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783865978 (394h51m58.554507313s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784048738 (394h51m58.554690073s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784240856 (394h51m58.554882191s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:24.899970585 (394h51m59.67061192s) [upload=315928]: Next returned nil segment Jul 9 20:02:24.899992798 (394h51m59.670634133s) [upload=315928]: Waiting for error group managing segments... Jul 9 20:02:25.204965397 (394h51m59.975606732s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.767637823 (394h52m0.538279158s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.775539020 (394h52m0.546180355s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.784443085 (394h52m0.55508442s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.786360713 (394h52m0.557002048s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.790650711 (394h52m0.561292046s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.795596423 (394h52m0.566237758s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.800154773 (394h52m0.570796108s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.809266435 (394h52m0.57990776s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:33.323814508 (394h52m8.094455843s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:54.619833778 (394h52m29.390475153s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:03.031749677 (394h52m37.802391012s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:08.267656661 (394h52m43.038297996s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696211223 (394h52m52.466852548s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696238234 (394h52m52.466879569s) [seg_pos={0 0}, upload=315928]: Segment reached optimal threshold of 14 pieces. Jul 9 20:03:17.696433668 (394h52m52.467075003s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f73dFC5Avj5HvkthE72J8wsV8b6xWAH9gVLqGEThS2b9rTjPk): protocol: expected piece hash; context canceled; EOF Jul 9 20:03:17.696504703 (394h52m52.467146038s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw): protocol: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection Jul 9 20:03:17.696540202 (394h52m52.467181537s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection Jul 9 20:03:17.696549359 (394h52m52.467190694s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vXrkhLqCofhR4Fmfqb98gxnqWQF6vMV4q3ATbRvPfcqi82WSo): protocol: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection Jul 9 20:03:17.696563035 (394h52m52.46720437s) [seg_pos={0 0}, upload=315928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 20:03:17.696661103 (394h52m52.467302428s) [upload=315928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 20:03:17.696665161 (394h52m52.467306496s) [upload=315928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 20:03:18.153388631 (394h52m52.924029966s) [upload=315928]: Done uploading segments... Jul 9 20:03:18.153408019 (394h52m52.924049354s) [upload=315928]: Upload finished. err: <nil> Duration: 50.796999734s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [..X.......................X.................................] duration: 6.153098064s FAIL (2025-07-09 20:10:02 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.153120776s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [..............................X.........X..X...X........XX..] duration: 32.657253276s FAIL (2025-07-09 20:09:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 32.657305044s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [...X.......................X................................] duration: 5.971191425s FAIL (2025-07-09 20:09:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.971218054s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [......................X..X.....................X...X........] duration: 45.399393456s FAIL (2025-07-09 20:09:27 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== . Jul 9 20:02:23.780217498 (394h51m58.550858883s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780676316 (394h51m58.551317641s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780936945 (394h51m58.55157827s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781177245 (394h51m58.55181858s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781413888 (394h51m58.552055213s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781644208 (394h51m58.552285543s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781895629 (394h51m58.552536954s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782135739 (394h51m58.552777074s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782318628 (394h51m58.552959953s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782512379 (394h51m58.553153714s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782777476 (394h51m58.553418801s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783024369 (394h51m58.553665704s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783212469 (394h51m58.553853804s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783488777 (394h51m58.554130102s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783681907 (394h51m58.554323232s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783865978 (394h51m58.554507313s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784048738 (394h51m58.554690073s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784240856 (394h51m58.554882191s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:24.899970585 (394h51m59.67061192s) [upload=315928]: Next returned nil segment Jul 9 20:02:24.899992798 (394h51m59.670634133s) [upload=315928]: Waiting for error group managing segments... Jul 9 20:02:25.204965397 (394h51m59.975606732s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.767637823 (394h52m0.538279158s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.775539020 (394h52m0.546180355s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.784443085 (394h52m0.55508442s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.786360713 (394h52m0.557002048s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.790650711 (394h52m0.561292046s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.795596423 (394h52m0.566237758s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.800154773 (394h52m0.570796108s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.809266435 (394h52m0.57990776s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:33.323814508 (394h52m8.094455843s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:54.619833778 (394h52m29.390475153s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:03.031749677 (394h52m37.802391012s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:08.267656661 (394h52m43.038297996s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696211223 (394h52m52.466852548s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696238234 (394h52m52.466879569s) [seg_pos={0 0}, upload=315928]: Segment reached optimal threshold of 14 pieces. Jul 9 20:03:17.696433668 (394h52m52.467075003s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f73dFC5Avj5HvkthE72J8wsV8b6xWAH9gVLqGEThS2b9rTjPk): protocol: expected piece hash; context canceled; EOF Jul 9 20:03:17.696504703 (394h52m52.467146038s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw): protocol: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection Jul 9 20:03:17.696540202 (394h52m52.467181537s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection Jul 9 20:03:17.696549359 (394h52m52.467190694s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vXrkhLqCofhR4Fmfqb98gxnqWQF6vMV4q3ATbRvPfcqi82WSo): protocol: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection Jul 9 20:03:17.696563035 (394h52m52.46720437s) [seg_pos={0 0}, upload=315928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 20:03:17.696661103 (394h52m52.467302428s) [upload=315928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 20:03:17.696665161 (394h52m52.467306496s) [upload=315928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 20:03:18.153388631 (394h52m52.924029966s) [upload=315928]: Done uploading segments... Jul 9 20:03:18.153408019 (394h52m52.924049354s) [upload=315928]: Upload finished. err: <nil> Duration: 45.399420498s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [...............................X.........X..X...X........XX.] duration: 37.594915229s FAIL (2025-07-09 20:08:45 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 37.594936101s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [....X.......................X...............................] duration: 6.496887517s FAIL (2025-07-09 20:08:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.49691014s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.......................X..X.....................X...X.......] duration: 36.020793789s FAIL (2025-07-09 20:08:27 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== . Jul 9 20:02:23.780217498 (394h51m58.550858883s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780676316 (394h51m58.551317641s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780936945 (394h51m58.55157827s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781177245 (394h51m58.55181858s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781413888 (394h51m58.552055213s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781644208 (394h51m58.552285543s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781895629 (394h51m58.552536954s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782135739 (394h51m58.552777074s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782318628 (394h51m58.552959953s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782512379 (394h51m58.553153714s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782777476 (394h51m58.553418801s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783024369 (394h51m58.553665704s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783212469 (394h51m58.553853804s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783488777 (394h51m58.554130102s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783681907 (394h51m58.554323232s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783865978 (394h51m58.554507313s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784048738 (394h51m58.554690073s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784240856 (394h51m58.554882191s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:24.899970585 (394h51m59.67061192s) [upload=315928]: Next returned nil segment Jul 9 20:02:24.899992798 (394h51m59.670634133s) [upload=315928]: Waiting for error group managing segments... Jul 9 20:02:25.204965397 (394h51m59.975606732s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.767637823 (394h52m0.538279158s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.775539020 (394h52m0.546180355s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.784443085 (394h52m0.55508442s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.786360713 (394h52m0.557002048s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.790650711 (394h52m0.561292046s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.795596423 (394h52m0.566237758s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.800154773 (394h52m0.570796108s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.809266435 (394h52m0.57990776s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:33.323814508 (394h52m8.094455843s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:54.619833778 (394h52m29.390475153s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:03.031749677 (394h52m37.802391012s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:08.267656661 (394h52m43.038297996s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696211223 (394h52m52.466852548s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696238234 (394h52m52.466879569s) [seg_pos={0 0}, upload=315928]: Segment reached optimal threshold of 14 pieces. Jul 9 20:03:17.696433668 (394h52m52.467075003s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f73dFC5Avj5HvkthE72J8wsV8b6xWAH9gVLqGEThS2b9rTjPk): protocol: expected piece hash; context canceled; EOF Jul 9 20:03:17.696504703 (394h52m52.467146038s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw): protocol: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection Jul 9 20:03:17.696540202 (394h52m52.467181537s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection Jul 9 20:03:17.696549359 (394h52m52.467190694s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vXrkhLqCofhR4Fmfqb98gxnqWQF6vMV4q3ATbRvPfcqi82WSo): protocol: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection Jul 9 20:03:17.696563035 (394h52m52.46720437s) [seg_pos={0 0}, upload=315928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 20:03:17.696661103 (394h52m52.467302428s) [upload=315928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 20:03:17.696665161 (394h52m52.467306496s) [upload=315928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 20:03:18.153388631 (394h52m52.924029966s) [upload=315928]: Done uploading segments... Jul 9 20:03:18.153408019 (394h52m52.924049354s) [upload=315928]: Upload finished. err: <nil> Duration: 36.020817565s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 6 out of 60 is failed (threshold=3) [................................X.........X..X...X........XX] duration: 1m0.000760164s FAIL (2025-07-09 20:07:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.000782046s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.....X.......................X..............................] duration: 5.962505866s FAIL (2025-07-09 20:07:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.962527026s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [........................X..X.....................X...X......] duration: 13.005477257s FAIL (2025-07-09 20:07:09 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== . Jul 9 20:02:23.780217498 (394h51m58.550858883s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780676316 (394h51m58.551317641s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780936945 (394h51m58.55157827s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781177245 (394h51m58.55181858s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781413888 (394h51m58.552055213s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781644208 (394h51m58.552285543s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781895629 (394h51m58.552536954s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782135739 (394h51m58.552777074s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782318628 (394h51m58.552959953s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782512379 (394h51m58.553153714s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782777476 (394h51m58.553418801s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783024369 (394h51m58.553665704s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783212469 (394h51m58.553853804s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783488777 (394h51m58.554130102s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783681907 (394h51m58.554323232s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783865978 (394h51m58.554507313s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784048738 (394h51m58.554690073s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784240856 (394h51m58.554882191s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:24.899970585 (394h51m59.67061192s) [upload=315928]: Next returned nil segment Jul 9 20:02:24.899992798 (394h51m59.670634133s) [upload=315928]: Waiting for error group managing segments... Jul 9 20:02:25.204965397 (394h51m59.975606732s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.767637823 (394h52m0.538279158s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.775539020 (394h52m0.546180355s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.784443085 (394h52m0.55508442s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.786360713 (394h52m0.557002048s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.790650711 (394h52m0.561292046s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.795596423 (394h52m0.566237758s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.800154773 (394h52m0.570796108s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.809266435 (394h52m0.57990776s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:33.323814508 (394h52m8.094455843s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:54.619833778 (394h52m29.390475153s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:03.031749677 (394h52m37.802391012s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:08.267656661 (394h52m43.038297996s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696211223 (394h52m52.466852548s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696238234 (394h52m52.466879569s) [seg_pos={0 0}, upload=315928]: Segment reached optimal threshold of 14 pieces. Jul 9 20:03:17.696433668 (394h52m52.467075003s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f73dFC5Avj5HvkthE72J8wsV8b6xWAH9gVLqGEThS2b9rTjPk): protocol: expected piece hash; context canceled; EOF Jul 9 20:03:17.696504703 (394h52m52.467146038s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw): protocol: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection Jul 9 20:03:17.696540202 (394h52m52.467181537s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection Jul 9 20:03:17.696549359 (394h52m52.467190694s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vXrkhLqCofhR4Fmfqb98gxnqWQF6vMV4q3ATbRvPfcqi82WSo): protocol: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection Jul 9 20:03:17.696563035 (394h52m52.46720437s) [seg_pos={0 0}, upload=315928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 20:03:17.696661103 (394h52m52.467302428s) [upload=315928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 20:03:17.696665161 (394h52m52.467306496s) [upload=315928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 20:03:18.153388631 (394h52m52.924029966s) [upload=315928]: Done uploading segments... Jul 9 20:03:18.153408019 (394h52m52.924049354s) [upload=315928]: Upload finished. err: <nil> Duration: 13.005510038s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [......X.......................X.............................] duration: 6.349121391s FAIL (2025-07-09 20:07:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.349143111s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 5 out of 60 is failed (threshold=3) [.................................X.........X..X...X........X] duration: 1m0.001508476s FAIL (2025-07-09 20:06:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 1m0.001532192s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.........................X..X.....................X...X.....] duration: 10.384929029s FAIL (2025-07-09 20:06:45 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== . Jul 9 20:02:23.780217498 (394h51m58.550858883s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780676316 (394h51m58.551317641s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780936945 (394h51m58.55157827s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781177245 (394h51m58.55181858s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781413888 (394h51m58.552055213s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781644208 (394h51m58.552285543s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781895629 (394h51m58.552536954s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782135739 (394h51m58.552777074s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782318628 (394h51m58.552959953s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782512379 (394h51m58.553153714s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782777476 (394h51m58.553418801s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783024369 (394h51m58.553665704s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783212469 (394h51m58.553853804s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783488777 (394h51m58.554130102s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783681907 (394h51m58.554323232s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783865978 (394h51m58.554507313s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784048738 (394h51m58.554690073s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784240856 (394h51m58.554882191s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:24.899970585 (394h51m59.67061192s) [upload=315928]: Next returned nil segment Jul 9 20:02:24.899992798 (394h51m59.670634133s) [upload=315928]: Waiting for error group managing segments... Jul 9 20:02:25.204965397 (394h51m59.975606732s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.767637823 (394h52m0.538279158s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.775539020 (394h52m0.546180355s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.784443085 (394h52m0.55508442s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.786360713 (394h52m0.557002048s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.790650711 (394h52m0.561292046s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.795596423 (394h52m0.566237758s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.800154773 (394h52m0.570796108s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.809266435 (394h52m0.57990776s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:33.323814508 (394h52m8.094455843s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:54.619833778 (394h52m29.390475153s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:03.031749677 (394h52m37.802391012s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:08.267656661 (394h52m43.038297996s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696211223 (394h52m52.466852548s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696238234 (394h52m52.466879569s) [seg_pos={0 0}, upload=315928]: Segment reached optimal threshold of 14 pieces. Jul 9 20:03:17.696433668 (394h52m52.467075003s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f73dFC5Avj5HvkthE72J8wsV8b6xWAH9gVLqGEThS2b9rTjPk): protocol: expected piece hash; context canceled; EOF Jul 9 20:03:17.696504703 (394h52m52.467146038s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw): protocol: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection Jul 9 20:03:17.696540202 (394h52m52.467181537s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection Jul 9 20:03:17.696549359 (394h52m52.467190694s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vXrkhLqCofhR4Fmfqb98gxnqWQF6vMV4q3ATbRvPfcqi82WSo): protocol: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection Jul 9 20:03:17.696563035 (394h52m52.46720437s) [seg_pos={0 0}, upload=315928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 20:03:17.696661103 (394h52m52.467302428s) [upload=315928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 20:03:17.696665161 (394h52m52.467306496s) [upload=315928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 20:03:18.153388631 (394h52m52.924029966s) [upload=315928]: Done uploading segments... Jul 9 20:03:18.153408019 (394h52m52.924049354s) [upload=315928]: Upload finished. err: <nil> Duration: 10.384954997s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [..........................X..X.....................X...X....] duration: 44.821953614s FAIL (2025-07-09 20:06:13 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== . Jul 9 20:02:23.780217498 (394h51m58.550858883s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780676316 (394h51m58.551317641s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780936945 (394h51m58.55157827s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781177245 (394h51m58.55181858s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781413888 (394h51m58.552055213s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781644208 (394h51m58.552285543s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781895629 (394h51m58.552536954s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782135739 (394h51m58.552777074s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782318628 (394h51m58.552959953s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782512379 (394h51m58.553153714s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782777476 (394h51m58.553418801s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783024369 (394h51m58.553665704s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783212469 (394h51m58.553853804s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783488777 (394h51m58.554130102s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783681907 (394h51m58.554323232s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783865978 (394h51m58.554507313s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784048738 (394h51m58.554690073s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784240856 (394h51m58.554882191s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:24.899970585 (394h51m59.67061192s) [upload=315928]: Next returned nil segment Jul 9 20:02:24.899992798 (394h51m59.670634133s) [upload=315928]: Waiting for error group managing segments... Jul 9 20:02:25.204965397 (394h51m59.975606732s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.767637823 (394h52m0.538279158s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.775539020 (394h52m0.546180355s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.784443085 (394h52m0.55508442s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.786360713 (394h52m0.557002048s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.790650711 (394h52m0.561292046s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.795596423 (394h52m0.566237758s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.800154773 (394h52m0.570796108s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.809266435 (394h52m0.57990776s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:33.323814508 (394h52m8.094455843s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:54.619833778 (394h52m29.390475153s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:03.031749677 (394h52m37.802391012s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:08.267656661 (394h52m43.038297996s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696211223 (394h52m52.466852548s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696238234 (394h52m52.466879569s) [seg_pos={0 0}, upload=315928]: Segment reached optimal threshold of 14 pieces. Jul 9 20:03:17.696433668 (394h52m52.467075003s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f73dFC5Avj5HvkthE72J8wsV8b6xWAH9gVLqGEThS2b9rTjPk): protocol: expected piece hash; context canceled; EOF Jul 9 20:03:17.696504703 (394h52m52.467146038s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw): protocol: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection Jul 9 20:03:17.696540202 (394h52m52.467181537s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection Jul 9 20:03:17.696549359 (394h52m52.467190694s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vXrkhLqCofhR4Fmfqb98gxnqWQF6vMV4q3ATbRvPfcqi82WSo): protocol: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection Jul 9 20:03:17.696563035 (394h52m52.46720437s) [seg_pos={0 0}, upload=315928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 20:03:17.696661103 (394h52m52.467302428s) [upload=315928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 20:03:17.696665161 (394h52m52.467306496s) [upload=315928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 20:03:18.153388631 (394h52m52.924029966s) [upload=315928]: Done uploading segments... Jul 9 20:03:18.153408019 (394h52m52.924049354s) [upload=315928]: Upload finished. err: <nil> Duration: 44.821979012s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [.......X.......................X............................] duration: 6.06641572s FAIL (2025-07-09 20:06:13 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.066438072s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [..................................X.........X..X...X........] duration: 47.442832781s FAIL (2025-07-09 20:05:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 47.442855386s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [...........................X..X.....................X...X...] duration: 29.960340332s FAIL (2025-07-09 20:05:23 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== . Jul 9 20:02:23.780217498 (394h51m58.550858883s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780676316 (394h51m58.551317641s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780936945 (394h51m58.55157827s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781177245 (394h51m58.55181858s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781413888 (394h51m58.552055213s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781644208 (394h51m58.552285543s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781895629 (394h51m58.552536954s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782135739 (394h51m58.552777074s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782318628 (394h51m58.552959953s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782512379 (394h51m58.553153714s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782777476 (394h51m58.553418801s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783024369 (394h51m58.553665704s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783212469 (394h51m58.553853804s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783488777 (394h51m58.554130102s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783681907 (394h51m58.554323232s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783865978 (394h51m58.554507313s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784048738 (394h51m58.554690073s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784240856 (394h51m58.554882191s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:24.899970585 (394h51m59.67061192s) [upload=315928]: Next returned nil segment Jul 9 20:02:24.899992798 (394h51m59.670634133s) [upload=315928]: Waiting for error group managing segments... Jul 9 20:02:25.204965397 (394h51m59.975606732s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.767637823 (394h52m0.538279158s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.775539020 (394h52m0.546180355s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.784443085 (394h52m0.55508442s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.786360713 (394h52m0.557002048s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.790650711 (394h52m0.561292046s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.795596423 (394h52m0.566237758s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.800154773 (394h52m0.570796108s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.809266435 (394h52m0.57990776s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:33.323814508 (394h52m8.094455843s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:54.619833778 (394h52m29.390475153s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:03.031749677 (394h52m37.802391012s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:08.267656661 (394h52m43.038297996s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696211223 (394h52m52.466852548s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696238234 (394h52m52.466879569s) [seg_pos={0 0}, upload=315928]: Segment reached optimal threshold of 14 pieces. Jul 9 20:03:17.696433668 (394h52m52.467075003s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f73dFC5Avj5HvkthE72J8wsV8b6xWAH9gVLqGEThS2b9rTjPk): protocol: expected piece hash; context canceled; EOF Jul 9 20:03:17.696504703 (394h52m52.467146038s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw): protocol: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection Jul 9 20:03:17.696540202 (394h52m52.467181537s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection Jul 9 20:03:17.696549359 (394h52m52.467190694s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vXrkhLqCofhR4Fmfqb98gxnqWQF6vMV4q3ATbRvPfcqi82WSo): protocol: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection Jul 9 20:03:17.696563035 (394h52m52.46720437s) [seg_pos={0 0}, upload=315928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 20:03:17.696661103 (394h52m52.467302428s) [upload=315928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 20:03:17.696665161 (394h52m52.467306496s) [upload=315928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 20:03:18.153388631 (394h52m52.924029966s) [upload=315928]: Done uploading segments... Jul 9 20:03:18.153408019 (394h52m52.924049354s) [upload=315928]: Upload finished. err: <nil> Duration: 29.960367665s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 2 out of 60 is failed (threshold=3) [........X.......................X...........................] duration: 6.245009717s FAIL (2025-07-09 20:05:22 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.245033733s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [...................................X.........X..X...X.......] duration: 40.985134954s FAIL (2025-07-09 20:04:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 40.985159521s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [X........X.......................X..........................] duration: 6.223252321s FAIL (2025-07-09 20:04:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.22372273s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [............................X..X.....................X...X..] duration: 19.982213273s FAIL (2025-07-09 20:04:09 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== . Jul 9 20:02:23.780217498 (394h51m58.550858883s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780676316 (394h51m58.551317641s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780936945 (394h51m58.55157827s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781177245 (394h51m58.55181858s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781413888 (394h51m58.552055213s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781644208 (394h51m58.552285543s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781895629 (394h51m58.552536954s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782135739 (394h51m58.552777074s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782318628 (394h51m58.552959953s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782512379 (394h51m58.553153714s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782777476 (394h51m58.553418801s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783024369 (394h51m58.553665704s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783212469 (394h51m58.553853804s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783488777 (394h51m58.554130102s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783681907 (394h51m58.554323232s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783865978 (394h51m58.554507313s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784048738 (394h51m58.554690073s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784240856 (394h51m58.554882191s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:24.899970585 (394h51m59.67061192s) [upload=315928]: Next returned nil segment Jul 9 20:02:24.899992798 (394h51m59.670634133s) [upload=315928]: Waiting for error group managing segments... Jul 9 20:02:25.204965397 (394h51m59.975606732s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.767637823 (394h52m0.538279158s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.775539020 (394h52m0.546180355s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.784443085 (394h52m0.55508442s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.786360713 (394h52m0.557002048s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.790650711 (394h52m0.561292046s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.795596423 (394h52m0.566237758s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.800154773 (394h52m0.570796108s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.809266435 (394h52m0.57990776s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:33.323814508 (394h52m8.094455843s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:54.619833778 (394h52m29.390475153s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:03.031749677 (394h52m37.802391012s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:08.267656661 (394h52m43.038297996s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696211223 (394h52m52.466852548s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696238234 (394h52m52.466879569s) [seg_pos={0 0}, upload=315928]: Segment reached optimal threshold of 14 pieces. Jul 9 20:03:17.696433668 (394h52m52.467075003s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f73dFC5Avj5HvkthE72J8wsV8b6xWAH9gVLqGEThS2b9rTjPk): protocol: expected piece hash; context canceled; EOF Jul 9 20:03:17.696504703 (394h52m52.467146038s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw): protocol: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection Jul 9 20:03:17.696540202 (394h52m52.467181537s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection Jul 9 20:03:17.696549359 (394h52m52.467190694s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vXrkhLqCofhR4Fmfqb98gxnqWQF6vMV4q3ATbRvPfcqi82WSo): protocol: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection Jul 9 20:03:17.696563035 (394h52m52.46720437s) [seg_pos={0 0}, upload=315928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 20:03:17.696661103 (394h52m52.467302428s) [upload=315928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 20:03:17.696665161 (394h52m52.467306496s) [upload=315928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 20:03:18.153388631 (394h52m52.924029966s) [upload=315928]: Done uploading segments... Jul 9 20:03:18.153408019 (394h52m52.924049354s) [upload=315928]: Upload finished. err: <nil> Duration: 19.982239293s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [....................................X.........X..X...X......] duration: 19.080896996s FAIL (2025-07-09 20:03:52 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 19.080908458s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.............................X..X.....................X...X.] duration: 14.93061122s FAIL (2025-07-09 20:03:37 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== . Jul 9 20:02:23.780217498 (394h51m58.550858883s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780676316 (394h51m58.551317641s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780936945 (394h51m58.55157827s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781177245 (394h51m58.55181858s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781413888 (394h51m58.552055213s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781644208 (394h51m58.552285543s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781895629 (394h51m58.552536954s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782135739 (394h51m58.552777074s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782318628 (394h51m58.552959953s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782512379 (394h51m58.553153714s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782777476 (394h51m58.553418801s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783024369 (394h51m58.553665704s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783212469 (394h51m58.553853804s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783488777 (394h51m58.554130102s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783681907 (394h51m58.554323232s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783865978 (394h51m58.554507313s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784048738 (394h51m58.554690073s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784240856 (394h51m58.554882191s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:24.899970585 (394h51m59.67061192s) [upload=315928]: Next returned nil segment Jul 9 20:02:24.899992798 (394h51m59.670634133s) [upload=315928]: Waiting for error group managing segments... Jul 9 20:02:25.204965397 (394h51m59.975606732s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.767637823 (394h52m0.538279158s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.775539020 (394h52m0.546180355s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.784443085 (394h52m0.55508442s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.786360713 (394h52m0.557002048s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.790650711 (394h52m0.561292046s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.795596423 (394h52m0.566237758s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.800154773 (394h52m0.570796108s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.809266435 (394h52m0.57990776s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:33.323814508 (394h52m8.094455843s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:54.619833778 (394h52m29.390475153s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:03.031749677 (394h52m37.802391012s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:08.267656661 (394h52m43.038297996s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696211223 (394h52m52.466852548s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696238234 (394h52m52.466879569s) [seg_pos={0 0}, upload=315928]: Segment reached optimal threshold of 14 pieces. Jul 9 20:03:17.696433668 (394h52m52.467075003s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f73dFC5Avj5HvkthE72J8wsV8b6xWAH9gVLqGEThS2b9rTjPk): protocol: expected piece hash; context canceled; EOF Jul 9 20:03:17.696504703 (394h52m52.467146038s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw): protocol: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection Jul 9 20:03:17.696540202 (394h52m52.467181537s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection Jul 9 20:03:17.696549359 (394h52m52.467190694s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vXrkhLqCofhR4Fmfqb98gxnqWQF6vMV4q3ATbRvPfcqi82WSo): protocol: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection Jul 9 20:03:17.696563035 (394h52m52.46720437s) [seg_pos={0 0}, upload=315928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 20:03:17.696661103 (394h52m52.467302428s) [upload=315928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 20:03:17.696665161 (394h52m52.467306496s) [upload=315928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 20:03:18.153388631 (394h52m52.924029966s) [upload=315928]: Done uploading segments... Jul 9 20:03:18.153408019 (394h52m52.924049354s) [upload=315928]: Upload finished. err: <nil> Duration: 14.930626469s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 3 out of 60 is failed (threshold=3) [.X........X.......................X.........................] duration: 6.247300267s FAIL (2025-07-09 20:03:37 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 6.247319523s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [.....................................X.........X..X...X.....] duration: 35.934388695s FAIL (2025-07-09 20:03:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 35.934404385s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20) antiblip: 4 out of 60 is failed (threshold=3) [..............................X..X.....................X...X] duration: 1m0.001959452s FAIL (2025-07-09 20:03:22 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== . Jul 9 20:02:23.780217498 (394h51m58.550858883s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780676316 (394h51m58.551317641s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.780936945 (394h51m58.55157827s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781177245 (394h51m58.55181858s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781413888 (394h51m58.552055213s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781644208 (394h51m58.552285543s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.781895629 (394h51m58.552536954s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782135739 (394h51m58.552777074s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782318628 (394h51m58.552959953s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782512379 (394h51m58.553153714s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.782777476 (394h51m58.553418801s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783024369 (394h51m58.553665704s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783212469 (394h51m58.553853804s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783488777 (394h51m58.554130102s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783681907 (394h51m58.554323232s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.783865978 (394h51m58.554507313s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784048738 (394h51m58.554690073s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:23.784240856 (394h51m58.554882191s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Uploading piece... Jul 9 20:02:24.899970585 (394h51m59.67061192s) [upload=315928]: Next returned nil segment Jul 9 20:02:24.899992798 (394h51m59.670634133s) [upload=315928]: Waiting for error group managing segments... Jul 9 20:02:25.204965397 (394h51m59.975606732s) [noise=true , address=79.127.205.235:4669 , piece_id=YBAEIQ4D342ZRZNZ7CN3FP5XXZEP4JRTSITTIETCFQCG52TMXZLA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.767637823 (394h52m0.538279158s) [noise=true , address=79.127.219.38:4008 , piece_id=5QBBOWQMUYCAT4KY6DSPIFS2J4D7FOV24RGMT3FNJYOTL6X764QQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.775539020 (394h52m0.546180355s) [noise=true , address=77.90.31.15:4710 , piece_id=LD6INE3ECX3HSS7CX25RWQYXE2PUQSUWZVQ3VVMINCKY64JQRV4Q, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.784443085 (394h52m0.55508442s) [noise=true , address=77.90.31.10:4531 , piece_id=3IHUYY7Q6CJH23BFCDYJYWEPVOWL7VXCO5W727VHMTL2RTJYA4FA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.786360713 (394h52m0.557002048s) [noise=true , address=77.90.31.18:4821 , piece_id=JIUP3CSGG23DG6XVVQOSFXPXM2PFZTKEJTZ6O6IKE4MHZ2XAUE2A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.790650711 (394h52m0.561292046s) [noise=true , address=77.90.31.14:4682 , piece_id=EXXWHHHRTELAI2WW6472EOUDCWAXTA5H5MLTUF5B5FJOU5NLMEOA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.795596423 (394h52m0.566237758s) [noise=true , address=77.90.31.16:4748 , piece_id=RARHNZP44WW3V4LB5TGMZUCGVWODY5LBJUTYU6UGPPJINALZA5IQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.800154773 (394h52m0.570796108s) [noise=true , address=77.90.31.13:4646 , piece_id=XURX6FTRDRDPEVUDINT3UCBCZYJB2C6K6BHS3LNKV4LYM22AAFWA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:25.809266435 (394h52m0.57990776s) [noise=true , address=77.90.31.16:4768 , piece_id=EADGMMZXL27TH2ZPFSR7QFWWEVWQEVFITN3TAU2TM2OVN64IBJSA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:33.323814508 (394h52m8.094455843s) [noise=true , address=79.127.201.215:4348 , piece_id=PYWYROAV33776ZW4O3U3SIE4VNI4IZUL6RUZOEP3QR4NZNLFG46A, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:02:54.619833778 (394h52m29.390475153s) [noise=true , address=104.36.82.2:4746 , piece_id=ORV3PXJ6LHH4J5PTYQ7UMGU36H2PWKKJMTUHZSL7CMCWKDMBBMNQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:03.031749677 (394h52m37.802391012s) [noise=true , address=104.36.82.5:4863 , piece_id=4EOE6YQGQVXDF26VILTGTHLB422UDGVLEXBMG3344WIAMR6WBWGQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:08.267656661 (394h52m43.038297996s) [noise=true , address=104.36.82.51:4064 , piece_id=WQSKOGGEF7KROPVU62HVACPS74QYDHYZQUZIXXZ6Q6APKCTNBCZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696211223 (394h52m52.466852548s) [noise=true , address=104.36.82.39:4738 , piece_id=7QVQHRYSHG2XKLZ5AJROBO7CI5COBRPN7B6JFYC2QMNUUUR35QYA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: <nil> Jul 9 20:03:17.696238234 (394h52m52.466879569s) [seg_pos={0 0}, upload=315928]: Segment reached optimal threshold of 14 pieces. Jul 9 20:03:17.696433668 (394h52m52.467075003s) [noise=true , address=104.36.82.19:4426 , piece_id=NYUABLYZULXKVJKDVAJD35VBQKUEFOAZO3SJ73GYBEWI5AFH5LHA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12f73dFC5Avj5HvkthE72J8wsV8b6xWAH9gVLqGEThS2b9rTjPk): protocol: expected piece hash; context canceled; EOF Jul 9 20:03:17.696504703 (394h52m52.467146038s) [noise=true , address=104.36.82.36:4617 , piece_id=QNSC3HECIXLZ62BBH4LXBVN3UR7DZWOZ64VFP7AIFO2KH4DDT4ZQ, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ifHtxXNY419Q7tJgZbBoz7ZULJmsob3QEgoGTZbhCPXH9TVQw): protocol: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45496->104.36.82.36:4617: use of closed network connection Jul 9 20:03:17.696540202 (394h52m52.467181537s) [noise=true , address=104.36.82.38:4707 , piece_id=IYK43BYSQUNEQ6BAUO245LMNAOBGGV7TGB76I4FKC6MABPNMBUDA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37852->104.36.82.38:4707: use of closed network connection Jul 9 20:03:17.696549359 (394h52m52.467190694s) [noise=true , address=104.36.82.23:4445 , piece_id=J6VPRBOQSJIOEOM2LZJBQJJYCXXSBTIIVDZGYIBDB7UNRT5CA7QA, seg_pos={0 0}, upload=315928]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12vXrkhLqCofhR4Fmfqb98gxnqWQF6vMV4q3ATbRvPfcqi82WSo): protocol: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36278->104.36.82.23:4445: use of closed network connection Jul 9 20:03:17.696563035 (394h52m52.46720437s) [seg_pos={0 0}, upload=315928]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Jul 9 20:03:17.696661103 (394h52m52.467302428s) [upload=315928]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 9 20:03:17.696665161 (394h52m52.467306496s) [upload=315928]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 9 20:03:18.153388631 (394h52m52.924029966s) [upload=315928]: Done uploading segments... Jul 9 20:03:18.153408019 (394h52m52.924049354s) [upload=315928]: Upload finished. err: <nil> Duration: 1m0.001980052s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20)