Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..............................X.X...................X.......] duration: 2.117332773s FAIL (2025-08-11 22:34:02 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 22:26:58.357568431 (77h0m52.788648562s) [upload=80269]: Starting upload Aug 11 22:26:58.357612295 (77h0m52.788692426s) [upload=80269]: Done starting upload Aug 11 22:26:58.357654996 (77h0m52.788735128s) [upload=80269]: Uploading segments... Aug 11 22:26:58.357686247 (77h0m52.788766368s) [upload=80269]: Got next segment. Inline: true Aug 11 22:26:58.357689654 (77h0m52.788769785s) [upload=80269]: Waiting for error group managing segments... Aug 11 22:26:58.357720903 (77h0m52.788801034s) [upload=80269]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:26:58.357724660 (77h0m52.788804791s) [upload=80269]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 22:26:58.357727095 (77h0m52.788807226s) [upload=80269]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:26:58.667015570 (77h0m53.098095701s) [upload=80269]: Done uploading segments... Aug 11 22:26:58.667034425 (77h0m53.098114556s) [upload=80269]: Upload finished. err: <nil> Duration:* 2.117356358s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [........X..............................X....X......X........] duration: 6.899432282s FAIL (2025-08-11 22:33:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after de2609602ede5ed5bc389edbcde768f8b117316fc0253f3ff9280ad575c23e77 != before 892dca178903bc7ddc12846a33a40d0a34fdc16cfb22a5c9c7449bbd2640a3fd ======LOGS====== Aug 11 22:26:29.612708298 (77h0m24.043788429s) [upload=80262]: Starting upload Aug 11 22:26:29.612769895 (77h0m24.043850016s) [upload=80262]: Done starting upload Aug 11 22:26:29.612844999 (77h0m24.04392513s) [upload=80262]: Uploading segments... Aug 11 22:26:29.613140405 (77h0m24.044220536s) [upload=80262]: Got next segment. Inline: false Aug 11 22:26:29.613195580 (77h0m24.044275711s) [upload=80262]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:26:29.613202614 (77h0m24.044282765s) [upload=80262]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:26:30.109951250 (77h0m24.541031381s) [seg_pos={0 0}, upload=80262]: Begin upload segment... Aug 11 22:26:30.110015363 (77h0m24.541095494s) [seg_pos={0 0}, upload=80262]: Done begin upload segment. Aug 11 22:26:30.110054187 (77h0m24.541134318s) [noise=true , address=104.36.82.13:4213 , piece_id=AC7QMQJBZZCUJOPDDJQRTBLNPHMQP7T6KYQU2MVABDTZINKGEI5Q, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110059597 (77h0m24.541139728s) [noise=true , address=104.36.82.8:4977 , piece_id=CIWWKHEX5PEEW5S5M6PRJ6IMJWJJPMZDPZDWOWWSA2SSKL6QHLKQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110502866 (77h0m24.541583007s) [noise=true , address=104.36.82.61:4408 , piece_id=C6CCZOJQ4PNPM572TP73E7LDZ4YCXRPMUFN64DN4VZYRW7MOPIBA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110573330 (77h0m24.541653531s) [noise=true , address=104.36.82.47:4529 , piece_id=DFFJUBM2NNGBM5HRCAODNK7YCLB6FRIKHFEWNDC2PVTINVEKRP2A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110849519 (77h0m24.54192965s) [noise=true , address=104.36.82.21:4497 , piece_id=PWEMVGVZKB7EZS4W7CH7422JLZERI3XTPA5WNV4NC6SG2QAV4K6A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110982844 (77h0m24.542062975s) [noise=true , address=77.90.31.18:4812 , piece_id=WV6YUK4BM7PILJOE6X6ATLJNZ6Q5Q3NRVKB2WI6AQTLRDG5SDLRA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.111196312 (77h0m24.542276444s) [noise=true , address=104.36.82.18:4394 , piece_id=67UIQFUSRYODDQD7267IK6T7LI2USCMLOQ6NHAKB6R7BREEPLOZA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.111523769 (77h0m24.5426039s) [noise=true , address=64.49.13.26:4945 , piece_id=GPWOHSN2OSDZJCYACTNUP6E7X7WVOGR6DU4YFMLZK7USMJRAFAXA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.112198239 (77h0m24.54327837s) [noise=true , address=79.127.220.101:4073 , piece_id=LXWQI2DXSMXW3SV3IABAFZUMUX2OUM36KH5O2V2M6JPYYDVSVD6A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.112436215 (77h0m24.543516346s) [noise=true , address=104.36.82.16:4303 , piece_id=FUIMZ7LJCPZBYYURK4LEDD4QA7NKGT3RITWI4CQFSPUWUASXZD4A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.112710860 (77h0m24.543790991s) [noise=true , address=104.36.82.58:4282 , piece_id=LBUYWTAAZUQOURZR7J3HQFIBNLKFN3DB2O36DBY23U7SDAPRWOBQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113153237 (77h0m24.544233368s) [noise=true , address=104.36.82.59:4314 , piece_id=ZO3W4D72VA74X477LGTGDCJJKFBUMFB25DUKMWX3WZH34VZKVG2Q, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113414036 (77h0m24.544494167s) [noise=true , address=104.36.82.45:4908 , piece_id=WLO343PJNCX5EPJXOISKKGU4OWPH7Y35D5OQ4OOGYSRBP5LO7BCQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113637804 (77h0m24.544717935s) [noise=true , address=104.36.82.22:4532 , piece_id=QQXQYRXNXXGVCH74ICKDMK4N6TFSSADPEAWZUC2KAP6PPOJSPSOQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113896769 (77h0m24.54497689s) [noise=true , address=104.36.82.17:4332 , piece_id=VNG4XRM4Q6GPB75OIDJYW3POR3JRMSHUCMV42OIZJ3XJJC5SP7OQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.114104116 (77h0m24.545184247s) [noise=true , address=104.36.82.34:4545 , piece_id=FPH3U4KXKWDHKDXPSNC5KB2LTHDVBIXKSFLYA7YVXUADTI26E25A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.114718722 (77h0m24.545798853s) [noise=true , address=104.36.82.5:4860 , piece_id=MXH3B674XJ33ADRLOFJZXYJZIEQOCLQ7WDJBSWIIJU4RQMSVLSSQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.115368636 (77h0m24.546448767s) [noise=true , address=104.36.82.62:4435 , piece_id=DN4JVKBXHP6ZAOU47NK7ZRAD2T3BY2GYTWVIUFHYHYXIZJVESI6A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:31.281304078 (77h0m25.712384209s) [upload=80262]: Next returned nil segment Aug 11 22:26:31.281338404 (77h0m25.712418535s) [upload=80262]: Waiting for error group managing segments... Aug 11 22:26:31.600564253 (77h0m26.031644444s) [noise=true , address=64.49.13.26:4945 , piece_id=GPWOHSN2OSDZJCYACTNUP6E7X7WVOGR6DU4YFMLZK7USMJRAFAXA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:31.991107398 (77h0m26.422187529s) [noise=true , address=79.127.220.101:4073 , piece_id=LXWQI2DXSMXW3SV3IABAFZUMUX2OUM36KH5O2V2M6JPYYDVSVD6A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.071078223 (77h0m26.502158354s) [noise=true , address=104.36.82.58:4282 , piece_id=LBUYWTAAZUQOURZR7J3HQFIBNLKFN3DB2O36DBY23U7SDAPRWOBQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.115562588 (77h0m26.546642719s) [noise=true , address=104.36.82.45:4908 , piece_id=WLO343PJNCX5EPJXOISKKGU4OWPH7Y35D5OQ4OOGYSRBP5LO7BCQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.130410037 (77h0m26.561490168s) [noise=true , address=104.36.82.17:4332 , piece_id=VNG4XRM4Q6GPB75OIDJYW3POR3JRMSHUCMV42OIZJ3XJJC5SP7OQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.131124754 (77h0m26.562204885s) [noise=true , address=104.36.82.21:4497 , piece_id=PWEMVGVZKB7EZS4W7CH7422JLZERI3XTPA5WNV4NC6SG2QAV4K6A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.180906606 (77h0m26.611986737s) [noise=true , address=104.36.82.47:4529 , piece_id=DFFJUBM2NNGBM5HRCAODNK7YCLB6FRIKHFEWNDC2PVTINVEKRP2A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.227616279 (77h0m26.6586964s) [noise=true , address=104.36.82.16:4303 , piece_id=FUIMZ7LJCPZBYYURK4LEDD4QA7NKGT3RITWI4CQFSPUWUASXZD4A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.228268337 (77h0m26.659348458s) [noise=true , address=77.90.31.18:4812 , piece_id=WV6YUK4BM7PILJOE6X6ATLJNZ6Q5Q3NRVKB2WI6AQTLRDG5SDLRA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.239880475 (77h0m26.670960606s) [noise=true , address=104.36.82.22:4532 , piece_id=QQXQYRXNXXGVCH74ICKDMK4N6TFSSADPEAWZUC2KAP6PPOJSPSOQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.241576581 (77h0m26.672656712s) [noise=true , address=104.36.82.62:4435 , piece_id=DN4JVKBXHP6ZAOU47NK7ZRAD2T3BY2GYTWVIUFHYHYXIZJVESI6A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.263864415 (77h0m26.694944546s) [noise=true , address=104.36.82.59:4314 , piece_id=ZO3W4D72VA74X477LGTGDCJJKFBUMFB25DUKMWX3WZH34VZKVG2Q, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.267293096 (77h0m26.698373227s) [noise=true , address=104.36.82.5:4860 , piece_id=MXH3B674XJ33ADRLOFJZXYJZIEQOCLQ7WDJBSWIIJU4RQMSVLSSQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.304902507 (77h0m26.735982638s) [noise=true , address=104.36.82.61:4408 , piece_id=C6CCZOJQ4PNPM572TP73E7LDZ4YCXRPMUFN64DN4VZYRW7MOPIBA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.304923146 (77h0m26.736003277s) [seg_pos={0 0}, upload=80262]: Segment reached optimal threshold of 14 pieces. Aug 11 22:26:32.305050350 (77h0m26.736130481s) [noise=true , address=104.36.82.34:4545 , piece_id=FPH3U4KXKWDHKDXPSNC5KB2LTHDVBIXKSFLYA7YVXUADTI26E25A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra): protocol: expected piece hash; context canceled; EOF Aug 11 22:26:32.305105094 (77h0m26.736185225s) [noise=true , address=104.36.82.18:4394 , piece_id=67UIQFUSRYODDQD7267IK6T7LI2USCMLOQ6NHAKB6R7BREEPLOZA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q6GgLmLeGugk1rQu21KNV2pEjXTmgAfiYcV45ibvDixBW41K2): protocol: expected piece hash; context canceled; EOF Aug 11 22:26:32.305485442 (77h0m26.736565573s) [noise=true , address=104.36.82.8:4977 , piece_id=CIWWKHEX5PEEW5S5M6PRJ6IMJWJJPMZDPZDWOWWSA2SSKL6QHLKQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCAm12tXwimFSPqz7Seh6A4oxWqQVxqsF459xux4a5CqjpbAT): protocol: read tcp 188.166.225.170:46648->104.36.82.8:4977: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 22:26:32.305518896 (77h0m26.736599027s) [noise=true , address=104.36.82.13:4213 , piece_id=AC7QMQJBZZCUJOPDDJQRTBLNPHMQP7T6KYQU2MVABDTZINKGEI5Q, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDcAySWNCL7XoStP5GKzAksN1kTs9L8u4KStgyaiQn3AvLcRM): protocol: read tcp 188.166.225.170:56468->104.36.82.13:4213: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 22:26:32.305543643 (77h0m26.736623774s) [seg_pos={0 0}, upload=80262]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:26:32.305611663 (77h0m26.736691794s) [upload=80262]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:26:32.305615842 (77h0m26.736695973s) [upload=80262]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:26:32.608068006 (77h0m27.039148137s) [upload=80262]: Done uploading segments... Aug 11 22:26:32.608087844 (77h0m27.039167975s) [upload=80262]: Upload finished. err: <nil> Duration: 6.899452571s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............................X.X...................X......] duration: 1.833837696s FAIL (2025-08-11 22:32:58 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 22:26:58.357568431 (77h0m52.788648562s) [upload=80269]: Starting upload Aug 11 22:26:58.357612295 (77h0m52.788692426s) [upload=80269]: Done starting upload Aug 11 22:26:58.357654996 (77h0m52.788735128s) [upload=80269]: Uploading segments... Aug 11 22:26:58.357686247 (77h0m52.788766368s) [upload=80269]: Got next segment. Inline: true Aug 11 22:26:58.357689654 (77h0m52.788769785s) [upload=80269]: Waiting for error group managing segments... Aug 11 22:26:58.357720903 (77h0m52.788801034s) [upload=80269]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:26:58.357724660 (77h0m52.788804791s) [upload=80269]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 22:26:58.357727095 (77h0m52.788807226s) [upload=80269]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:26:58.667015570 (77h0m53.098095701s) [upload=80269]: Done uploading segments... Aug 11 22:26:58.667034425 (77h0m53.098114556s) [upload=80269]: Upload finished. err: <nil> Duration:* 1.833867915s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........X..............................X....X......X.......] duration: 6.996434599s FAIL (2025-08-11 22:32:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after de2609602ede5ed5bc389edbcde768f8b117316fc0253f3ff9280ad575c23e77 != before 892dca178903bc7ddc12846a33a40d0a34fdc16cfb22a5c9c7449bbd2640a3fd ======LOGS====== Aug 11 22:26:29.612708298 (77h0m24.043788429s) [upload=80262]: Starting upload Aug 11 22:26:29.612769895 (77h0m24.043850016s) [upload=80262]: Done starting upload Aug 11 22:26:29.612844999 (77h0m24.04392513s) [upload=80262]: Uploading segments... Aug 11 22:26:29.613140405 (77h0m24.044220536s) [upload=80262]: Got next segment. Inline: false Aug 11 22:26:29.613195580 (77h0m24.044275711s) [upload=80262]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:26:29.613202614 (77h0m24.044282765s) [upload=80262]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:26:30.109951250 (77h0m24.541031381s) [seg_pos={0 0}, upload=80262]: Begin upload segment... Aug 11 22:26:30.110015363 (77h0m24.541095494s) [seg_pos={0 0}, upload=80262]: Done begin upload segment. Aug 11 22:26:30.110054187 (77h0m24.541134318s) [noise=true , address=104.36.82.13:4213 , piece_id=AC7QMQJBZZCUJOPDDJQRTBLNPHMQP7T6KYQU2MVABDTZINKGEI5Q, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110059597 (77h0m24.541139728s) [noise=true , address=104.36.82.8:4977 , piece_id=CIWWKHEX5PEEW5S5M6PRJ6IMJWJJPMZDPZDWOWWSA2SSKL6QHLKQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110502866 (77h0m24.541583007s) [noise=true , address=104.36.82.61:4408 , piece_id=C6CCZOJQ4PNPM572TP73E7LDZ4YCXRPMUFN64DN4VZYRW7MOPIBA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110573330 (77h0m24.541653531s) [noise=true , address=104.36.82.47:4529 , piece_id=DFFJUBM2NNGBM5HRCAODNK7YCLB6FRIKHFEWNDC2PVTINVEKRP2A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110849519 (77h0m24.54192965s) [noise=true , address=104.36.82.21:4497 , piece_id=PWEMVGVZKB7EZS4W7CH7422JLZERI3XTPA5WNV4NC6SG2QAV4K6A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110982844 (77h0m24.542062975s) [noise=true , address=77.90.31.18:4812 , piece_id=WV6YUK4BM7PILJOE6X6ATLJNZ6Q5Q3NRVKB2WI6AQTLRDG5SDLRA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.111196312 (77h0m24.542276444s) [noise=true , address=104.36.82.18:4394 , piece_id=67UIQFUSRYODDQD7267IK6T7LI2USCMLOQ6NHAKB6R7BREEPLOZA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.111523769 (77h0m24.5426039s) [noise=true , address=64.49.13.26:4945 , piece_id=GPWOHSN2OSDZJCYACTNUP6E7X7WVOGR6DU4YFMLZK7USMJRAFAXA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.112198239 (77h0m24.54327837s) [noise=true , address=79.127.220.101:4073 , piece_id=LXWQI2DXSMXW3SV3IABAFZUMUX2OUM36KH5O2V2M6JPYYDVSVD6A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.112436215 (77h0m24.543516346s) [noise=true , address=104.36.82.16:4303 , piece_id=FUIMZ7LJCPZBYYURK4LEDD4QA7NKGT3RITWI4CQFSPUWUASXZD4A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.112710860 (77h0m24.543790991s) [noise=true , address=104.36.82.58:4282 , piece_id=LBUYWTAAZUQOURZR7J3HQFIBNLKFN3DB2O36DBY23U7SDAPRWOBQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113153237 (77h0m24.544233368s) [noise=true , address=104.36.82.59:4314 , piece_id=ZO3W4D72VA74X477LGTGDCJJKFBUMFB25DUKMWX3WZH34VZKVG2Q, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113414036 (77h0m24.544494167s) [noise=true , address=104.36.82.45:4908 , piece_id=WLO343PJNCX5EPJXOISKKGU4OWPH7Y35D5OQ4OOGYSRBP5LO7BCQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113637804 (77h0m24.544717935s) [noise=true , address=104.36.82.22:4532 , piece_id=QQXQYRXNXXGVCH74ICKDMK4N6TFSSADPEAWZUC2KAP6PPOJSPSOQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113896769 (77h0m24.54497689s) [noise=true , address=104.36.82.17:4332 , piece_id=VNG4XRM4Q6GPB75OIDJYW3POR3JRMSHUCMV42OIZJ3XJJC5SP7OQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.114104116 (77h0m24.545184247s) [noise=true , address=104.36.82.34:4545 , piece_id=FPH3U4KXKWDHKDXPSNC5KB2LTHDVBIXKSFLYA7YVXUADTI26E25A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.114718722 (77h0m24.545798853s) [noise=true , address=104.36.82.5:4860 , piece_id=MXH3B674XJ33ADRLOFJZXYJZIEQOCLQ7WDJBSWIIJU4RQMSVLSSQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.115368636 (77h0m24.546448767s) [noise=true , address=104.36.82.62:4435 , piece_id=DN4JVKBXHP6ZAOU47NK7ZRAD2T3BY2GYTWVIUFHYHYXIZJVESI6A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:31.281304078 (77h0m25.712384209s) [upload=80262]: Next returned nil segment Aug 11 22:26:31.281338404 (77h0m25.712418535s) [upload=80262]: Waiting for error group managing segments... Aug 11 22:26:31.600564253 (77h0m26.031644444s) [noise=true , address=64.49.13.26:4945 , piece_id=GPWOHSN2OSDZJCYACTNUP6E7X7WVOGR6DU4YFMLZK7USMJRAFAXA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:31.991107398 (77h0m26.422187529s) [noise=true , address=79.127.220.101:4073 , piece_id=LXWQI2DXSMXW3SV3IABAFZUMUX2OUM36KH5O2V2M6JPYYDVSVD6A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.071078223 (77h0m26.502158354s) [noise=true , address=104.36.82.58:4282 , piece_id=LBUYWTAAZUQOURZR7J3HQFIBNLKFN3DB2O36DBY23U7SDAPRWOBQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.115562588 (77h0m26.546642719s) [noise=true , address=104.36.82.45:4908 , piece_id=WLO343PJNCX5EPJXOISKKGU4OWPH7Y35D5OQ4OOGYSRBP5LO7BCQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.130410037 (77h0m26.561490168s) [noise=true , address=104.36.82.17:4332 , piece_id=VNG4XRM4Q6GPB75OIDJYW3POR3JRMSHUCMV42OIZJ3XJJC5SP7OQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.131124754 (77h0m26.562204885s) [noise=true , address=104.36.82.21:4497 , piece_id=PWEMVGVZKB7EZS4W7CH7422JLZERI3XTPA5WNV4NC6SG2QAV4K6A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.180906606 (77h0m26.611986737s) [noise=true , address=104.36.82.47:4529 , piece_id=DFFJUBM2NNGBM5HRCAODNK7YCLB6FRIKHFEWNDC2PVTINVEKRP2A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.227616279 (77h0m26.6586964s) [noise=true , address=104.36.82.16:4303 , piece_id=FUIMZ7LJCPZBYYURK4LEDD4QA7NKGT3RITWI4CQFSPUWUASXZD4A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.228268337 (77h0m26.659348458s) [noise=true , address=77.90.31.18:4812 , piece_id=WV6YUK4BM7PILJOE6X6ATLJNZ6Q5Q3NRVKB2WI6AQTLRDG5SDLRA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.239880475 (77h0m26.670960606s) [noise=true , address=104.36.82.22:4532 , piece_id=QQXQYRXNXXGVCH74ICKDMK4N6TFSSADPEAWZUC2KAP6PPOJSPSOQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.241576581 (77h0m26.672656712s) [noise=true , address=104.36.82.62:4435 , piece_id=DN4JVKBXHP6ZAOU47NK7ZRAD2T3BY2GYTWVIUFHYHYXIZJVESI6A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.263864415 (77h0m26.694944546s) [noise=true , address=104.36.82.59:4314 , piece_id=ZO3W4D72VA74X477LGTGDCJJKFBUMFB25DUKMWX3WZH34VZKVG2Q, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.267293096 (77h0m26.698373227s) [noise=true , address=104.36.82.5:4860 , piece_id=MXH3B674XJ33ADRLOFJZXYJZIEQOCLQ7WDJBSWIIJU4RQMSVLSSQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.304902507 (77h0m26.735982638s) [noise=true , address=104.36.82.61:4408 , piece_id=C6CCZOJQ4PNPM572TP73E7LDZ4YCXRPMUFN64DN4VZYRW7MOPIBA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.304923146 (77h0m26.736003277s) [seg_pos={0 0}, upload=80262]: Segment reached optimal threshold of 14 pieces. Aug 11 22:26:32.305050350 (77h0m26.736130481s) [noise=true , address=104.36.82.34:4545 , piece_id=FPH3U4KXKWDHKDXPSNC5KB2LTHDVBIXKSFLYA7YVXUADTI26E25A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra): protocol: expected piece hash; context canceled; EOF Aug 11 22:26:32.305105094 (77h0m26.736185225s) [noise=true , address=104.36.82.18:4394 , piece_id=67UIQFUSRYODDQD7267IK6T7LI2USCMLOQ6NHAKB6R7BREEPLOZA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q6GgLmLeGugk1rQu21KNV2pEjXTmgAfiYcV45ibvDixBW41K2): protocol: expected piece hash; context canceled; EOF Aug 11 22:26:32.305485442 (77h0m26.736565573s) [noise=true , address=104.36.82.8:4977 , piece_id=CIWWKHEX5PEEW5S5M6PRJ6IMJWJJPMZDPZDWOWWSA2SSKL6QHLKQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCAm12tXwimFSPqz7Seh6A4oxWqQVxqsF459xux4a5CqjpbAT): protocol: read tcp 188.166.225.170:46648->104.36.82.8:4977: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 22:26:32.305518896 (77h0m26.736599027s) [noise=true , address=104.36.82.13:4213 , piece_id=AC7QMQJBZZCUJOPDDJQRTBLNPHMQP7T6KYQU2MVABDTZINKGEI5Q, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDcAySWNCL7XoStP5GKzAksN1kTs9L8u4KStgyaiQn3AvLcRM): protocol: read tcp 188.166.225.170:56468->104.36.82.13:4213: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 22:26:32.305543643 (77h0m26.736623774s) [seg_pos={0 0}, upload=80262]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:26:32.305611663 (77h0m26.736691794s) [upload=80262]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:26:32.305615842 (77h0m26.736695973s) [upload=80262]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:26:32.608068006 (77h0m27.039148137s) [upload=80262]: Done uploading segments... Aug 11 22:26:32.608087844 (77h0m27.039167975s) [upload=80262]: Upload finished. err: <nil> Duration: 6.996459316s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [................................X.X...................X.....] duration: 1.928914247s FAIL (2025-08-11 22:32:04 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 22:26:58.357568431 (77h0m52.788648562s) [upload=80269]: Starting upload Aug 11 22:26:58.357612295 (77h0m52.788692426s) [upload=80269]: Done starting upload Aug 11 22:26:58.357654996 (77h0m52.788735128s) [upload=80269]: Uploading segments... Aug 11 22:26:58.357686247 (77h0m52.788766368s) [upload=80269]: Got next segment. Inline: true Aug 11 22:26:58.357689654 (77h0m52.788769785s) [upload=80269]: Waiting for error group managing segments... Aug 11 22:26:58.357720903 (77h0m52.788801034s) [upload=80269]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:26:58.357724660 (77h0m52.788804791s) [upload=80269]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 22:26:58.357727095 (77h0m52.788807226s) [upload=80269]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:26:58.667015570 (77h0m53.098095701s) [upload=80269]: Done uploading segments... Aug 11 22:26:58.667034425 (77h0m53.098114556s) [upload=80269]: Upload finished. err: <nil> Duration:* 1.928936118s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........X..............................X....X......X......] duration: 6.015006375s FAIL (2025-08-11 22:31:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after de2609602ede5ed5bc389edbcde768f8b117316fc0253f3ff9280ad575c23e77 != before 892dca178903bc7ddc12846a33a40d0a34fdc16cfb22a5c9c7449bbd2640a3fd ======LOGS====== Aug 11 22:26:29.612708298 (77h0m24.043788429s) [upload=80262]: Starting upload Aug 11 22:26:29.612769895 (77h0m24.043850016s) [upload=80262]: Done starting upload Aug 11 22:26:29.612844999 (77h0m24.04392513s) [upload=80262]: Uploading segments... Aug 11 22:26:29.613140405 (77h0m24.044220536s) [upload=80262]: Got next segment. Inline: false Aug 11 22:26:29.613195580 (77h0m24.044275711s) [upload=80262]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:26:29.613202614 (77h0m24.044282765s) [upload=80262]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:26:30.109951250 (77h0m24.541031381s) [seg_pos={0 0}, upload=80262]: Begin upload segment... Aug 11 22:26:30.110015363 (77h0m24.541095494s) [seg_pos={0 0}, upload=80262]: Done begin upload segment. Aug 11 22:26:30.110054187 (77h0m24.541134318s) [noise=true , address=104.36.82.13:4213 , piece_id=AC7QMQJBZZCUJOPDDJQRTBLNPHMQP7T6KYQU2MVABDTZINKGEI5Q, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110059597 (77h0m24.541139728s) [noise=true , address=104.36.82.8:4977 , piece_id=CIWWKHEX5PEEW5S5M6PRJ6IMJWJJPMZDPZDWOWWSA2SSKL6QHLKQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110502866 (77h0m24.541583007s) [noise=true , address=104.36.82.61:4408 , piece_id=C6CCZOJQ4PNPM572TP73E7LDZ4YCXRPMUFN64DN4VZYRW7MOPIBA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110573330 (77h0m24.541653531s) [noise=true , address=104.36.82.47:4529 , piece_id=DFFJUBM2NNGBM5HRCAODNK7YCLB6FRIKHFEWNDC2PVTINVEKRP2A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110849519 (77h0m24.54192965s) [noise=true , address=104.36.82.21:4497 , piece_id=PWEMVGVZKB7EZS4W7CH7422JLZERI3XTPA5WNV4NC6SG2QAV4K6A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110982844 (77h0m24.542062975s) [noise=true , address=77.90.31.18:4812 , piece_id=WV6YUK4BM7PILJOE6X6ATLJNZ6Q5Q3NRVKB2WI6AQTLRDG5SDLRA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.111196312 (77h0m24.542276444s) [noise=true , address=104.36.82.18:4394 , piece_id=67UIQFUSRYODDQD7267IK6T7LI2USCMLOQ6NHAKB6R7BREEPLOZA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.111523769 (77h0m24.5426039s) [noise=true , address=64.49.13.26:4945 , piece_id=GPWOHSN2OSDZJCYACTNUP6E7X7WVOGR6DU4YFMLZK7USMJRAFAXA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.112198239 (77h0m24.54327837s) [noise=true , address=79.127.220.101:4073 , piece_id=LXWQI2DXSMXW3SV3IABAFZUMUX2OUM36KH5O2V2M6JPYYDVSVD6A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.112436215 (77h0m24.543516346s) [noise=true , address=104.36.82.16:4303 , piece_id=FUIMZ7LJCPZBYYURK4LEDD4QA7NKGT3RITWI4CQFSPUWUASXZD4A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.112710860 (77h0m24.543790991s) [noise=true , address=104.36.82.58:4282 , piece_id=LBUYWTAAZUQOURZR7J3HQFIBNLKFN3DB2O36DBY23U7SDAPRWOBQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113153237 (77h0m24.544233368s) [noise=true , address=104.36.82.59:4314 , piece_id=ZO3W4D72VA74X477LGTGDCJJKFBUMFB25DUKMWX3WZH34VZKVG2Q, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113414036 (77h0m24.544494167s) [noise=true , address=104.36.82.45:4908 , piece_id=WLO343PJNCX5EPJXOISKKGU4OWPH7Y35D5OQ4OOGYSRBP5LO7BCQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113637804 (77h0m24.544717935s) [noise=true , address=104.36.82.22:4532 , piece_id=QQXQYRXNXXGVCH74ICKDMK4N6TFSSADPEAWZUC2KAP6PPOJSPSOQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113896769 (77h0m24.54497689s) [noise=true , address=104.36.82.17:4332 , piece_id=VNG4XRM4Q6GPB75OIDJYW3POR3JRMSHUCMV42OIZJ3XJJC5SP7OQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.114104116 (77h0m24.545184247s) [noise=true , address=104.36.82.34:4545 , piece_id=FPH3U4KXKWDHKDXPSNC5KB2LTHDVBIXKSFLYA7YVXUADTI26E25A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.114718722 (77h0m24.545798853s) [noise=true , address=104.36.82.5:4860 , piece_id=MXH3B674XJ33ADRLOFJZXYJZIEQOCLQ7WDJBSWIIJU4RQMSVLSSQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.115368636 (77h0m24.546448767s) [noise=true , address=104.36.82.62:4435 , piece_id=DN4JVKBXHP6ZAOU47NK7ZRAD2T3BY2GYTWVIUFHYHYXIZJVESI6A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:31.281304078 (77h0m25.712384209s) [upload=80262]: Next returned nil segment Aug 11 22:26:31.281338404 (77h0m25.712418535s) [upload=80262]: Waiting for error group managing segments... Aug 11 22:26:31.600564253 (77h0m26.031644444s) [noise=true , address=64.49.13.26:4945 , piece_id=GPWOHSN2OSDZJCYACTNUP6E7X7WVOGR6DU4YFMLZK7USMJRAFAXA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:31.991107398 (77h0m26.422187529s) [noise=true , address=79.127.220.101:4073 , piece_id=LXWQI2DXSMXW3SV3IABAFZUMUX2OUM36KH5O2V2M6JPYYDVSVD6A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.071078223 (77h0m26.502158354s) [noise=true , address=104.36.82.58:4282 , piece_id=LBUYWTAAZUQOURZR7J3HQFIBNLKFN3DB2O36DBY23U7SDAPRWOBQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.115562588 (77h0m26.546642719s) [noise=true , address=104.36.82.45:4908 , piece_id=WLO343PJNCX5EPJXOISKKGU4OWPH7Y35D5OQ4OOGYSRBP5LO7BCQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.130410037 (77h0m26.561490168s) [noise=true , address=104.36.82.17:4332 , piece_id=VNG4XRM4Q6GPB75OIDJYW3POR3JRMSHUCMV42OIZJ3XJJC5SP7OQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.131124754 (77h0m26.562204885s) [noise=true , address=104.36.82.21:4497 , piece_id=PWEMVGVZKB7EZS4W7CH7422JLZERI3XTPA5WNV4NC6SG2QAV4K6A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.180906606 (77h0m26.611986737s) [noise=true , address=104.36.82.47:4529 , piece_id=DFFJUBM2NNGBM5HRCAODNK7YCLB6FRIKHFEWNDC2PVTINVEKRP2A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.227616279 (77h0m26.6586964s) [noise=true , address=104.36.82.16:4303 , piece_id=FUIMZ7LJCPZBYYURK4LEDD4QA7NKGT3RITWI4CQFSPUWUASXZD4A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.228268337 (77h0m26.659348458s) [noise=true , address=77.90.31.18:4812 , piece_id=WV6YUK4BM7PILJOE6X6ATLJNZ6Q5Q3NRVKB2WI6AQTLRDG5SDLRA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.239880475 (77h0m26.670960606s) [noise=true , address=104.36.82.22:4532 , piece_id=QQXQYRXNXXGVCH74ICKDMK4N6TFSSADPEAWZUC2KAP6PPOJSPSOQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.241576581 (77h0m26.672656712s) [noise=true , address=104.36.82.62:4435 , piece_id=DN4JVKBXHP6ZAOU47NK7ZRAD2T3BY2GYTWVIUFHYHYXIZJVESI6A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.263864415 (77h0m26.694944546s) [noise=true , address=104.36.82.59:4314 , piece_id=ZO3W4D72VA74X477LGTGDCJJKFBUMFB25DUKMWX3WZH34VZKVG2Q, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.267293096 (77h0m26.698373227s) [noise=true , address=104.36.82.5:4860 , piece_id=MXH3B674XJ33ADRLOFJZXYJZIEQOCLQ7WDJBSWIIJU4RQMSVLSSQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.304902507 (77h0m26.735982638s) [noise=true , address=104.36.82.61:4408 , piece_id=C6CCZOJQ4PNPM572TP73E7LDZ4YCXRPMUFN64DN4VZYRW7MOPIBA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.304923146 (77h0m26.736003277s) [seg_pos={0 0}, upload=80262]: Segment reached optimal threshold of 14 pieces. Aug 11 22:26:32.305050350 (77h0m26.736130481s) [noise=true , address=104.36.82.34:4545 , piece_id=FPH3U4KXKWDHKDXPSNC5KB2LTHDVBIXKSFLYA7YVXUADTI26E25A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra): protocol: expected piece hash; context canceled; EOF Aug 11 22:26:32.305105094 (77h0m26.736185225s) [noise=true , address=104.36.82.18:4394 , piece_id=67UIQFUSRYODDQD7267IK6T7LI2USCMLOQ6NHAKB6R7BREEPLOZA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q6GgLmLeGugk1rQu21KNV2pEjXTmgAfiYcV45ibvDixBW41K2): protocol: expected piece hash; context canceled; EOF Aug 11 22:26:32.305485442 (77h0m26.736565573s) [noise=true , address=104.36.82.8:4977 , piece_id=CIWWKHEX5PEEW5S5M6PRJ6IMJWJJPMZDPZDWOWWSA2SSKL6QHLKQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCAm12tXwimFSPqz7Seh6A4oxWqQVxqsF459xux4a5CqjpbAT): protocol: read tcp 188.166.225.170:46648->104.36.82.8:4977: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 22:26:32.305518896 (77h0m26.736599027s) [noise=true , address=104.36.82.13:4213 , piece_id=AC7QMQJBZZCUJOPDDJQRTBLNPHMQP7T6KYQU2MVABDTZINKGEI5Q, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDcAySWNCL7XoStP5GKzAksN1kTs9L8u4KStgyaiQn3AvLcRM): protocol: read tcp 188.166.225.170:56468->104.36.82.13:4213: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 22:26:32.305543643 (77h0m26.736623774s) [seg_pos={0 0}, upload=80262]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:26:32.305611663 (77h0m26.736691794s) [upload=80262]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:26:32.305615842 (77h0m26.736695973s) [upload=80262]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:26:32.608068006 (77h0m27.039148137s) [upload=80262]: Done uploading segments... Aug 11 22:26:32.608087844 (77h0m27.039167975s) [upload=80262]: Upload finished. err: <nil> Duration: 6.015026102s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.................................X.X...................X....] duration: 1.863026679s FAIL (2025-08-11 22:30:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 22:26:58.357568431 (77h0m52.788648562s) [upload=80269]: Starting upload Aug 11 22:26:58.357612295 (77h0m52.788692426s) [upload=80269]: Done starting upload Aug 11 22:26:58.357654996 (77h0m52.788735128s) [upload=80269]: Uploading segments... Aug 11 22:26:58.357686247 (77h0m52.788766368s) [upload=80269]: Got next segment. Inline: true Aug 11 22:26:58.357689654 (77h0m52.788769785s) [upload=80269]: Waiting for error group managing segments... Aug 11 22:26:58.357720903 (77h0m52.788801034s) [upload=80269]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:26:58.357724660 (77h0m52.788804791s) [upload=80269]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 22:26:58.357727095 (77h0m52.788807226s) [upload=80269]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:26:58.667015570 (77h0m53.098095701s) [upload=80269]: Done uploading segments... Aug 11 22:26:58.667034425 (77h0m53.098114556s) [upload=80269]: Upload finished. err: <nil> Duration:* 1.863216153s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [...........X..............................X....X......X.....] duration: 6.430825518s FAIL (2025-08-11 22:30:50 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after de2609602ede5ed5bc389edbcde768f8b117316fc0253f3ff9280ad575c23e77 != before 892dca178903bc7ddc12846a33a40d0a34fdc16cfb22a5c9c7449bbd2640a3fd ======LOGS====== Aug 11 22:26:29.612708298 (77h0m24.043788429s) [upload=80262]: Starting upload Aug 11 22:26:29.612769895 (77h0m24.043850016s) [upload=80262]: Done starting upload Aug 11 22:26:29.612844999 (77h0m24.04392513s) [upload=80262]: Uploading segments... Aug 11 22:26:29.613140405 (77h0m24.044220536s) [upload=80262]: Got next segment. Inline: false Aug 11 22:26:29.613195580 (77h0m24.044275711s) [upload=80262]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:26:29.613202614 (77h0m24.044282765s) [upload=80262]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:26:30.109951250 (77h0m24.541031381s) [seg_pos={0 0}, upload=80262]: Begin upload segment... Aug 11 22:26:30.110015363 (77h0m24.541095494s) [seg_pos={0 0}, upload=80262]: Done begin upload segment. Aug 11 22:26:30.110054187 (77h0m24.541134318s) [noise=true , address=104.36.82.13:4213 , piece_id=AC7QMQJBZZCUJOPDDJQRTBLNPHMQP7T6KYQU2MVABDTZINKGEI5Q, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110059597 (77h0m24.541139728s) [noise=true , address=104.36.82.8:4977 , piece_id=CIWWKHEX5PEEW5S5M6PRJ6IMJWJJPMZDPZDWOWWSA2SSKL6QHLKQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110502866 (77h0m24.541583007s) [noise=true , address=104.36.82.61:4408 , piece_id=C6CCZOJQ4PNPM572TP73E7LDZ4YCXRPMUFN64DN4VZYRW7MOPIBA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110573330 (77h0m24.541653531s) [noise=true , address=104.36.82.47:4529 , piece_id=DFFJUBM2NNGBM5HRCAODNK7YCLB6FRIKHFEWNDC2PVTINVEKRP2A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110849519 (77h0m24.54192965s) [noise=true , address=104.36.82.21:4497 , piece_id=PWEMVGVZKB7EZS4W7CH7422JLZERI3XTPA5WNV4NC6SG2QAV4K6A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110982844 (77h0m24.542062975s) [noise=true , address=77.90.31.18:4812 , piece_id=WV6YUK4BM7PILJOE6X6ATLJNZ6Q5Q3NRVKB2WI6AQTLRDG5SDLRA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.111196312 (77h0m24.542276444s) [noise=true , address=104.36.82.18:4394 , piece_id=67UIQFUSRYODDQD7267IK6T7LI2USCMLOQ6NHAKB6R7BREEPLOZA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.111523769 (77h0m24.5426039s) [noise=true , address=64.49.13.26:4945 , piece_id=GPWOHSN2OSDZJCYACTNUP6E7X7WVOGR6DU4YFMLZK7USMJRAFAXA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.112198239 (77h0m24.54327837s) [noise=true , address=79.127.220.101:4073 , piece_id=LXWQI2DXSMXW3SV3IABAFZUMUX2OUM36KH5O2V2M6JPYYDVSVD6A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.112436215 (77h0m24.543516346s) [noise=true , address=104.36.82.16:4303 , piece_id=FUIMZ7LJCPZBYYURK4LEDD4QA7NKGT3RITWI4CQFSPUWUASXZD4A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.112710860 (77h0m24.543790991s) [noise=true , address=104.36.82.58:4282 , piece_id=LBUYWTAAZUQOURZR7J3HQFIBNLKFN3DB2O36DBY23U7SDAPRWOBQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113153237 (77h0m24.544233368s) [noise=true , address=104.36.82.59:4314 , piece_id=ZO3W4D72VA74X477LGTGDCJJKFBUMFB25DUKMWX3WZH34VZKVG2Q, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113414036 (77h0m24.544494167s) [noise=true , address=104.36.82.45:4908 , piece_id=WLO343PJNCX5EPJXOISKKGU4OWPH7Y35D5OQ4OOGYSRBP5LO7BCQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113637804 (77h0m24.544717935s) [noise=true , address=104.36.82.22:4532 , piece_id=QQXQYRXNXXGVCH74ICKDMK4N6TFSSADPEAWZUC2KAP6PPOJSPSOQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113896769 (77h0m24.54497689s) [noise=true , address=104.36.82.17:4332 , piece_id=VNG4XRM4Q6GPB75OIDJYW3POR3JRMSHUCMV42OIZJ3XJJC5SP7OQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.114104116 (77h0m24.545184247s) [noise=true , address=104.36.82.34:4545 , piece_id=FPH3U4KXKWDHKDXPSNC5KB2LTHDVBIXKSFLYA7YVXUADTI26E25A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.114718722 (77h0m24.545798853s) [noise=true , address=104.36.82.5:4860 , piece_id=MXH3B674XJ33ADRLOFJZXYJZIEQOCLQ7WDJBSWIIJU4RQMSVLSSQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.115368636 (77h0m24.546448767s) [noise=true , address=104.36.82.62:4435 , piece_id=DN4JVKBXHP6ZAOU47NK7ZRAD2T3BY2GYTWVIUFHYHYXIZJVESI6A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:31.281304078 (77h0m25.712384209s) [upload=80262]: Next returned nil segment Aug 11 22:26:31.281338404 (77h0m25.712418535s) [upload=80262]: Waiting for error group managing segments... Aug 11 22:26:31.600564253 (77h0m26.031644444s) [noise=true , address=64.49.13.26:4945 , piece_id=GPWOHSN2OSDZJCYACTNUP6E7X7WVOGR6DU4YFMLZK7USMJRAFAXA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:31.991107398 (77h0m26.422187529s) [noise=true , address=79.127.220.101:4073 , piece_id=LXWQI2DXSMXW3SV3IABAFZUMUX2OUM36KH5O2V2M6JPYYDVSVD6A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.071078223 (77h0m26.502158354s) [noise=true , address=104.36.82.58:4282 , piece_id=LBUYWTAAZUQOURZR7J3HQFIBNLKFN3DB2O36DBY23U7SDAPRWOBQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.115562588 (77h0m26.546642719s) [noise=true , address=104.36.82.45:4908 , piece_id=WLO343PJNCX5EPJXOISKKGU4OWPH7Y35D5OQ4OOGYSRBP5LO7BCQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.130410037 (77h0m26.561490168s) [noise=true , address=104.36.82.17:4332 , piece_id=VNG4XRM4Q6GPB75OIDJYW3POR3JRMSHUCMV42OIZJ3XJJC5SP7OQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.131124754 (77h0m26.562204885s) [noise=true , address=104.36.82.21:4497 , piece_id=PWEMVGVZKB7EZS4W7CH7422JLZERI3XTPA5WNV4NC6SG2QAV4K6A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.180906606 (77h0m26.611986737s) [noise=true , address=104.36.82.47:4529 , piece_id=DFFJUBM2NNGBM5HRCAODNK7YCLB6FRIKHFEWNDC2PVTINVEKRP2A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.227616279 (77h0m26.6586964s) [noise=true , address=104.36.82.16:4303 , piece_id=FUIMZ7LJCPZBYYURK4LEDD4QA7NKGT3RITWI4CQFSPUWUASXZD4A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.228268337 (77h0m26.659348458s) [noise=true , address=77.90.31.18:4812 , piece_id=WV6YUK4BM7PILJOE6X6ATLJNZ6Q5Q3NRVKB2WI6AQTLRDG5SDLRA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.239880475 (77h0m26.670960606s) [noise=true , address=104.36.82.22:4532 , piece_id=QQXQYRXNXXGVCH74ICKDMK4N6TFSSADPEAWZUC2KAP6PPOJSPSOQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.241576581 (77h0m26.672656712s) [noise=true , address=104.36.82.62:4435 , piece_id=DN4JVKBXHP6ZAOU47NK7ZRAD2T3BY2GYTWVIUFHYHYXIZJVESI6A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.263864415 (77h0m26.694944546s) [noise=true , address=104.36.82.59:4314 , piece_id=ZO3W4D72VA74X477LGTGDCJJKFBUMFB25DUKMWX3WZH34VZKVG2Q, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.267293096 (77h0m26.698373227s) [noise=true , address=104.36.82.5:4860 , piece_id=MXH3B674XJ33ADRLOFJZXYJZIEQOCLQ7WDJBSWIIJU4RQMSVLSSQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.304902507 (77h0m26.735982638s) [noise=true , address=104.36.82.61:4408 , piece_id=C6CCZOJQ4PNPM572TP73E7LDZ4YCXRPMUFN64DN4VZYRW7MOPIBA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.304923146 (77h0m26.736003277s) [seg_pos={0 0}, upload=80262]: Segment reached optimal threshold of 14 pieces. Aug 11 22:26:32.305050350 (77h0m26.736130481s) [noise=true , address=104.36.82.34:4545 , piece_id=FPH3U4KXKWDHKDXPSNC5KB2LTHDVBIXKSFLYA7YVXUADTI26E25A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra): protocol: expected piece hash; context canceled; EOF Aug 11 22:26:32.305105094 (77h0m26.736185225s) [noise=true , address=104.36.82.18:4394 , piece_id=67UIQFUSRYODDQD7267IK6T7LI2USCMLOQ6NHAKB6R7BREEPLOZA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q6GgLmLeGugk1rQu21KNV2pEjXTmgAfiYcV45ibvDixBW41K2): protocol: expected piece hash; context canceled; EOF Aug 11 22:26:32.305485442 (77h0m26.736565573s) [noise=true , address=104.36.82.8:4977 , piece_id=CIWWKHEX5PEEW5S5M6PRJ6IMJWJJPMZDPZDWOWWSA2SSKL6QHLKQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCAm12tXwimFSPqz7Seh6A4oxWqQVxqsF459xux4a5CqjpbAT): protocol: read tcp 188.166.225.170:46648->104.36.82.8:4977: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 22:26:32.305518896 (77h0m26.736599027s) [noise=true , address=104.36.82.13:4213 , piece_id=AC7QMQJBZZCUJOPDDJQRTBLNPHMQP7T6KYQU2MVABDTZINKGEI5Q, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDcAySWNCL7XoStP5GKzAksN1kTs9L8u4KStgyaiQn3AvLcRM): protocol: read tcp 188.166.225.170:56468->104.36.82.13:4213: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 22:26:32.305543643 (77h0m26.736623774s) [seg_pos={0 0}, upload=80262]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:26:32.305611663 (77h0m26.736691794s) [upload=80262]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:26:32.305615842 (77h0m26.736695973s) [upload=80262]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:26:32.608068006 (77h0m27.039148137s) [upload=80262]: Done uploading segments... Aug 11 22:26:32.608087844 (77h0m27.039167975s) [upload=80262]: Upload finished. err: <nil> Duration: 6.430851947s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [............X..............................X....X......X....] duration: 6.943938261s FAIL (2025-08-11 22:30:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after de2609602ede5ed5bc389edbcde768f8b117316fc0253f3ff9280ad575c23e77 != before 892dca178903bc7ddc12846a33a40d0a34fdc16cfb22a5c9c7449bbd2640a3fd ======LOGS====== Aug 11 22:26:29.612708298 (77h0m24.043788429s) [upload=80262]: Starting upload Aug 11 22:26:29.612769895 (77h0m24.043850016s) [upload=80262]: Done starting upload Aug 11 22:26:29.612844999 (77h0m24.04392513s) [upload=80262]: Uploading segments... Aug 11 22:26:29.613140405 (77h0m24.044220536s) [upload=80262]: Got next segment. Inline: false Aug 11 22:26:29.613195580 (77h0m24.044275711s) [upload=80262]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:26:29.613202614 (77h0m24.044282765s) [upload=80262]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:26:30.109951250 (77h0m24.541031381s) [seg_pos={0 0}, upload=80262]: Begin upload segment... Aug 11 22:26:30.110015363 (77h0m24.541095494s) [seg_pos={0 0}, upload=80262]: Done begin upload segment. Aug 11 22:26:30.110054187 (77h0m24.541134318s) [noise=true , address=104.36.82.13:4213 , piece_id=AC7QMQJBZZCUJOPDDJQRTBLNPHMQP7T6KYQU2MVABDTZINKGEI5Q, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110059597 (77h0m24.541139728s) [noise=true , address=104.36.82.8:4977 , piece_id=CIWWKHEX5PEEW5S5M6PRJ6IMJWJJPMZDPZDWOWWSA2SSKL6QHLKQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110502866 (77h0m24.541583007s) [noise=true , address=104.36.82.61:4408 , piece_id=C6CCZOJQ4PNPM572TP73E7LDZ4YCXRPMUFN64DN4VZYRW7MOPIBA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110573330 (77h0m24.541653531s) [noise=true , address=104.36.82.47:4529 , piece_id=DFFJUBM2NNGBM5HRCAODNK7YCLB6FRIKHFEWNDC2PVTINVEKRP2A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110849519 (77h0m24.54192965s) [noise=true , address=104.36.82.21:4497 , piece_id=PWEMVGVZKB7EZS4W7CH7422JLZERI3XTPA5WNV4NC6SG2QAV4K6A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110982844 (77h0m24.542062975s) [noise=true , address=77.90.31.18:4812 , piece_id=WV6YUK4BM7PILJOE6X6ATLJNZ6Q5Q3NRVKB2WI6AQTLRDG5SDLRA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.111196312 (77h0m24.542276444s) [noise=true , address=104.36.82.18:4394 , piece_id=67UIQFUSRYODDQD7267IK6T7LI2USCMLOQ6NHAKB6R7BREEPLOZA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.111523769 (77h0m24.5426039s) [noise=true , address=64.49.13.26:4945 , piece_id=GPWOHSN2OSDZJCYACTNUP6E7X7WVOGR6DU4YFMLZK7USMJRAFAXA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.112198239 (77h0m24.54327837s) [noise=true , address=79.127.220.101:4073 , piece_id=LXWQI2DXSMXW3SV3IABAFZUMUX2OUM36KH5O2V2M6JPYYDVSVD6A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.112436215 (77h0m24.543516346s) [noise=true , address=104.36.82.16:4303 , piece_id=FUIMZ7LJCPZBYYURK4LEDD4QA7NKGT3RITWI4CQFSPUWUASXZD4A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.112710860 (77h0m24.543790991s) [noise=true , address=104.36.82.58:4282 , piece_id=LBUYWTAAZUQOURZR7J3HQFIBNLKFN3DB2O36DBY23U7SDAPRWOBQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113153237 (77h0m24.544233368s) [noise=true , address=104.36.82.59:4314 , piece_id=ZO3W4D72VA74X477LGTGDCJJKFBUMFB25DUKMWX3WZH34VZKVG2Q, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113414036 (77h0m24.544494167s) [noise=true , address=104.36.82.45:4908 , piece_id=WLO343PJNCX5EPJXOISKKGU4OWPH7Y35D5OQ4OOGYSRBP5LO7BCQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113637804 (77h0m24.544717935s) [noise=true , address=104.36.82.22:4532 , piece_id=QQXQYRXNXXGVCH74ICKDMK4N6TFSSADPEAWZUC2KAP6PPOJSPSOQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113896769 (77h0m24.54497689s) [noise=true , address=104.36.82.17:4332 , piece_id=VNG4XRM4Q6GPB75OIDJYW3POR3JRMSHUCMV42OIZJ3XJJC5SP7OQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.114104116 (77h0m24.545184247s) [noise=true , address=104.36.82.34:4545 , piece_id=FPH3U4KXKWDHKDXPSNC5KB2LTHDVBIXKSFLYA7YVXUADTI26E25A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.114718722 (77h0m24.545798853s) [noise=true , address=104.36.82.5:4860 , piece_id=MXH3B674XJ33ADRLOFJZXYJZIEQOCLQ7WDJBSWIIJU4RQMSVLSSQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.115368636 (77h0m24.546448767s) [noise=true , address=104.36.82.62:4435 , piece_id=DN4JVKBXHP6ZAOU47NK7ZRAD2T3BY2GYTWVIUFHYHYXIZJVESI6A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:31.281304078 (77h0m25.712384209s) [upload=80262]: Next returned nil segment Aug 11 22:26:31.281338404 (77h0m25.712418535s) [upload=80262]: Waiting for error group managing segments... Aug 11 22:26:31.600564253 (77h0m26.031644444s) [noise=true , address=64.49.13.26:4945 , piece_id=GPWOHSN2OSDZJCYACTNUP6E7X7WVOGR6DU4YFMLZK7USMJRAFAXA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:31.991107398 (77h0m26.422187529s) [noise=true , address=79.127.220.101:4073 , piece_id=LXWQI2DXSMXW3SV3IABAFZUMUX2OUM36KH5O2V2M6JPYYDVSVD6A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.071078223 (77h0m26.502158354s) [noise=true , address=104.36.82.58:4282 , piece_id=LBUYWTAAZUQOURZR7J3HQFIBNLKFN3DB2O36DBY23U7SDAPRWOBQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.115562588 (77h0m26.546642719s) [noise=true , address=104.36.82.45:4908 , piece_id=WLO343PJNCX5EPJXOISKKGU4OWPH7Y35D5OQ4OOGYSRBP5LO7BCQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.130410037 (77h0m26.561490168s) [noise=true , address=104.36.82.17:4332 , piece_id=VNG4XRM4Q6GPB75OIDJYW3POR3JRMSHUCMV42OIZJ3XJJC5SP7OQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.131124754 (77h0m26.562204885s) [noise=true , address=104.36.82.21:4497 , piece_id=PWEMVGVZKB7EZS4W7CH7422JLZERI3XTPA5WNV4NC6SG2QAV4K6A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.180906606 (77h0m26.611986737s) [noise=true , address=104.36.82.47:4529 , piece_id=DFFJUBM2NNGBM5HRCAODNK7YCLB6FRIKHFEWNDC2PVTINVEKRP2A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.227616279 (77h0m26.6586964s) [noise=true , address=104.36.82.16:4303 , piece_id=FUIMZ7LJCPZBYYURK4LEDD4QA7NKGT3RITWI4CQFSPUWUASXZD4A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.228268337 (77h0m26.659348458s) [noise=true , address=77.90.31.18:4812 , piece_id=WV6YUK4BM7PILJOE6X6ATLJNZ6Q5Q3NRVKB2WI6AQTLRDG5SDLRA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.239880475 (77h0m26.670960606s) [noise=true , address=104.36.82.22:4532 , piece_id=QQXQYRXNXXGVCH74ICKDMK4N6TFSSADPEAWZUC2KAP6PPOJSPSOQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.241576581 (77h0m26.672656712s) [noise=true , address=104.36.82.62:4435 , piece_id=DN4JVKBXHP6ZAOU47NK7ZRAD2T3BY2GYTWVIUFHYHYXIZJVESI6A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.263864415 (77h0m26.694944546s) [noise=true , address=104.36.82.59:4314 , piece_id=ZO3W4D72VA74X477LGTGDCJJKFBUMFB25DUKMWX3WZH34VZKVG2Q, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.267293096 (77h0m26.698373227s) [noise=true , address=104.36.82.5:4860 , piece_id=MXH3B674XJ33ADRLOFJZXYJZIEQOCLQ7WDJBSWIIJU4RQMSVLSSQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.304902507 (77h0m26.735982638s) [noise=true , address=104.36.82.61:4408 , piece_id=C6CCZOJQ4PNPM572TP73E7LDZ4YCXRPMUFN64DN4VZYRW7MOPIBA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.304923146 (77h0m26.736003277s) [seg_pos={0 0}, upload=80262]: Segment reached optimal threshold of 14 pieces. Aug 11 22:26:32.305050350 (77h0m26.736130481s) [noise=true , address=104.36.82.34:4545 , piece_id=FPH3U4KXKWDHKDXPSNC5KB2LTHDVBIXKSFLYA7YVXUADTI26E25A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra): protocol: expected piece hash; context canceled; EOF Aug 11 22:26:32.305105094 (77h0m26.736185225s) [noise=true , address=104.36.82.18:4394 , piece_id=67UIQFUSRYODDQD7267IK6T7LI2USCMLOQ6NHAKB6R7BREEPLOZA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q6GgLmLeGugk1rQu21KNV2pEjXTmgAfiYcV45ibvDixBW41K2): protocol: expected piece hash; context canceled; EOF Aug 11 22:26:32.305485442 (77h0m26.736565573s) [noise=true , address=104.36.82.8:4977 , piece_id=CIWWKHEX5PEEW5S5M6PRJ6IMJWJJPMZDPZDWOWWSA2SSKL6QHLKQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCAm12tXwimFSPqz7Seh6A4oxWqQVxqsF459xux4a5CqjpbAT): protocol: read tcp 188.166.225.170:46648->104.36.82.8:4977: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 22:26:32.305518896 (77h0m26.736599027s) [noise=true , address=104.36.82.13:4213 , piece_id=AC7QMQJBZZCUJOPDDJQRTBLNPHMQP7T6KYQU2MVABDTZINKGEI5Q, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDcAySWNCL7XoStP5GKzAksN1kTs9L8u4KStgyaiQn3AvLcRM): protocol: read tcp 188.166.225.170:56468->104.36.82.13:4213: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 22:26:32.305543643 (77h0m26.736623774s) [seg_pos={0 0}, upload=80262]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:26:32.305611663 (77h0m26.736691794s) [upload=80262]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:26:32.305615842 (77h0m26.736695973s) [upload=80262]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:26:32.608068006 (77h0m27.039148137s) [upload=80262]: Done uploading segments... Aug 11 22:26:32.608087844 (77h0m27.039167975s) [upload=80262]: Upload finished. err: <nil> Duration: 6.943962567s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..................................X.X...................X...] duration: 1.869529363s FAIL (2025-08-11 22:29:44 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 22:26:58.357568431 (77h0m52.788648562s) [upload=80269]: Starting upload Aug 11 22:26:58.357612295 (77h0m52.788692426s) [upload=80269]: Done starting upload Aug 11 22:26:58.357654996 (77h0m52.788735128s) [upload=80269]: Uploading segments... Aug 11 22:26:58.357686247 (77h0m52.788766368s) [upload=80269]: Got next segment. Inline: true Aug 11 22:26:58.357689654 (77h0m52.788769785s) [upload=80269]: Waiting for error group managing segments... Aug 11 22:26:58.357720903 (77h0m52.788801034s) [upload=80269]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:26:58.357724660 (77h0m52.788804791s) [upload=80269]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 22:26:58.357727095 (77h0m52.788807226s) [upload=80269]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:26:58.667015570 (77h0m53.098095701s) [upload=80269]: Done uploading segments... Aug 11 22:26:58.667034425 (77h0m53.098114556s) [upload=80269]: Upload finished. err: <nil> Duration:* 1.869568567s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [X............X..............................X....X......X...] duration: 5.971740621s FAIL (2025-08-11 22:29:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after de2609602ede5ed5bc389edbcde768f8b117316fc0253f3ff9280ad575c23e77 != before 892dca178903bc7ddc12846a33a40d0a34fdc16cfb22a5c9c7449bbd2640a3fd ======LOGS====== Aug 11 22:26:29.612708298 (77h0m24.043788429s) [upload=80262]: Starting upload Aug 11 22:26:29.612769895 (77h0m24.043850016s) [upload=80262]: Done starting upload Aug 11 22:26:29.612844999 (77h0m24.04392513s) [upload=80262]: Uploading segments... Aug 11 22:26:29.613140405 (77h0m24.044220536s) [upload=80262]: Got next segment. Inline: false Aug 11 22:26:29.613195580 (77h0m24.044275711s) [upload=80262]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:26:29.613202614 (77h0m24.044282765s) [upload=80262]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:26:30.109951250 (77h0m24.541031381s) [seg_pos={0 0}, upload=80262]: Begin upload segment... Aug 11 22:26:30.110015363 (77h0m24.541095494s) [seg_pos={0 0}, upload=80262]: Done begin upload segment. Aug 11 22:26:30.110054187 (77h0m24.541134318s) [noise=true , address=104.36.82.13:4213 , piece_id=AC7QMQJBZZCUJOPDDJQRTBLNPHMQP7T6KYQU2MVABDTZINKGEI5Q, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110059597 (77h0m24.541139728s) [noise=true , address=104.36.82.8:4977 , piece_id=CIWWKHEX5PEEW5S5M6PRJ6IMJWJJPMZDPZDWOWWSA2SSKL6QHLKQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110502866 (77h0m24.541583007s) [noise=true , address=104.36.82.61:4408 , piece_id=C6CCZOJQ4PNPM572TP73E7LDZ4YCXRPMUFN64DN4VZYRW7MOPIBA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110573330 (77h0m24.541653531s) [noise=true , address=104.36.82.47:4529 , piece_id=DFFJUBM2NNGBM5HRCAODNK7YCLB6FRIKHFEWNDC2PVTINVEKRP2A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110849519 (77h0m24.54192965s) [noise=true , address=104.36.82.21:4497 , piece_id=PWEMVGVZKB7EZS4W7CH7422JLZERI3XTPA5WNV4NC6SG2QAV4K6A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110982844 (77h0m24.542062975s) [noise=true , address=77.90.31.18:4812 , piece_id=WV6YUK4BM7PILJOE6X6ATLJNZ6Q5Q3NRVKB2WI6AQTLRDG5SDLRA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.111196312 (77h0m24.542276444s) [noise=true , address=104.36.82.18:4394 , piece_id=67UIQFUSRYODDQD7267IK6T7LI2USCMLOQ6NHAKB6R7BREEPLOZA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.111523769 (77h0m24.5426039s) [noise=true , address=64.49.13.26:4945 , piece_id=GPWOHSN2OSDZJCYACTNUP6E7X7WVOGR6DU4YFMLZK7USMJRAFAXA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.112198239 (77h0m24.54327837s) [noise=true , address=79.127.220.101:4073 , piece_id=LXWQI2DXSMXW3SV3IABAFZUMUX2OUM36KH5O2V2M6JPYYDVSVD6A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.112436215 (77h0m24.543516346s) [noise=true , address=104.36.82.16:4303 , piece_id=FUIMZ7LJCPZBYYURK4LEDD4QA7NKGT3RITWI4CQFSPUWUASXZD4A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.112710860 (77h0m24.543790991s) [noise=true , address=104.36.82.58:4282 , piece_id=LBUYWTAAZUQOURZR7J3HQFIBNLKFN3DB2O36DBY23U7SDAPRWOBQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113153237 (77h0m24.544233368s) [noise=true , address=104.36.82.59:4314 , piece_id=ZO3W4D72VA74X477LGTGDCJJKFBUMFB25DUKMWX3WZH34VZKVG2Q, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113414036 (77h0m24.544494167s) [noise=true , address=104.36.82.45:4908 , piece_id=WLO343PJNCX5EPJXOISKKGU4OWPH7Y35D5OQ4OOGYSRBP5LO7BCQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113637804 (77h0m24.544717935s) [noise=true , address=104.36.82.22:4532 , piece_id=QQXQYRXNXXGVCH74ICKDMK4N6TFSSADPEAWZUC2KAP6PPOJSPSOQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113896769 (77h0m24.54497689s) [noise=true , address=104.36.82.17:4332 , piece_id=VNG4XRM4Q6GPB75OIDJYW3POR3JRMSHUCMV42OIZJ3XJJC5SP7OQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.114104116 (77h0m24.545184247s) [noise=true , address=104.36.82.34:4545 , piece_id=FPH3U4KXKWDHKDXPSNC5KB2LTHDVBIXKSFLYA7YVXUADTI26E25A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.114718722 (77h0m24.545798853s) [noise=true , address=104.36.82.5:4860 , piece_id=MXH3B674XJ33ADRLOFJZXYJZIEQOCLQ7WDJBSWIIJU4RQMSVLSSQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.115368636 (77h0m24.546448767s) [noise=true , address=104.36.82.62:4435 , piece_id=DN4JVKBXHP6ZAOU47NK7ZRAD2T3BY2GYTWVIUFHYHYXIZJVESI6A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:31.281304078 (77h0m25.712384209s) [upload=80262]: Next returned nil segment Aug 11 22:26:31.281338404 (77h0m25.712418535s) [upload=80262]: Waiting for error group managing segments... Aug 11 22:26:31.600564253 (77h0m26.031644444s) [noise=true , address=64.49.13.26:4945 , piece_id=GPWOHSN2OSDZJCYACTNUP6E7X7WVOGR6DU4YFMLZK7USMJRAFAXA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:31.991107398 (77h0m26.422187529s) [noise=true , address=79.127.220.101:4073 , piece_id=LXWQI2DXSMXW3SV3IABAFZUMUX2OUM36KH5O2V2M6JPYYDVSVD6A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.071078223 (77h0m26.502158354s) [noise=true , address=104.36.82.58:4282 , piece_id=LBUYWTAAZUQOURZR7J3HQFIBNLKFN3DB2O36DBY23U7SDAPRWOBQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.115562588 (77h0m26.546642719s) [noise=true , address=104.36.82.45:4908 , piece_id=WLO343PJNCX5EPJXOISKKGU4OWPH7Y35D5OQ4OOGYSRBP5LO7BCQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.130410037 (77h0m26.561490168s) [noise=true , address=104.36.82.17:4332 , piece_id=VNG4XRM4Q6GPB75OIDJYW3POR3JRMSHUCMV42OIZJ3XJJC5SP7OQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.131124754 (77h0m26.562204885s) [noise=true , address=104.36.82.21:4497 , piece_id=PWEMVGVZKB7EZS4W7CH7422JLZERI3XTPA5WNV4NC6SG2QAV4K6A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.180906606 (77h0m26.611986737s) [noise=true , address=104.36.82.47:4529 , piece_id=DFFJUBM2NNGBM5HRCAODNK7YCLB6FRIKHFEWNDC2PVTINVEKRP2A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.227616279 (77h0m26.6586964s) [noise=true , address=104.36.82.16:4303 , piece_id=FUIMZ7LJCPZBYYURK4LEDD4QA7NKGT3RITWI4CQFSPUWUASXZD4A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.228268337 (77h0m26.659348458s) [noise=true , address=77.90.31.18:4812 , piece_id=WV6YUK4BM7PILJOE6X6ATLJNZ6Q5Q3NRVKB2WI6AQTLRDG5SDLRA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.239880475 (77h0m26.670960606s) [noise=true , address=104.36.82.22:4532 , piece_id=QQXQYRXNXXGVCH74ICKDMK4N6TFSSADPEAWZUC2KAP6PPOJSPSOQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.241576581 (77h0m26.672656712s) [noise=true , address=104.36.82.62:4435 , piece_id=DN4JVKBXHP6ZAOU47NK7ZRAD2T3BY2GYTWVIUFHYHYXIZJVESI6A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.263864415 (77h0m26.694944546s) [noise=true , address=104.36.82.59:4314 , piece_id=ZO3W4D72VA74X477LGTGDCJJKFBUMFB25DUKMWX3WZH34VZKVG2Q, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.267293096 (77h0m26.698373227s) [noise=true , address=104.36.82.5:4860 , piece_id=MXH3B674XJ33ADRLOFJZXYJZIEQOCLQ7WDJBSWIIJU4RQMSVLSSQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.304902507 (77h0m26.735982638s) [noise=true , address=104.36.82.61:4408 , piece_id=C6CCZOJQ4PNPM572TP73E7LDZ4YCXRPMUFN64DN4VZYRW7MOPIBA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.304923146 (77h0m26.736003277s) [seg_pos={0 0}, upload=80262]: Segment reached optimal threshold of 14 pieces. Aug 11 22:26:32.305050350 (77h0m26.736130481s) [noise=true , address=104.36.82.34:4545 , piece_id=FPH3U4KXKWDHKDXPSNC5KB2LTHDVBIXKSFLYA7YVXUADTI26E25A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra): protocol: expected piece hash; context canceled; EOF Aug 11 22:26:32.305105094 (77h0m26.736185225s) [noise=true , address=104.36.82.18:4394 , piece_id=67UIQFUSRYODDQD7267IK6T7LI2USCMLOQ6NHAKB6R7BREEPLOZA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q6GgLmLeGugk1rQu21KNV2pEjXTmgAfiYcV45ibvDixBW41K2): protocol: expected piece hash; context canceled; EOF Aug 11 22:26:32.305485442 (77h0m26.736565573s) [noise=true , address=104.36.82.8:4977 , piece_id=CIWWKHEX5PEEW5S5M6PRJ6IMJWJJPMZDPZDWOWWSA2SSKL6QHLKQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCAm12tXwimFSPqz7Seh6A4oxWqQVxqsF459xux4a5CqjpbAT): protocol: read tcp 188.166.225.170:46648->104.36.82.8:4977: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 22:26:32.305518896 (77h0m26.736599027s) [noise=true , address=104.36.82.13:4213 , piece_id=AC7QMQJBZZCUJOPDDJQRTBLNPHMQP7T6KYQU2MVABDTZINKGEI5Q, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDcAySWNCL7XoStP5GKzAksN1kTs9L8u4KStgyaiQn3AvLcRM): protocol: read tcp 188.166.225.170:56468->104.36.82.13:4213: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 22:26:32.305543643 (77h0m26.736623774s) [seg_pos={0 0}, upload=80262]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:26:32.305611663 (77h0m26.736691794s) [upload=80262]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:26:32.305615842 (77h0m26.736695973s) [upload=80262]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:26:32.608068006 (77h0m27.039148137s) [upload=80262]: Done uploading segments... Aug 11 22:26:32.608087844 (77h0m27.039167975s) [upload=80262]: Upload finished. err: <nil> Duration: 5.971768475s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...................................X.X...................X..] duration: 1.902800934s FAIL (2025-08-11 22:28:45 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 22:26:58.357568431 (77h0m52.788648562s) [upload=80269]: Starting upload Aug 11 22:26:58.357612295 (77h0m52.788692426s) [upload=80269]: Done starting upload Aug 11 22:26:58.357654996 (77h0m52.788735128s) [upload=80269]: Uploading segments... Aug 11 22:26:58.357686247 (77h0m52.788766368s) [upload=80269]: Got next segment. Inline: true Aug 11 22:26:58.357689654 (77h0m52.788769785s) [upload=80269]: Waiting for error group managing segments... Aug 11 22:26:58.357720903 (77h0m52.788801034s) [upload=80269]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:26:58.357724660 (77h0m52.788804791s) [upload=80269]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 22:26:58.357727095 (77h0m52.788807226s) [upload=80269]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:26:58.667015570 (77h0m53.098095701s) [upload=80269]: Done uploading segments... Aug 11 22:26:58.667034425 (77h0m53.098114556s) [upload=80269]: Upload finished. err: <nil> Duration:* 1.902827315s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [.X............X..............................X....X......X..] duration: 7.247376509s FAIL (2025-08-11 22:28:10 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after de2609602ede5ed5bc389edbcde768f8b117316fc0253f3ff9280ad575c23e77 != before 892dca178903bc7ddc12846a33a40d0a34fdc16cfb22a5c9c7449bbd2640a3fd ======LOGS====== Aug 11 22:26:29.612708298 (77h0m24.043788429s) [upload=80262]: Starting upload Aug 11 22:26:29.612769895 (77h0m24.043850016s) [upload=80262]: Done starting upload Aug 11 22:26:29.612844999 (77h0m24.04392513s) [upload=80262]: Uploading segments... Aug 11 22:26:29.613140405 (77h0m24.044220536s) [upload=80262]: Got next segment. Inline: false Aug 11 22:26:29.613195580 (77h0m24.044275711s) [upload=80262]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:26:29.613202614 (77h0m24.044282765s) [upload=80262]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:26:30.109951250 (77h0m24.541031381s) [seg_pos={0 0}, upload=80262]: Begin upload segment... Aug 11 22:26:30.110015363 (77h0m24.541095494s) [seg_pos={0 0}, upload=80262]: Done begin upload segment. Aug 11 22:26:30.110054187 (77h0m24.541134318s) [noise=true , address=104.36.82.13:4213 , piece_id=AC7QMQJBZZCUJOPDDJQRTBLNPHMQP7T6KYQU2MVABDTZINKGEI5Q, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110059597 (77h0m24.541139728s) [noise=true , address=104.36.82.8:4977 , piece_id=CIWWKHEX5PEEW5S5M6PRJ6IMJWJJPMZDPZDWOWWSA2SSKL6QHLKQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110502866 (77h0m24.541583007s) [noise=true , address=104.36.82.61:4408 , piece_id=C6CCZOJQ4PNPM572TP73E7LDZ4YCXRPMUFN64DN4VZYRW7MOPIBA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110573330 (77h0m24.541653531s) [noise=true , address=104.36.82.47:4529 , piece_id=DFFJUBM2NNGBM5HRCAODNK7YCLB6FRIKHFEWNDC2PVTINVEKRP2A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110849519 (77h0m24.54192965s) [noise=true , address=104.36.82.21:4497 , piece_id=PWEMVGVZKB7EZS4W7CH7422JLZERI3XTPA5WNV4NC6SG2QAV4K6A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110982844 (77h0m24.542062975s) [noise=true , address=77.90.31.18:4812 , piece_id=WV6YUK4BM7PILJOE6X6ATLJNZ6Q5Q3NRVKB2WI6AQTLRDG5SDLRA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.111196312 (77h0m24.542276444s) [noise=true , address=104.36.82.18:4394 , piece_id=67UIQFUSRYODDQD7267IK6T7LI2USCMLOQ6NHAKB6R7BREEPLOZA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.111523769 (77h0m24.5426039s) [noise=true , address=64.49.13.26:4945 , piece_id=GPWOHSN2OSDZJCYACTNUP6E7X7WVOGR6DU4YFMLZK7USMJRAFAXA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.112198239 (77h0m24.54327837s) [noise=true , address=79.127.220.101:4073 , piece_id=LXWQI2DXSMXW3SV3IABAFZUMUX2OUM36KH5O2V2M6JPYYDVSVD6A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.112436215 (77h0m24.543516346s) [noise=true , address=104.36.82.16:4303 , piece_id=FUIMZ7LJCPZBYYURK4LEDD4QA7NKGT3RITWI4CQFSPUWUASXZD4A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.112710860 (77h0m24.543790991s) [noise=true , address=104.36.82.58:4282 , piece_id=LBUYWTAAZUQOURZR7J3HQFIBNLKFN3DB2O36DBY23U7SDAPRWOBQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113153237 (77h0m24.544233368s) [noise=true , address=104.36.82.59:4314 , piece_id=ZO3W4D72VA74X477LGTGDCJJKFBUMFB25DUKMWX3WZH34VZKVG2Q, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113414036 (77h0m24.544494167s) [noise=true , address=104.36.82.45:4908 , piece_id=WLO343PJNCX5EPJXOISKKGU4OWPH7Y35D5OQ4OOGYSRBP5LO7BCQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113637804 (77h0m24.544717935s) [noise=true , address=104.36.82.22:4532 , piece_id=QQXQYRXNXXGVCH74ICKDMK4N6TFSSADPEAWZUC2KAP6PPOJSPSOQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113896769 (77h0m24.54497689s) [noise=true , address=104.36.82.17:4332 , piece_id=VNG4XRM4Q6GPB75OIDJYW3POR3JRMSHUCMV42OIZJ3XJJC5SP7OQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.114104116 (77h0m24.545184247s) [noise=true , address=104.36.82.34:4545 , piece_id=FPH3U4KXKWDHKDXPSNC5KB2LTHDVBIXKSFLYA7YVXUADTI26E25A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.114718722 (77h0m24.545798853s) [noise=true , address=104.36.82.5:4860 , piece_id=MXH3B674XJ33ADRLOFJZXYJZIEQOCLQ7WDJBSWIIJU4RQMSVLSSQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.115368636 (77h0m24.546448767s) [noise=true , address=104.36.82.62:4435 , piece_id=DN4JVKBXHP6ZAOU47NK7ZRAD2T3BY2GYTWVIUFHYHYXIZJVESI6A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:31.281304078 (77h0m25.712384209s) [upload=80262]: Next returned nil segment Aug 11 22:26:31.281338404 (77h0m25.712418535s) [upload=80262]: Waiting for error group managing segments... Aug 11 22:26:31.600564253 (77h0m26.031644444s) [noise=true , address=64.49.13.26:4945 , piece_id=GPWOHSN2OSDZJCYACTNUP6E7X7WVOGR6DU4YFMLZK7USMJRAFAXA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:31.991107398 (77h0m26.422187529s) [noise=true , address=79.127.220.101:4073 , piece_id=LXWQI2DXSMXW3SV3IABAFZUMUX2OUM36KH5O2V2M6JPYYDVSVD6A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.071078223 (77h0m26.502158354s) [noise=true , address=104.36.82.58:4282 , piece_id=LBUYWTAAZUQOURZR7J3HQFIBNLKFN3DB2O36DBY23U7SDAPRWOBQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.115562588 (77h0m26.546642719s) [noise=true , address=104.36.82.45:4908 , piece_id=WLO343PJNCX5EPJXOISKKGU4OWPH7Y35D5OQ4OOGYSRBP5LO7BCQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.130410037 (77h0m26.561490168s) [noise=true , address=104.36.82.17:4332 , piece_id=VNG4XRM4Q6GPB75OIDJYW3POR3JRMSHUCMV42OIZJ3XJJC5SP7OQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.131124754 (77h0m26.562204885s) [noise=true , address=104.36.82.21:4497 , piece_id=PWEMVGVZKB7EZS4W7CH7422JLZERI3XTPA5WNV4NC6SG2QAV4K6A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.180906606 (77h0m26.611986737s) [noise=true , address=104.36.82.47:4529 , piece_id=DFFJUBM2NNGBM5HRCAODNK7YCLB6FRIKHFEWNDC2PVTINVEKRP2A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.227616279 (77h0m26.6586964s) [noise=true , address=104.36.82.16:4303 , piece_id=FUIMZ7LJCPZBYYURK4LEDD4QA7NKGT3RITWI4CQFSPUWUASXZD4A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.228268337 (77h0m26.659348458s) [noise=true , address=77.90.31.18:4812 , piece_id=WV6YUK4BM7PILJOE6X6ATLJNZ6Q5Q3NRVKB2WI6AQTLRDG5SDLRA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.239880475 (77h0m26.670960606s) [noise=true , address=104.36.82.22:4532 , piece_id=QQXQYRXNXXGVCH74ICKDMK4N6TFSSADPEAWZUC2KAP6PPOJSPSOQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.241576581 (77h0m26.672656712s) [noise=true , address=104.36.82.62:4435 , piece_id=DN4JVKBXHP6ZAOU47NK7ZRAD2T3BY2GYTWVIUFHYHYXIZJVESI6A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.263864415 (77h0m26.694944546s) [noise=true , address=104.36.82.59:4314 , piece_id=ZO3W4D72VA74X477LGTGDCJJKFBUMFB25DUKMWX3WZH34VZKVG2Q, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.267293096 (77h0m26.698373227s) [noise=true , address=104.36.82.5:4860 , piece_id=MXH3B674XJ33ADRLOFJZXYJZIEQOCLQ7WDJBSWIIJU4RQMSVLSSQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.304902507 (77h0m26.735982638s) [noise=true , address=104.36.82.61:4408 , piece_id=C6CCZOJQ4PNPM572TP73E7LDZ4YCXRPMUFN64DN4VZYRW7MOPIBA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.304923146 (77h0m26.736003277s) [seg_pos={0 0}, upload=80262]: Segment reached optimal threshold of 14 pieces. Aug 11 22:26:32.305050350 (77h0m26.736130481s) [noise=true , address=104.36.82.34:4545 , piece_id=FPH3U4KXKWDHKDXPSNC5KB2LTHDVBIXKSFLYA7YVXUADTI26E25A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra): protocol: expected piece hash; context canceled; EOF Aug 11 22:26:32.305105094 (77h0m26.736185225s) [noise=true , address=104.36.82.18:4394 , piece_id=67UIQFUSRYODDQD7267IK6T7LI2USCMLOQ6NHAKB6R7BREEPLOZA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q6GgLmLeGugk1rQu21KNV2pEjXTmgAfiYcV45ibvDixBW41K2): protocol: expected piece hash; context canceled; EOF Aug 11 22:26:32.305485442 (77h0m26.736565573s) [noise=true , address=104.36.82.8:4977 , piece_id=CIWWKHEX5PEEW5S5M6PRJ6IMJWJJPMZDPZDWOWWSA2SSKL6QHLKQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCAm12tXwimFSPqz7Seh6A4oxWqQVxqsF459xux4a5CqjpbAT): protocol: read tcp 188.166.225.170:46648->104.36.82.8:4977: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 22:26:32.305518896 (77h0m26.736599027s) [noise=true , address=104.36.82.13:4213 , piece_id=AC7QMQJBZZCUJOPDDJQRTBLNPHMQP7T6KYQU2MVABDTZINKGEI5Q, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDcAySWNCL7XoStP5GKzAksN1kTs9L8u4KStgyaiQn3AvLcRM): protocol: read tcp 188.166.225.170:56468->104.36.82.13:4213: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 22:26:32.305543643 (77h0m26.736623774s) [seg_pos={0 0}, upload=80262]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:26:32.305611663 (77h0m26.736691794s) [upload=80262]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:26:32.305615842 (77h0m26.736695973s) [upload=80262]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:26:32.608068006 (77h0m27.039148137s) [upload=80262]: Done uploading segments... Aug 11 22:26:32.608087844 (77h0m27.039167975s) [upload=80262]: Upload finished. err: <nil> Duration: 7.247400676s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....................................X.X...................X.] duration: 1.859670861s FAIL (2025-08-11 22:27:52 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 22:26:58.357568431 (77h0m52.788648562s) [upload=80269]: Starting upload Aug 11 22:26:58.357612295 (77h0m52.788692426s) [upload=80269]: Done starting upload Aug 11 22:26:58.357654996 (77h0m52.788735128s) [upload=80269]: Uploading segments... Aug 11 22:26:58.357686247 (77h0m52.788766368s) [upload=80269]: Got next segment. Inline: true Aug 11 22:26:58.357689654 (77h0m52.788769785s) [upload=80269]: Waiting for error group managing segments... Aug 11 22:26:58.357720903 (77h0m52.788801034s) [upload=80269]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:26:58.357724660 (77h0m52.788804791s) [upload=80269]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 22:26:58.357727095 (77h0m52.788807226s) [upload=80269]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:26:58.667015570 (77h0m53.098095701s) [upload=80269]: Done uploading segments... Aug 11 22:26:58.667034425 (77h0m53.098114556s) [upload=80269]: Upload finished. err: <nil> Duration:* 1.8596968s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [..X............X..............................X....X......X.] duration: 6.059150025s FAIL (2025-08-11 22:27:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after de2609602ede5ed5bc389edbcde768f8b117316fc0253f3ff9280ad575c23e77 != before 892dca178903bc7ddc12846a33a40d0a34fdc16cfb22a5c9c7449bbd2640a3fd ======LOGS====== Aug 11 22:26:29.612708298 (77h0m24.043788429s) [upload=80262]: Starting upload Aug 11 22:26:29.612769895 (77h0m24.043850016s) [upload=80262]: Done starting upload Aug 11 22:26:29.612844999 (77h0m24.04392513s) [upload=80262]: Uploading segments... Aug 11 22:26:29.613140405 (77h0m24.044220536s) [upload=80262]: Got next segment. Inline: false Aug 11 22:26:29.613195580 (77h0m24.044275711s) [upload=80262]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:26:29.613202614 (77h0m24.044282765s) [upload=80262]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:26:30.109951250 (77h0m24.541031381s) [seg_pos={0 0}, upload=80262]: Begin upload segment... Aug 11 22:26:30.110015363 (77h0m24.541095494s) [seg_pos={0 0}, upload=80262]: Done begin upload segment. Aug 11 22:26:30.110054187 (77h0m24.541134318s) [noise=true , address=104.36.82.13:4213 , piece_id=AC7QMQJBZZCUJOPDDJQRTBLNPHMQP7T6KYQU2MVABDTZINKGEI5Q, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110059597 (77h0m24.541139728s) [noise=true , address=104.36.82.8:4977 , piece_id=CIWWKHEX5PEEW5S5M6PRJ6IMJWJJPMZDPZDWOWWSA2SSKL6QHLKQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110502866 (77h0m24.541583007s) [noise=true , address=104.36.82.61:4408 , piece_id=C6CCZOJQ4PNPM572TP73E7LDZ4YCXRPMUFN64DN4VZYRW7MOPIBA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110573330 (77h0m24.541653531s) [noise=true , address=104.36.82.47:4529 , piece_id=DFFJUBM2NNGBM5HRCAODNK7YCLB6FRIKHFEWNDC2PVTINVEKRP2A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110849519 (77h0m24.54192965s) [noise=true , address=104.36.82.21:4497 , piece_id=PWEMVGVZKB7EZS4W7CH7422JLZERI3XTPA5WNV4NC6SG2QAV4K6A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110982844 (77h0m24.542062975s) [noise=true , address=77.90.31.18:4812 , piece_id=WV6YUK4BM7PILJOE6X6ATLJNZ6Q5Q3NRVKB2WI6AQTLRDG5SDLRA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.111196312 (77h0m24.542276444s) [noise=true , address=104.36.82.18:4394 , piece_id=67UIQFUSRYODDQD7267IK6T7LI2USCMLOQ6NHAKB6R7BREEPLOZA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.111523769 (77h0m24.5426039s) [noise=true , address=64.49.13.26:4945 , piece_id=GPWOHSN2OSDZJCYACTNUP6E7X7WVOGR6DU4YFMLZK7USMJRAFAXA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.112198239 (77h0m24.54327837s) [noise=true , address=79.127.220.101:4073 , piece_id=LXWQI2DXSMXW3SV3IABAFZUMUX2OUM36KH5O2V2M6JPYYDVSVD6A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.112436215 (77h0m24.543516346s) [noise=true , address=104.36.82.16:4303 , piece_id=FUIMZ7LJCPZBYYURK4LEDD4QA7NKGT3RITWI4CQFSPUWUASXZD4A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.112710860 (77h0m24.543790991s) [noise=true , address=104.36.82.58:4282 , piece_id=LBUYWTAAZUQOURZR7J3HQFIBNLKFN3DB2O36DBY23U7SDAPRWOBQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113153237 (77h0m24.544233368s) [noise=true , address=104.36.82.59:4314 , piece_id=ZO3W4D72VA74X477LGTGDCJJKFBUMFB25DUKMWX3WZH34VZKVG2Q, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113414036 (77h0m24.544494167s) [noise=true , address=104.36.82.45:4908 , piece_id=WLO343PJNCX5EPJXOISKKGU4OWPH7Y35D5OQ4OOGYSRBP5LO7BCQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113637804 (77h0m24.544717935s) [noise=true , address=104.36.82.22:4532 , piece_id=QQXQYRXNXXGVCH74ICKDMK4N6TFSSADPEAWZUC2KAP6PPOJSPSOQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113896769 (77h0m24.54497689s) [noise=true , address=104.36.82.17:4332 , piece_id=VNG4XRM4Q6GPB75OIDJYW3POR3JRMSHUCMV42OIZJ3XJJC5SP7OQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.114104116 (77h0m24.545184247s) [noise=true , address=104.36.82.34:4545 , piece_id=FPH3U4KXKWDHKDXPSNC5KB2LTHDVBIXKSFLYA7YVXUADTI26E25A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.114718722 (77h0m24.545798853s) [noise=true , address=104.36.82.5:4860 , piece_id=MXH3B674XJ33ADRLOFJZXYJZIEQOCLQ7WDJBSWIIJU4RQMSVLSSQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.115368636 (77h0m24.546448767s) [noise=true , address=104.36.82.62:4435 , piece_id=DN4JVKBXHP6ZAOU47NK7ZRAD2T3BY2GYTWVIUFHYHYXIZJVESI6A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:31.281304078 (77h0m25.712384209s) [upload=80262]: Next returned nil segment Aug 11 22:26:31.281338404 (77h0m25.712418535s) [upload=80262]: Waiting for error group managing segments... Aug 11 22:26:31.600564253 (77h0m26.031644444s) [noise=true , address=64.49.13.26:4945 , piece_id=GPWOHSN2OSDZJCYACTNUP6E7X7WVOGR6DU4YFMLZK7USMJRAFAXA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:31.991107398 (77h0m26.422187529s) [noise=true , address=79.127.220.101:4073 , piece_id=LXWQI2DXSMXW3SV3IABAFZUMUX2OUM36KH5O2V2M6JPYYDVSVD6A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.071078223 (77h0m26.502158354s) [noise=true , address=104.36.82.58:4282 , piece_id=LBUYWTAAZUQOURZR7J3HQFIBNLKFN3DB2O36DBY23U7SDAPRWOBQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.115562588 (77h0m26.546642719s) [noise=true , address=104.36.82.45:4908 , piece_id=WLO343PJNCX5EPJXOISKKGU4OWPH7Y35D5OQ4OOGYSRBP5LO7BCQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.130410037 (77h0m26.561490168s) [noise=true , address=104.36.82.17:4332 , piece_id=VNG4XRM4Q6GPB75OIDJYW3POR3JRMSHUCMV42OIZJ3XJJC5SP7OQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.131124754 (77h0m26.562204885s) [noise=true , address=104.36.82.21:4497 , piece_id=PWEMVGVZKB7EZS4W7CH7422JLZERI3XTPA5WNV4NC6SG2QAV4K6A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.180906606 (77h0m26.611986737s) [noise=true , address=104.36.82.47:4529 , piece_id=DFFJUBM2NNGBM5HRCAODNK7YCLB6FRIKHFEWNDC2PVTINVEKRP2A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.227616279 (77h0m26.6586964s) [noise=true , address=104.36.82.16:4303 , piece_id=FUIMZ7LJCPZBYYURK4LEDD4QA7NKGT3RITWI4CQFSPUWUASXZD4A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.228268337 (77h0m26.659348458s) [noise=true , address=77.90.31.18:4812 , piece_id=WV6YUK4BM7PILJOE6X6ATLJNZ6Q5Q3NRVKB2WI6AQTLRDG5SDLRA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.239880475 (77h0m26.670960606s) [noise=true , address=104.36.82.22:4532 , piece_id=QQXQYRXNXXGVCH74ICKDMK4N6TFSSADPEAWZUC2KAP6PPOJSPSOQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.241576581 (77h0m26.672656712s) [noise=true , address=104.36.82.62:4435 , piece_id=DN4JVKBXHP6ZAOU47NK7ZRAD2T3BY2GYTWVIUFHYHYXIZJVESI6A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.263864415 (77h0m26.694944546s) [noise=true , address=104.36.82.59:4314 , piece_id=ZO3W4D72VA74X477LGTGDCJJKFBUMFB25DUKMWX3WZH34VZKVG2Q, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.267293096 (77h0m26.698373227s) [noise=true , address=104.36.82.5:4860 , piece_id=MXH3B674XJ33ADRLOFJZXYJZIEQOCLQ7WDJBSWIIJU4RQMSVLSSQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.304902507 (77h0m26.735982638s) [noise=true , address=104.36.82.61:4408 , piece_id=C6CCZOJQ4PNPM572TP73E7LDZ4YCXRPMUFN64DN4VZYRW7MOPIBA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.304923146 (77h0m26.736003277s) [seg_pos={0 0}, upload=80262]: Segment reached optimal threshold of 14 pieces. Aug 11 22:26:32.305050350 (77h0m26.736130481s) [noise=true , address=104.36.82.34:4545 , piece_id=FPH3U4KXKWDHKDXPSNC5KB2LTHDVBIXKSFLYA7YVXUADTI26E25A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra): protocol: expected piece hash; context canceled; EOF Aug 11 22:26:32.305105094 (77h0m26.736185225s) [noise=true , address=104.36.82.18:4394 , piece_id=67UIQFUSRYODDQD7267IK6T7LI2USCMLOQ6NHAKB6R7BREEPLOZA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q6GgLmLeGugk1rQu21KNV2pEjXTmgAfiYcV45ibvDixBW41K2): protocol: expected piece hash; context canceled; EOF Aug 11 22:26:32.305485442 (77h0m26.736565573s) [noise=true , address=104.36.82.8:4977 , piece_id=CIWWKHEX5PEEW5S5M6PRJ6IMJWJJPMZDPZDWOWWSA2SSKL6QHLKQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCAm12tXwimFSPqz7Seh6A4oxWqQVxqsF459xux4a5CqjpbAT): protocol: read tcp 188.166.225.170:46648->104.36.82.8:4977: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 22:26:32.305518896 (77h0m26.736599027s) [noise=true , address=104.36.82.13:4213 , piece_id=AC7QMQJBZZCUJOPDDJQRTBLNPHMQP7T6KYQU2MVABDTZINKGEI5Q, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDcAySWNCL7XoStP5GKzAksN1kTs9L8u4KStgyaiQn3AvLcRM): protocol: read tcp 188.166.225.170:56468->104.36.82.13:4213: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 22:26:32.305543643 (77h0m26.736623774s) [seg_pos={0 0}, upload=80262]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:26:32.305611663 (77h0m26.736691794s) [upload=80262]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:26:32.305615842 (77h0m26.736695973s) [upload=80262]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:26:32.608068006 (77h0m27.039148137s) [upload=80262]: Done uploading segments... Aug 11 22:26:32.608087844 (77h0m27.039167975s) [upload=80262]: Upload finished. err: <nil> Duration: 6.059174103s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....................................X.X...................X] duration: 1.413334249s FAIL (2025-08-11 22:26:59 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 11 22:26:58.357568431 (77h0m52.788648562s) [upload=80269]: Starting upload Aug 11 22:26:58.357612295 (77h0m52.788692426s) [upload=80269]: Done starting upload Aug 11 22:26:58.357654996 (77h0m52.788735128s) [upload=80269]: Uploading segments... Aug 11 22:26:58.357686247 (77h0m52.788766368s) [upload=80269]: Got next segment. Inline: true Aug 11 22:26:58.357689654 (77h0m52.788769785s) [upload=80269]: Waiting for error group managing segments... Aug 11 22:26:58.357720903 (77h0m52.788801034s) [upload=80269]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:26:58.357724660 (77h0m52.788804791s) [upload=80269]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 22:26:58.357727095 (77h0m52.788807226s) [upload=80269]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:26:58.667015570 (77h0m53.098095701s) [upload=80269]: Done uploading segments... Aug 11 22:26:58.667034425 (77h0m53.098114556s) [upload=80269]: Upload finished. err: <nil> Duration:* 1.413355008s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 5 out of 60 is failed (threshold=3) [...X............X..............................X....X......X] duration: 5.944760529s FAIL (2025-08-11 22:26:34 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after de2609602ede5ed5bc389edbcde768f8b117316fc0253f3ff9280ad575c23e77 != before 892dca178903bc7ddc12846a33a40d0a34fdc16cfb22a5c9c7449bbd2640a3fd ======LOGS====== Aug 11 22:26:29.612708298 (77h0m24.043788429s) [upload=80262]: Starting upload Aug 11 22:26:29.612769895 (77h0m24.043850016s) [upload=80262]: Done starting upload Aug 11 22:26:29.612844999 (77h0m24.04392513s) [upload=80262]: Uploading segments... Aug 11 22:26:29.613140405 (77h0m24.044220536s) [upload=80262]: Got next segment. Inline: false Aug 11 22:26:29.613195580 (77h0m24.044275711s) [upload=80262]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:26:29.613202614 (77h0m24.044282765s) [upload=80262]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:26:30.109951250 (77h0m24.541031381s) [seg_pos={0 0}, upload=80262]: Begin upload segment... Aug 11 22:26:30.110015363 (77h0m24.541095494s) [seg_pos={0 0}, upload=80262]: Done begin upload segment. Aug 11 22:26:30.110054187 (77h0m24.541134318s) [noise=true , address=104.36.82.13:4213 , piece_id=AC7QMQJBZZCUJOPDDJQRTBLNPHMQP7T6KYQU2MVABDTZINKGEI5Q, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110059597 (77h0m24.541139728s) [noise=true , address=104.36.82.8:4977 , piece_id=CIWWKHEX5PEEW5S5M6PRJ6IMJWJJPMZDPZDWOWWSA2SSKL6QHLKQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110502866 (77h0m24.541583007s) [noise=true , address=104.36.82.61:4408 , piece_id=C6CCZOJQ4PNPM572TP73E7LDZ4YCXRPMUFN64DN4VZYRW7MOPIBA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110573330 (77h0m24.541653531s) [noise=true , address=104.36.82.47:4529 , piece_id=DFFJUBM2NNGBM5HRCAODNK7YCLB6FRIKHFEWNDC2PVTINVEKRP2A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110849519 (77h0m24.54192965s) [noise=true , address=104.36.82.21:4497 , piece_id=PWEMVGVZKB7EZS4W7CH7422JLZERI3XTPA5WNV4NC6SG2QAV4K6A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.110982844 (77h0m24.542062975s) [noise=true , address=77.90.31.18:4812 , piece_id=WV6YUK4BM7PILJOE6X6ATLJNZ6Q5Q3NRVKB2WI6AQTLRDG5SDLRA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.111196312 (77h0m24.542276444s) [noise=true , address=104.36.82.18:4394 , piece_id=67UIQFUSRYODDQD7267IK6T7LI2USCMLOQ6NHAKB6R7BREEPLOZA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.111523769 (77h0m24.5426039s) [noise=true , address=64.49.13.26:4945 , piece_id=GPWOHSN2OSDZJCYACTNUP6E7X7WVOGR6DU4YFMLZK7USMJRAFAXA, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.112198239 (77h0m24.54327837s) [noise=true , address=79.127.220.101:4073 , piece_id=LXWQI2DXSMXW3SV3IABAFZUMUX2OUM36KH5O2V2M6JPYYDVSVD6A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.112436215 (77h0m24.543516346s) [noise=true , address=104.36.82.16:4303 , piece_id=FUIMZ7LJCPZBYYURK4LEDD4QA7NKGT3RITWI4CQFSPUWUASXZD4A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.112710860 (77h0m24.543790991s) [noise=true , address=104.36.82.58:4282 , piece_id=LBUYWTAAZUQOURZR7J3HQFIBNLKFN3DB2O36DBY23U7SDAPRWOBQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113153237 (77h0m24.544233368s) [noise=true , address=104.36.82.59:4314 , piece_id=ZO3W4D72VA74X477LGTGDCJJKFBUMFB25DUKMWX3WZH34VZKVG2Q, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113414036 (77h0m24.544494167s) [noise=true , address=104.36.82.45:4908 , piece_id=WLO343PJNCX5EPJXOISKKGU4OWPH7Y35D5OQ4OOGYSRBP5LO7BCQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113637804 (77h0m24.544717935s) [noise=true , address=104.36.82.22:4532 , piece_id=QQXQYRXNXXGVCH74ICKDMK4N6TFSSADPEAWZUC2KAP6PPOJSPSOQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.113896769 (77h0m24.54497689s) [noise=true , address=104.36.82.17:4332 , piece_id=VNG4XRM4Q6GPB75OIDJYW3POR3JRMSHUCMV42OIZJ3XJJC5SP7OQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.114104116 (77h0m24.545184247s) [noise=true , address=104.36.82.34:4545 , piece_id=FPH3U4KXKWDHKDXPSNC5KB2LTHDVBIXKSFLYA7YVXUADTI26E25A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.114718722 (77h0m24.545798853s) [noise=true , address=104.36.82.5:4860 , piece_id=MXH3B674XJ33ADRLOFJZXYJZIEQOCLQ7WDJBSWIIJU4RQMSVLSSQ, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:30.115368636 (77h0m24.546448767s) [noise=true , address=104.36.82.62:4435 , piece_id=DN4JVKBXHP6ZAOU47NK7ZRAD2T3BY2GYTWVIUFHYHYXIZJVESI6A, seg_pos={0 0}, upload=80262]: Uploading piece... Aug 11 22:26:31.281304078 (77h0m25.712384209s) [upload=80262]: Next returned nil segment Aug 11 22:26:31.281338404 (77h0m25.712418535s) [upload=80262]: Waiting for error group managing segments... Aug 11 22:26:31.600564253 (77h0m26.031644444s) [noise=true , address=64.49.13.26:4945 , piece_id=GPWOHSN2OSDZJCYACTNUP6E7X7WVOGR6DU4YFMLZK7USMJRAFAXA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:31.991107398 (77h0m26.422187529s) [noise=true , address=79.127.220.101:4073 , piece_id=LXWQI2DXSMXW3SV3IABAFZUMUX2OUM36KH5O2V2M6JPYYDVSVD6A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.071078223 (77h0m26.502158354s) [noise=true , address=104.36.82.58:4282 , piece_id=LBUYWTAAZUQOURZR7J3HQFIBNLKFN3DB2O36DBY23U7SDAPRWOBQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.115562588 (77h0m26.546642719s) [noise=true , address=104.36.82.45:4908 , piece_id=WLO343PJNCX5EPJXOISKKGU4OWPH7Y35D5OQ4OOGYSRBP5LO7BCQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.130410037 (77h0m26.561490168s) [noise=true , address=104.36.82.17:4332 , piece_id=VNG4XRM4Q6GPB75OIDJYW3POR3JRMSHUCMV42OIZJ3XJJC5SP7OQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.131124754 (77h0m26.562204885s) [noise=true , address=104.36.82.21:4497 , piece_id=PWEMVGVZKB7EZS4W7CH7422JLZERI3XTPA5WNV4NC6SG2QAV4K6A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.180906606 (77h0m26.611986737s) [noise=true , address=104.36.82.47:4529 , piece_id=DFFJUBM2NNGBM5HRCAODNK7YCLB6FRIKHFEWNDC2PVTINVEKRP2A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.227616279 (77h0m26.6586964s) [noise=true , address=104.36.82.16:4303 , piece_id=FUIMZ7LJCPZBYYURK4LEDD4QA7NKGT3RITWI4CQFSPUWUASXZD4A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.228268337 (77h0m26.659348458s) [noise=true , address=77.90.31.18:4812 , piece_id=WV6YUK4BM7PILJOE6X6ATLJNZ6Q5Q3NRVKB2WI6AQTLRDG5SDLRA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.239880475 (77h0m26.670960606s) [noise=true , address=104.36.82.22:4532 , piece_id=QQXQYRXNXXGVCH74ICKDMK4N6TFSSADPEAWZUC2KAP6PPOJSPSOQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.241576581 (77h0m26.672656712s) [noise=true , address=104.36.82.62:4435 , piece_id=DN4JVKBXHP6ZAOU47NK7ZRAD2T3BY2GYTWVIUFHYHYXIZJVESI6A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.263864415 (77h0m26.694944546s) [noise=true , address=104.36.82.59:4314 , piece_id=ZO3W4D72VA74X477LGTGDCJJKFBUMFB25DUKMWX3WZH34VZKVG2Q, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.267293096 (77h0m26.698373227s) [noise=true , address=104.36.82.5:4860 , piece_id=MXH3B674XJ33ADRLOFJZXYJZIEQOCLQ7WDJBSWIIJU4RQMSVLSSQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.304902507 (77h0m26.735982638s) [noise=true , address=104.36.82.61:4408 , piece_id=C6CCZOJQ4PNPM572TP73E7LDZ4YCXRPMUFN64DN4VZYRW7MOPIBA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: <nil> Aug 11 22:26:32.304923146 (77h0m26.736003277s) [seg_pos={0 0}, upload=80262]: Segment reached optimal threshold of 14 pieces. Aug 11 22:26:32.305050350 (77h0m26.736130481s) [noise=true , address=104.36.82.34:4545 , piece_id=FPH3U4KXKWDHKDXPSNC5KB2LTHDVBIXKSFLYA7YVXUADTI26E25A, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12P5cnEza1Xxwg4qo1nau11zYHsHxqEAwhFsnt2UE1RhtTrJmra): protocol: expected piece hash; context canceled; EOF Aug 11 22:26:32.305105094 (77h0m26.736185225s) [noise=true , address=104.36.82.18:4394 , piece_id=67UIQFUSRYODDQD7267IK6T7LI2USCMLOQ6NHAKB6R7BREEPLOZA, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Q6GgLmLeGugk1rQu21KNV2pEjXTmgAfiYcV45ibvDixBW41K2): protocol: expected piece hash; context canceled; EOF Aug 11 22:26:32.305485442 (77h0m26.736565573s) [noise=true , address=104.36.82.8:4977 , piece_id=CIWWKHEX5PEEW5S5M6PRJ6IMJWJJPMZDPZDWOWWSA2SSKL6QHLKQ, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WCAm12tXwimFSPqz7Seh6A4oxWqQVxqsF459xux4a5CqjpbAT): protocol: read tcp 188.166.225.170:46648->104.36.82.8:4977: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 22:26:32.305518896 (77h0m26.736599027s) [noise=true , address=104.36.82.13:4213 , piece_id=AC7QMQJBZZCUJOPDDJQRTBLNPHMQP7T6KYQU2MVABDTZINKGEI5Q, seg_pos={0 0}, upload=80262]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XDcAySWNCL7XoStP5GKzAksN1kTs9L8u4KStgyaiQn3AvLcRM): protocol: read tcp 188.166.225.170:56468->104.36.82.13:4213: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 22:26:32.305543643 (77h0m26.736623774s) [seg_pos={0 0}, upload=80262]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:26:32.305611663 (77h0m26.736691794s) [upload=80262]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:26:32.305615842 (77h0m26.736695973s) [upload=80262]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:26:32.608068006 (77h0m27.039148137s) [upload=80262]: Done uploading segments... Aug 11 22:26:32.608087844 (77h0m27.039167975s) [upload=80262]: Upload finished. err: <nil> Duration: 5.944793332s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [......................................X.X...................] duration: 1.965547738s FAIL (2025-08-11 22:25:58 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after d295b8eeb563de4b48b879f424f9ad08c7fb4dd3bebf44de27a7ca55039b02cb != before 8ab40e22d894e0fc1b2b6af3e54ab06e9aa1481b89a729d8b5523518ea3a89da ======LOGS====== Aug 11 22:11:29.756339814 (76h45m24.187419945s) [upload=80005]: Starting upload Aug 11 22:11:29.756390561 (76h45m24.187470683s) [upload=80005]: Done starting upload Aug 11 22:11:29.756461917 (76h45m24.187542038s) [upload=80005]: Uploading segments... Aug 11 22:11:29.756603629 (76h45m24.18768377s) [upload=80005]: Got next segment. Inline: true Aug 11 22:11:29.756615802 (76h45m24.187695933s) [upload=80005]: Waiting for error group managing segments... Aug 11 22:11:29.756677580 (76h45m24.187757711s) [upload=80005]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:11:29.756683782 (76h45m24.187763913s) [upload=80005]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 22:11:29.756686688 (76h45m24.187766819s) [upload=80005]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:11:30.039257370 (76h45m24.470337501s) [upload=80005]: Done uploading segments... Aug 11 22:11:30.039274463 (76h45m24.470354594s) [upload=80005]: Upload finished. err: <nil> Duration:* 1.965582495s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [....X............X..............................X....X......] duration: 7.055384501s FAIL (2025-08-11 22:25:35 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 22:20:31.574625288 (76h54m26.005705419s) [upload=80162]: Starting upload Aug 11 22:20:31.574678641 (76h54m26.005758762s) [upload=80162]: Done starting upload Aug 11 22:20:31.574807807 (76h54m26.005887938s) [upload=80162]: Uploading segments... Aug 11 22:20:31.574925383 (76h54m26.006005514s) [upload=80162]: Got next segment. Inline: false Aug 11 22:20:31.574978033 (76h54m26.006058175s) [upload=80162]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:20:31.574984195 (76h54m26.006064326s) [upload=80162]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:20:32.026275643 (76h54m26.457355784s) [seg_pos={0 0}, upload=80162]: Begin upload segment... Aug 11 22:20:32.026336149 (76h54m26.45741628s) [seg_pos={0 0}, upload=80162]: Done begin upload segment. Aug 11 22:20:32.026364853 (76h54m26.457445015s) [noise=true , address=104.36.82.39:4726 , piece_id=P6KXVXBJB35DOM656QZ5FGM3BT2TXEPIIHROPB74O2DUVGGFTC4Q, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.026403458 (76h54m26.457483589s) [noise=true , address=104.36.82.4:4833 , piece_id=QWFWTTMK3J2RUOGRBE4KXAEZKR4ZIHQSQKG5DQNFMOYUX3EISRKA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.026702028 (76h54m26.457782159s) [noise=true , address=104.36.82.44:4881 , piece_id=5FOV2NBGOV4DWAP374W6ZTUQEVTKB7NZCAF6PETPKW3J2OXRYFZA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.026892152 (76h54m26.457972273s) [noise=true , address=104.36.82.37:4655 , piece_id=KZ4TE53475C6A7J76KYSLCJQY2FPSA765ZEHUYZ6AP7IVLEDPWQA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.026937660 (76h54m26.458017791s) [noise=true , address=104.36.82.18:4391 , piece_id=GBL5TYMJQLTU3VD4QGZDUGCNMCFTFTHSXXMBSC4UGKAFNWQMAVMA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.027173652 (76h54m26.458253773s) [noise=true , address=104.36.82.5:4868 , piece_id=OLLMACTMEK7YPD52IFAUDBXVWB7HAOVOKRDPRURVKLSYBHHUADWA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.027962971 (76h54m26.459043092s) [noise=true , address=104.36.82.3:4791 , piece_id=XFIV3AWJYDLGLCBSCYGXYGKJKFILJP2RE3XSPFXDQBIUGIO4DUVA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.028296229 (76h54m26.45937636s) [noise=true , address=64.49.13.140:4506 , piece_id=QEZVLMNSKUE3USGZ7V2G4RIP43KNJ3QUXACA34TF2UJY2X6WPOVQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.028559102 (76h54m26.459639223s) [noise=true , address=104.36.82.50:4013 , piece_id=NLMRU6XQQDO3TZ65JTJPRXIQW636OU6E547AFRXW4I7K32AWXPOQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.028812717 (76h54m26.459892838s) [noise=true , address=104.36.82.21:4494 , piece_id=K6ZZNIMGOUUK57X3FRG2UOIQSZ3LZNMEM6RARYTNDZXYBMACAJWA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.029064418 (76h54m26.460144539s) [noise=true , address=77.90.31.17:4791 , piece_id=OITGVAJE3KT7KZNQZPZROK64UH7X3DYX43QG7I5AT6LNM5FAA3WA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.029894658 (76h54m26.460974779s) [noise=true , address=104.36.82.46:4505 , piece_id=UKTBYDHNP3BHKGBM7YIMNO5FSD5BCLTJY3SDDF7LJ36HHMQVMNSQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.030316414 (76h54m26.461396545s) [noise=true , address=156.146.43.225:4461 , piece_id=TCWHADOK5P2YCXYMWBEIJVLNWR52UQXDHBEJHCBHMJOJEJSMSFUQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.030549089 (76h54m26.46162922s) [noise=true , address=104.36.82.61:4382 , piece_id=ZURJAZXSHDX6CRHYEAZCLPVCNADTQNRKO7SETLALVFZSZCS6I3UQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.030599746 (76h54m26.461679877s) [noise=true , address=104.36.82.38:4716 , piece_id=EU436Z7WJ4TMNMQA5LBYMMIYZPA7DGXBRV7Y4Z5LO75A3K53FYCQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.030833865 (76h54m26.461913986s) [noise=true , address=79.127.220.98:4423 , piece_id=RO4OG3I2MMYL2ULFLOJDG4TGN6NSA3ETUZ63NXHSWE3ZUTJEJOCA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.031060648 (76h54m26.462140779s) [noise=true , address=104.36.82.19:4425 , piece_id=RUH3QKTVKS6Q6MTLMF76AH62VCV2S6AVXRLMM72MLQCLEDFYBTDA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.031290207 (76h54m26.462370338s) [noise=true , address=104.36.82.14:4255 , piece_id=M5F55V4YVJ3MIWSJNJYFIIV4PBZDDNAIYDT42YFNWD7RTJGVPABA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:33.144545294 (76h54m27.575625425s) [upload=80162]: Next returned nil segment Aug 11 22:20:33.144561866 (76h54m27.575641997s) [upload=80162]: Waiting for error group managing segments... Aug 11 22:20:33.426713607 (76h54m27.857793738s) [noise=true , address=64.49.13.140:4506 , piece_id=QEZVLMNSKUE3USGZ7V2G4RIP43KNJ3QUXACA34TF2UJY2X6WPOVQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:33.881181071 (76h54m28.312261202s) [noise=true , address=79.127.220.98:4423 , piece_id=RO4OG3I2MMYL2ULFLOJDG4TGN6NSA3ETUZ63NXHSWE3ZUTJEJOCA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.000438465 (76h54m28.431518606s) [noise=true , address=104.36.82.61:4382 , piece_id=ZURJAZXSHDX6CRHYEAZCLPVCNADTQNRKO7SETLALVFZSZCS6I3UQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.028136351 (76h54m28.459216482s) [noise=true , address=104.36.82.19:4425 , piece_id=RUH3QKTVKS6Q6MTLMF76AH62VCV2S6AVXRLMM72MLQCLEDFYBTDA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.044195869 (76h54m28.475276001s) [noise=true , address=104.36.82.46:4505 , piece_id=UKTBYDHNP3BHKGBM7YIMNO5FSD5BCLTJY3SDDF7LJ36HHMQVMNSQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.074452992 (76h54m28.505533113s) [noise=true , address=77.90.31.17:4791 , piece_id=OITGVAJE3KT7KZNQZPZROK64UH7X3DYX43QG7I5AT6LNM5FAA3WA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.075748340 (76h54m28.506828471s) [noise=true , address=104.36.82.3:4791 , piece_id=XFIV3AWJYDLGLCBSCYGXYGKJKFILJP2RE3XSPFXDQBIUGIO4DUVA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.087394404 (76h54m28.518474535s) [noise=true , address=104.36.82.37:4655 , piece_id=KZ4TE53475C6A7J76KYSLCJQY2FPSA765ZEHUYZ6AP7IVLEDPWQA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.103935743 (76h54m28.535015874s) [noise=true , address=104.36.82.21:4494 , piece_id=K6ZZNIMGOUUK57X3FRG2UOIQSZ3LZNMEM6RARYTNDZXYBMACAJWA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.124051121 (76h54m28.555131262s) [noise=true , address=104.36.82.14:4255 , piece_id=M5F55V4YVJ3MIWSJNJYFIIV4PBZDDNAIYDT42YFNWD7RTJGVPABA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.177175989 (76h54m28.60825612s) [noise=true , address=104.36.82.4:4833 , piece_id=QWFWTTMK3J2RUOGRBE4KXAEZKR4ZIHQSQKG5DQNFMOYUX3EISRKA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.189359731 (76h54m28.620439862s) [noise=true , address=156.146.43.225:4461 , piece_id=TCWHADOK5P2YCXYMWBEIJVLNWR52UQXDHBEJHCBHMJOJEJSMSFUQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.196129264 (76h54m28.627209395s) [noise=true , address=104.36.82.5:4868 , piece_id=OLLMACTMEK7YPD52IFAUDBXVWB7HAOVOKRDPRURVKLSYBHHUADWA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.196547093 (76h54m28.627627234s) [noise=true , address=104.36.82.50:4013 , piece_id=NLMRU6XQQDO3TZ65JTJPRXIQW636OU6E547AFRXW4I7K32AWXPOQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.196609021 (76h54m28.627689163s) [seg_pos={0 0}, upload=80162]: Segment reached optimal threshold of 14 pieces. Aug 11 22:20:34.196768076 (76h54m28.627848207s) [noise=true , address=104.36.82.39:4726 , piece_id=P6KXVXBJB35DOM656QZ5FGM3BT2TXEPIIHROPB74O2DUVGGFTC4Q, seg_pos={0 0}, upload=80162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4): protocol: expected piece hash; context canceled; EOF Aug 11 22:20:34.196810928 (76h54m28.627891059s) [noise=true , address=104.36.82.18:4391 , piece_id=GBL5TYMJQLTU3VD4QGZDUGCNMCFTFTHSXXMBSC4UGKAFNWQMAVMA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MHmmjheT4VDX93MiQNzQyTWkxZFzz2PwNvdRfsevZRbj6qmJS): protocol: expected piece hash; context canceled; EOF Aug 11 22:20:34.196863489 (76h54m28.62794361s) [noise=true , address=104.36.82.44:4881 , piece_id=5FOV2NBGOV4DWAP374W6ZTUQEVTKB7NZCAF6PETPKW3J2OXRYFZA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 11 22:20:34.196931038 (76h54m28.628011169s) [noise=true , address=104.36.82.38:4716 , piece_id=EU436Z7WJ4TMNMQA5LBYMMIYZPA7DGXBRV7Y4Z5LO75A3K53FYCQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MAHcnhvjvD74dpLS5S3m751NzfjvJ8a9ZvHwA7mdXUEXm9DAX): protocol: expected piece hash; context canceled; EOF Aug 11 22:20:34.196948211 (76h54m28.628028332s) [seg_pos={0 0}, upload=80162]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:20:34.197022533 (76h54m28.628102664s) [upload=80162]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:20:34.197027934 (76h54m28.628108065s) [upload=80162]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:20:34.509243036 (76h54m28.940323177s) [upload=80162]: Done uploading segments... Aug 11 22:20:34.509266030 (76h54m28.940346171s) [upload=80162]: Upload finished. err: <nil> Duration: 7.055408035s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.......................................X.X..................] duration: 1.899819508s FAIL (2025-08-11 22:24:56 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after d295b8eeb563de4b48b879f424f9ad08c7fb4dd3bebf44de27a7ca55039b02cb != before 8ab40e22d894e0fc1b2b6af3e54ab06e9aa1481b89a729d8b5523518ea3a89da ======LOGS====== Aug 11 22:11:29.756339814 (76h45m24.187419945s) [upload=80005]: Starting upload Aug 11 22:11:29.756390561 (76h45m24.187470683s) [upload=80005]: Done starting upload Aug 11 22:11:29.756461917 (76h45m24.187542038s) [upload=80005]: Uploading segments... Aug 11 22:11:29.756603629 (76h45m24.18768377s) [upload=80005]: Got next segment. Inline: true Aug 11 22:11:29.756615802 (76h45m24.187695933s) [upload=80005]: Waiting for error group managing segments... Aug 11 22:11:29.756677580 (76h45m24.187757711s) [upload=80005]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:11:29.756683782 (76h45m24.187763913s) [upload=80005]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 22:11:29.756686688 (76h45m24.187766819s) [upload=80005]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:11:30.039257370 (76h45m24.470337501s) [upload=80005]: Done uploading segments... Aug 11 22:11:30.039274463 (76h45m24.470354594s) [upload=80005]: Upload finished. err: <nil> Duration:* 1.899845347s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.....X............X..............................X....X.....] duration: 6.05204803s FAIL (2025-08-11 22:24:28 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 22:20:31.574625288 (76h54m26.005705419s) [upload=80162]: Starting upload Aug 11 22:20:31.574678641 (76h54m26.005758762s) [upload=80162]: Done starting upload Aug 11 22:20:31.574807807 (76h54m26.005887938s) [upload=80162]: Uploading segments... Aug 11 22:20:31.574925383 (76h54m26.006005514s) [upload=80162]: Got next segment. Inline: false Aug 11 22:20:31.574978033 (76h54m26.006058175s) [upload=80162]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:20:31.574984195 (76h54m26.006064326s) [upload=80162]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:20:32.026275643 (76h54m26.457355784s) [seg_pos={0 0}, upload=80162]: Begin upload segment... Aug 11 22:20:32.026336149 (76h54m26.45741628s) [seg_pos={0 0}, upload=80162]: Done begin upload segment. Aug 11 22:20:32.026364853 (76h54m26.457445015s) [noise=true , address=104.36.82.39:4726 , piece_id=P6KXVXBJB35DOM656QZ5FGM3BT2TXEPIIHROPB74O2DUVGGFTC4Q, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.026403458 (76h54m26.457483589s) [noise=true , address=104.36.82.4:4833 , piece_id=QWFWTTMK3J2RUOGRBE4KXAEZKR4ZIHQSQKG5DQNFMOYUX3EISRKA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.026702028 (76h54m26.457782159s) [noise=true , address=104.36.82.44:4881 , piece_id=5FOV2NBGOV4DWAP374W6ZTUQEVTKB7NZCAF6PETPKW3J2OXRYFZA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.026892152 (76h54m26.457972273s) [noise=true , address=104.36.82.37:4655 , piece_id=KZ4TE53475C6A7J76KYSLCJQY2FPSA765ZEHUYZ6AP7IVLEDPWQA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.026937660 (76h54m26.458017791s) [noise=true , address=104.36.82.18:4391 , piece_id=GBL5TYMJQLTU3VD4QGZDUGCNMCFTFTHSXXMBSC4UGKAFNWQMAVMA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.027173652 (76h54m26.458253773s) [noise=true , address=104.36.82.5:4868 , piece_id=OLLMACTMEK7YPD52IFAUDBXVWB7HAOVOKRDPRURVKLSYBHHUADWA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.027962971 (76h54m26.459043092s) [noise=true , address=104.36.82.3:4791 , piece_id=XFIV3AWJYDLGLCBSCYGXYGKJKFILJP2RE3XSPFXDQBIUGIO4DUVA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.028296229 (76h54m26.45937636s) [noise=true , address=64.49.13.140:4506 , piece_id=QEZVLMNSKUE3USGZ7V2G4RIP43KNJ3QUXACA34TF2UJY2X6WPOVQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.028559102 (76h54m26.459639223s) [noise=true , address=104.36.82.50:4013 , piece_id=NLMRU6XQQDO3TZ65JTJPRXIQW636OU6E547AFRXW4I7K32AWXPOQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.028812717 (76h54m26.459892838s) [noise=true , address=104.36.82.21:4494 , piece_id=K6ZZNIMGOUUK57X3FRG2UOIQSZ3LZNMEM6RARYTNDZXYBMACAJWA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.029064418 (76h54m26.460144539s) [noise=true , address=77.90.31.17:4791 , piece_id=OITGVAJE3KT7KZNQZPZROK64UH7X3DYX43QG7I5AT6LNM5FAA3WA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.029894658 (76h54m26.460974779s) [noise=true , address=104.36.82.46:4505 , piece_id=UKTBYDHNP3BHKGBM7YIMNO5FSD5BCLTJY3SDDF7LJ36HHMQVMNSQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.030316414 (76h54m26.461396545s) [noise=true , address=156.146.43.225:4461 , piece_id=TCWHADOK5P2YCXYMWBEIJVLNWR52UQXDHBEJHCBHMJOJEJSMSFUQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.030549089 (76h54m26.46162922s) [noise=true , address=104.36.82.61:4382 , piece_id=ZURJAZXSHDX6CRHYEAZCLPVCNADTQNRKO7SETLALVFZSZCS6I3UQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.030599746 (76h54m26.461679877s) [noise=true , address=104.36.82.38:4716 , piece_id=EU436Z7WJ4TMNMQA5LBYMMIYZPA7DGXBRV7Y4Z5LO75A3K53FYCQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.030833865 (76h54m26.461913986s) [noise=true , address=79.127.220.98:4423 , piece_id=RO4OG3I2MMYL2ULFLOJDG4TGN6NSA3ETUZ63NXHSWE3ZUTJEJOCA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.031060648 (76h54m26.462140779s) [noise=true , address=104.36.82.19:4425 , piece_id=RUH3QKTVKS6Q6MTLMF76AH62VCV2S6AVXRLMM72MLQCLEDFYBTDA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.031290207 (76h54m26.462370338s) [noise=true , address=104.36.82.14:4255 , piece_id=M5F55V4YVJ3MIWSJNJYFIIV4PBZDDNAIYDT42YFNWD7RTJGVPABA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:33.144545294 (76h54m27.575625425s) [upload=80162]: Next returned nil segment Aug 11 22:20:33.144561866 (76h54m27.575641997s) [upload=80162]: Waiting for error group managing segments... Aug 11 22:20:33.426713607 (76h54m27.857793738s) [noise=true , address=64.49.13.140:4506 , piece_id=QEZVLMNSKUE3USGZ7V2G4RIP43KNJ3QUXACA34TF2UJY2X6WPOVQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:33.881181071 (76h54m28.312261202s) [noise=true , address=79.127.220.98:4423 , piece_id=RO4OG3I2MMYL2ULFLOJDG4TGN6NSA3ETUZ63NXHSWE3ZUTJEJOCA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.000438465 (76h54m28.431518606s) [noise=true , address=104.36.82.61:4382 , piece_id=ZURJAZXSHDX6CRHYEAZCLPVCNADTQNRKO7SETLALVFZSZCS6I3UQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.028136351 (76h54m28.459216482s) [noise=true , address=104.36.82.19:4425 , piece_id=RUH3QKTVKS6Q6MTLMF76AH62VCV2S6AVXRLMM72MLQCLEDFYBTDA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.044195869 (76h54m28.475276001s) [noise=true , address=104.36.82.46:4505 , piece_id=UKTBYDHNP3BHKGBM7YIMNO5FSD5BCLTJY3SDDF7LJ36HHMQVMNSQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.074452992 (76h54m28.505533113s) [noise=true , address=77.90.31.17:4791 , piece_id=OITGVAJE3KT7KZNQZPZROK64UH7X3DYX43QG7I5AT6LNM5FAA3WA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.075748340 (76h54m28.506828471s) [noise=true , address=104.36.82.3:4791 , piece_id=XFIV3AWJYDLGLCBSCYGXYGKJKFILJP2RE3XSPFXDQBIUGIO4DUVA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.087394404 (76h54m28.518474535s) [noise=true , address=104.36.82.37:4655 , piece_id=KZ4TE53475C6A7J76KYSLCJQY2FPSA765ZEHUYZ6AP7IVLEDPWQA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.103935743 (76h54m28.535015874s) [noise=true , address=104.36.82.21:4494 , piece_id=K6ZZNIMGOUUK57X3FRG2UOIQSZ3LZNMEM6RARYTNDZXYBMACAJWA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.124051121 (76h54m28.555131262s) [noise=true , address=104.36.82.14:4255 , piece_id=M5F55V4YVJ3MIWSJNJYFIIV4PBZDDNAIYDT42YFNWD7RTJGVPABA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.177175989 (76h54m28.60825612s) [noise=true , address=104.36.82.4:4833 , piece_id=QWFWTTMK3J2RUOGRBE4KXAEZKR4ZIHQSQKG5DQNFMOYUX3EISRKA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.189359731 (76h54m28.620439862s) [noise=true , address=156.146.43.225:4461 , piece_id=TCWHADOK5P2YCXYMWBEIJVLNWR52UQXDHBEJHCBHMJOJEJSMSFUQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.196129264 (76h54m28.627209395s) [noise=true , address=104.36.82.5:4868 , piece_id=OLLMACTMEK7YPD52IFAUDBXVWB7HAOVOKRDPRURVKLSYBHHUADWA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.196547093 (76h54m28.627627234s) [noise=true , address=104.36.82.50:4013 , piece_id=NLMRU6XQQDO3TZ65JTJPRXIQW636OU6E547AFRXW4I7K32AWXPOQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.196609021 (76h54m28.627689163s) [seg_pos={0 0}, upload=80162]: Segment reached optimal threshold of 14 pieces. Aug 11 22:20:34.196768076 (76h54m28.627848207s) [noise=true , address=104.36.82.39:4726 , piece_id=P6KXVXBJB35DOM656QZ5FGM3BT2TXEPIIHROPB74O2DUVGGFTC4Q, seg_pos={0 0}, upload=80162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4): protocol: expected piece hash; context canceled; EOF Aug 11 22:20:34.196810928 (76h54m28.627891059s) [noise=true , address=104.36.82.18:4391 , piece_id=GBL5TYMJQLTU3VD4QGZDUGCNMCFTFTHSXXMBSC4UGKAFNWQMAVMA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MHmmjheT4VDX93MiQNzQyTWkxZFzz2PwNvdRfsevZRbj6qmJS): protocol: expected piece hash; context canceled; EOF Aug 11 22:20:34.196863489 (76h54m28.62794361s) [noise=true , address=104.36.82.44:4881 , piece_id=5FOV2NBGOV4DWAP374W6ZTUQEVTKB7NZCAF6PETPKW3J2OXRYFZA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 11 22:20:34.196931038 (76h54m28.628011169s) [noise=true , address=104.36.82.38:4716 , piece_id=EU436Z7WJ4TMNMQA5LBYMMIYZPA7DGXBRV7Y4Z5LO75A3K53FYCQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MAHcnhvjvD74dpLS5S3m751NzfjvJ8a9ZvHwA7mdXUEXm9DAX): protocol: expected piece hash; context canceled; EOF Aug 11 22:20:34.196948211 (76h54m28.628028332s) [seg_pos={0 0}, upload=80162]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:20:34.197022533 (76h54m28.628102664s) [upload=80162]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:20:34.197027934 (76h54m28.628108065s) [upload=80162]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:20:34.509243036 (76h54m28.940323177s) [upload=80162]: Done uploading segments... Aug 11 22:20:34.509266030 (76h54m28.940346171s) [upload=80162]: Upload finished. err: <nil> Duration: 6.052072206s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [......X............X..............................X....X....] duration: 6.086449728s FAIL (2025-08-11 22:24:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 22:20:31.574625288 (76h54m26.005705419s) [upload=80162]: Starting upload Aug 11 22:20:31.574678641 (76h54m26.005758762s) [upload=80162]: Done starting upload Aug 11 22:20:31.574807807 (76h54m26.005887938s) [upload=80162]: Uploading segments... Aug 11 22:20:31.574925383 (76h54m26.006005514s) [upload=80162]: Got next segment. Inline: false Aug 11 22:20:31.574978033 (76h54m26.006058175s) [upload=80162]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:20:31.574984195 (76h54m26.006064326s) [upload=80162]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:20:32.026275643 (76h54m26.457355784s) [seg_pos={0 0}, upload=80162]: Begin upload segment... Aug 11 22:20:32.026336149 (76h54m26.45741628s) [seg_pos={0 0}, upload=80162]: Done begin upload segment. Aug 11 22:20:32.026364853 (76h54m26.457445015s) [noise=true , address=104.36.82.39:4726 , piece_id=P6KXVXBJB35DOM656QZ5FGM3BT2TXEPIIHROPB74O2DUVGGFTC4Q, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.026403458 (76h54m26.457483589s) [noise=true , address=104.36.82.4:4833 , piece_id=QWFWTTMK3J2RUOGRBE4KXAEZKR4ZIHQSQKG5DQNFMOYUX3EISRKA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.026702028 (76h54m26.457782159s) [noise=true , address=104.36.82.44:4881 , piece_id=5FOV2NBGOV4DWAP374W6ZTUQEVTKB7NZCAF6PETPKW3J2OXRYFZA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.026892152 (76h54m26.457972273s) [noise=true , address=104.36.82.37:4655 , piece_id=KZ4TE53475C6A7J76KYSLCJQY2FPSA765ZEHUYZ6AP7IVLEDPWQA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.026937660 (76h54m26.458017791s) [noise=true , address=104.36.82.18:4391 , piece_id=GBL5TYMJQLTU3VD4QGZDUGCNMCFTFTHSXXMBSC4UGKAFNWQMAVMA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.027173652 (76h54m26.458253773s) [noise=true , address=104.36.82.5:4868 , piece_id=OLLMACTMEK7YPD52IFAUDBXVWB7HAOVOKRDPRURVKLSYBHHUADWA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.027962971 (76h54m26.459043092s) [noise=true , address=104.36.82.3:4791 , piece_id=XFIV3AWJYDLGLCBSCYGXYGKJKFILJP2RE3XSPFXDQBIUGIO4DUVA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.028296229 (76h54m26.45937636s) [noise=true , address=64.49.13.140:4506 , piece_id=QEZVLMNSKUE3USGZ7V2G4RIP43KNJ3QUXACA34TF2UJY2X6WPOVQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.028559102 (76h54m26.459639223s) [noise=true , address=104.36.82.50:4013 , piece_id=NLMRU6XQQDO3TZ65JTJPRXIQW636OU6E547AFRXW4I7K32AWXPOQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.028812717 (76h54m26.459892838s) [noise=true , address=104.36.82.21:4494 , piece_id=K6ZZNIMGOUUK57X3FRG2UOIQSZ3LZNMEM6RARYTNDZXYBMACAJWA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.029064418 (76h54m26.460144539s) [noise=true , address=77.90.31.17:4791 , piece_id=OITGVAJE3KT7KZNQZPZROK64UH7X3DYX43QG7I5AT6LNM5FAA3WA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.029894658 (76h54m26.460974779s) [noise=true , address=104.36.82.46:4505 , piece_id=UKTBYDHNP3BHKGBM7YIMNO5FSD5BCLTJY3SDDF7LJ36HHMQVMNSQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.030316414 (76h54m26.461396545s) [noise=true , address=156.146.43.225:4461 , piece_id=TCWHADOK5P2YCXYMWBEIJVLNWR52UQXDHBEJHCBHMJOJEJSMSFUQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.030549089 (76h54m26.46162922s) [noise=true , address=104.36.82.61:4382 , piece_id=ZURJAZXSHDX6CRHYEAZCLPVCNADTQNRKO7SETLALVFZSZCS6I3UQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.030599746 (76h54m26.461679877s) [noise=true , address=104.36.82.38:4716 , piece_id=EU436Z7WJ4TMNMQA5LBYMMIYZPA7DGXBRV7Y4Z5LO75A3K53FYCQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.030833865 (76h54m26.461913986s) [noise=true , address=79.127.220.98:4423 , piece_id=RO4OG3I2MMYL2ULFLOJDG4TGN6NSA3ETUZ63NXHSWE3ZUTJEJOCA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.031060648 (76h54m26.462140779s) [noise=true , address=104.36.82.19:4425 , piece_id=RUH3QKTVKS6Q6MTLMF76AH62VCV2S6AVXRLMM72MLQCLEDFYBTDA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.031290207 (76h54m26.462370338s) [noise=true , address=104.36.82.14:4255 , piece_id=M5F55V4YVJ3MIWSJNJYFIIV4PBZDDNAIYDT42YFNWD7RTJGVPABA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:33.144545294 (76h54m27.575625425s) [upload=80162]: Next returned nil segment Aug 11 22:20:33.144561866 (76h54m27.575641997s) [upload=80162]: Waiting for error group managing segments... Aug 11 22:20:33.426713607 (76h54m27.857793738s) [noise=true , address=64.49.13.140:4506 , piece_id=QEZVLMNSKUE3USGZ7V2G4RIP43KNJ3QUXACA34TF2UJY2X6WPOVQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:33.881181071 (76h54m28.312261202s) [noise=true , address=79.127.220.98:4423 , piece_id=RO4OG3I2MMYL2ULFLOJDG4TGN6NSA3ETUZ63NXHSWE3ZUTJEJOCA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.000438465 (76h54m28.431518606s) [noise=true , address=104.36.82.61:4382 , piece_id=ZURJAZXSHDX6CRHYEAZCLPVCNADTQNRKO7SETLALVFZSZCS6I3UQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.028136351 (76h54m28.459216482s) [noise=true , address=104.36.82.19:4425 , piece_id=RUH3QKTVKS6Q6MTLMF76AH62VCV2S6AVXRLMM72MLQCLEDFYBTDA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.044195869 (76h54m28.475276001s) [noise=true , address=104.36.82.46:4505 , piece_id=UKTBYDHNP3BHKGBM7YIMNO5FSD5BCLTJY3SDDF7LJ36HHMQVMNSQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.074452992 (76h54m28.505533113s) [noise=true , address=77.90.31.17:4791 , piece_id=OITGVAJE3KT7KZNQZPZROK64UH7X3DYX43QG7I5AT6LNM5FAA3WA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.075748340 (76h54m28.506828471s) [noise=true , address=104.36.82.3:4791 , piece_id=XFIV3AWJYDLGLCBSCYGXYGKJKFILJP2RE3XSPFXDQBIUGIO4DUVA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.087394404 (76h54m28.518474535s) [noise=true , address=104.36.82.37:4655 , piece_id=KZ4TE53475C6A7J76KYSLCJQY2FPSA765ZEHUYZ6AP7IVLEDPWQA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.103935743 (76h54m28.535015874s) [noise=true , address=104.36.82.21:4494 , piece_id=K6ZZNIMGOUUK57X3FRG2UOIQSZ3LZNMEM6RARYTNDZXYBMACAJWA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.124051121 (76h54m28.555131262s) [noise=true , address=104.36.82.14:4255 , piece_id=M5F55V4YVJ3MIWSJNJYFIIV4PBZDDNAIYDT42YFNWD7RTJGVPABA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.177175989 (76h54m28.60825612s) [noise=true , address=104.36.82.4:4833 , piece_id=QWFWTTMK3J2RUOGRBE4KXAEZKR4ZIHQSQKG5DQNFMOYUX3EISRKA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.189359731 (76h54m28.620439862s) [noise=true , address=156.146.43.225:4461 , piece_id=TCWHADOK5P2YCXYMWBEIJVLNWR52UQXDHBEJHCBHMJOJEJSMSFUQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.196129264 (76h54m28.627209395s) [noise=true , address=104.36.82.5:4868 , piece_id=OLLMACTMEK7YPD52IFAUDBXVWB7HAOVOKRDPRURVKLSYBHHUADWA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.196547093 (76h54m28.627627234s) [noise=true , address=104.36.82.50:4013 , piece_id=NLMRU6XQQDO3TZ65JTJPRXIQW636OU6E547AFRXW4I7K32AWXPOQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.196609021 (76h54m28.627689163s) [seg_pos={0 0}, upload=80162]: Segment reached optimal threshold of 14 pieces. Aug 11 22:20:34.196768076 (76h54m28.627848207s) [noise=true , address=104.36.82.39:4726 , piece_id=P6KXVXBJB35DOM656QZ5FGM3BT2TXEPIIHROPB74O2DUVGGFTC4Q, seg_pos={0 0}, upload=80162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4): protocol: expected piece hash; context canceled; EOF Aug 11 22:20:34.196810928 (76h54m28.627891059s) [noise=true , address=104.36.82.18:4391 , piece_id=GBL5TYMJQLTU3VD4QGZDUGCNMCFTFTHSXXMBSC4UGKAFNWQMAVMA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MHmmjheT4VDX93MiQNzQyTWkxZFzz2PwNvdRfsevZRbj6qmJS): protocol: expected piece hash; context canceled; EOF Aug 11 22:20:34.196863489 (76h54m28.62794361s) [noise=true , address=104.36.82.44:4881 , piece_id=5FOV2NBGOV4DWAP374W6ZTUQEVTKB7NZCAF6PETPKW3J2OXRYFZA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 11 22:20:34.196931038 (76h54m28.628011169s) [noise=true , address=104.36.82.38:4716 , piece_id=EU436Z7WJ4TMNMQA5LBYMMIYZPA7DGXBRV7Y4Z5LO75A3K53FYCQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MAHcnhvjvD74dpLS5S3m751NzfjvJ8a9ZvHwA7mdXUEXm9DAX): protocol: expected piece hash; context canceled; EOF Aug 11 22:20:34.196948211 (76h54m28.628028332s) [seg_pos={0 0}, upload=80162]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:20:34.197022533 (76h54m28.628102664s) [upload=80162]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:20:34.197027934 (76h54m28.628108065s) [upload=80162]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:20:34.509243036 (76h54m28.940323177s) [upload=80162]: Done uploading segments... Aug 11 22:20:34.509266030 (76h54m28.940346171s) [upload=80162]: Upload finished. err: <nil> Duration: 6.086472753s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [........................................X.X.................] duration: 2.213854821s FAIL (2025-08-11 22:23:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after d295b8eeb563de4b48b879f424f9ad08c7fb4dd3bebf44de27a7ca55039b02cb != before 8ab40e22d894e0fc1b2b6af3e54ab06e9aa1481b89a729d8b5523518ea3a89da ======LOGS====== Aug 11 22:11:29.756339814 (76h45m24.187419945s) [upload=80005]: Starting upload Aug 11 22:11:29.756390561 (76h45m24.187470683s) [upload=80005]: Done starting upload Aug 11 22:11:29.756461917 (76h45m24.187542038s) [upload=80005]: Uploading segments... Aug 11 22:11:29.756603629 (76h45m24.18768377s) [upload=80005]: Got next segment. Inline: true Aug 11 22:11:29.756615802 (76h45m24.187695933s) [upload=80005]: Waiting for error group managing segments... Aug 11 22:11:29.756677580 (76h45m24.187757711s) [upload=80005]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:11:29.756683782 (76h45m24.187763913s) [upload=80005]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 22:11:29.756686688 (76h45m24.187766819s) [upload=80005]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:11:30.039257370 (76h45m24.470337501s) [upload=80005]: Done uploading segments... Aug 11 22:11:30.039274463 (76h45m24.470354594s) [upload=80005]: Upload finished. err: <nil> Duration:* 2.21387458s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.......X............X..............................X....X...] duration: 7.002448264s FAIL (2025-08-11 22:23:31 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 22:20:31.574625288 (76h54m26.005705419s) [upload=80162]: Starting upload Aug 11 22:20:31.574678641 (76h54m26.005758762s) [upload=80162]: Done starting upload Aug 11 22:20:31.574807807 (76h54m26.005887938s) [upload=80162]: Uploading segments... Aug 11 22:20:31.574925383 (76h54m26.006005514s) [upload=80162]: Got next segment. Inline: false Aug 11 22:20:31.574978033 (76h54m26.006058175s) [upload=80162]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:20:31.574984195 (76h54m26.006064326s) [upload=80162]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:20:32.026275643 (76h54m26.457355784s) [seg_pos={0 0}, upload=80162]: Begin upload segment... Aug 11 22:20:32.026336149 (76h54m26.45741628s) [seg_pos={0 0}, upload=80162]: Done begin upload segment. Aug 11 22:20:32.026364853 (76h54m26.457445015s) [noise=true , address=104.36.82.39:4726 , piece_id=P6KXVXBJB35DOM656QZ5FGM3BT2TXEPIIHROPB74O2DUVGGFTC4Q, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.026403458 (76h54m26.457483589s) [noise=true , address=104.36.82.4:4833 , piece_id=QWFWTTMK3J2RUOGRBE4KXAEZKR4ZIHQSQKG5DQNFMOYUX3EISRKA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.026702028 (76h54m26.457782159s) [noise=true , address=104.36.82.44:4881 , piece_id=5FOV2NBGOV4DWAP374W6ZTUQEVTKB7NZCAF6PETPKW3J2OXRYFZA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.026892152 (76h54m26.457972273s) [noise=true , address=104.36.82.37:4655 , piece_id=KZ4TE53475C6A7J76KYSLCJQY2FPSA765ZEHUYZ6AP7IVLEDPWQA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.026937660 (76h54m26.458017791s) [noise=true , address=104.36.82.18:4391 , piece_id=GBL5TYMJQLTU3VD4QGZDUGCNMCFTFTHSXXMBSC4UGKAFNWQMAVMA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.027173652 (76h54m26.458253773s) [noise=true , address=104.36.82.5:4868 , piece_id=OLLMACTMEK7YPD52IFAUDBXVWB7HAOVOKRDPRURVKLSYBHHUADWA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.027962971 (76h54m26.459043092s) [noise=true , address=104.36.82.3:4791 , piece_id=XFIV3AWJYDLGLCBSCYGXYGKJKFILJP2RE3XSPFXDQBIUGIO4DUVA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.028296229 (76h54m26.45937636s) [noise=true , address=64.49.13.140:4506 , piece_id=QEZVLMNSKUE3USGZ7V2G4RIP43KNJ3QUXACA34TF2UJY2X6WPOVQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.028559102 (76h54m26.459639223s) [noise=true , address=104.36.82.50:4013 , piece_id=NLMRU6XQQDO3TZ65JTJPRXIQW636OU6E547AFRXW4I7K32AWXPOQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.028812717 (76h54m26.459892838s) [noise=true , address=104.36.82.21:4494 , piece_id=K6ZZNIMGOUUK57X3FRG2UOIQSZ3LZNMEM6RARYTNDZXYBMACAJWA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.029064418 (76h54m26.460144539s) [noise=true , address=77.90.31.17:4791 , piece_id=OITGVAJE3KT7KZNQZPZROK64UH7X3DYX43QG7I5AT6LNM5FAA3WA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.029894658 (76h54m26.460974779s) [noise=true , address=104.36.82.46:4505 , piece_id=UKTBYDHNP3BHKGBM7YIMNO5FSD5BCLTJY3SDDF7LJ36HHMQVMNSQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.030316414 (76h54m26.461396545s) [noise=true , address=156.146.43.225:4461 , piece_id=TCWHADOK5P2YCXYMWBEIJVLNWR52UQXDHBEJHCBHMJOJEJSMSFUQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.030549089 (76h54m26.46162922s) [noise=true , address=104.36.82.61:4382 , piece_id=ZURJAZXSHDX6CRHYEAZCLPVCNADTQNRKO7SETLALVFZSZCS6I3UQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.030599746 (76h54m26.461679877s) [noise=true , address=104.36.82.38:4716 , piece_id=EU436Z7WJ4TMNMQA5LBYMMIYZPA7DGXBRV7Y4Z5LO75A3K53FYCQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.030833865 (76h54m26.461913986s) [noise=true , address=79.127.220.98:4423 , piece_id=RO4OG3I2MMYL2ULFLOJDG4TGN6NSA3ETUZ63NXHSWE3ZUTJEJOCA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.031060648 (76h54m26.462140779s) [noise=true , address=104.36.82.19:4425 , piece_id=RUH3QKTVKS6Q6MTLMF76AH62VCV2S6AVXRLMM72MLQCLEDFYBTDA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.031290207 (76h54m26.462370338s) [noise=true , address=104.36.82.14:4255 , piece_id=M5F55V4YVJ3MIWSJNJYFIIV4PBZDDNAIYDT42YFNWD7RTJGVPABA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:33.144545294 (76h54m27.575625425s) [upload=80162]: Next returned nil segment Aug 11 22:20:33.144561866 (76h54m27.575641997s) [upload=80162]: Waiting for error group managing segments... Aug 11 22:20:33.426713607 (76h54m27.857793738s) [noise=true , address=64.49.13.140:4506 , piece_id=QEZVLMNSKUE3USGZ7V2G4RIP43KNJ3QUXACA34TF2UJY2X6WPOVQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:33.881181071 (76h54m28.312261202s) [noise=true , address=79.127.220.98:4423 , piece_id=RO4OG3I2MMYL2ULFLOJDG4TGN6NSA3ETUZ63NXHSWE3ZUTJEJOCA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.000438465 (76h54m28.431518606s) [noise=true , address=104.36.82.61:4382 , piece_id=ZURJAZXSHDX6CRHYEAZCLPVCNADTQNRKO7SETLALVFZSZCS6I3UQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.028136351 (76h54m28.459216482s) [noise=true , address=104.36.82.19:4425 , piece_id=RUH3QKTVKS6Q6MTLMF76AH62VCV2S6AVXRLMM72MLQCLEDFYBTDA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.044195869 (76h54m28.475276001s) [noise=true , address=104.36.82.46:4505 , piece_id=UKTBYDHNP3BHKGBM7YIMNO5FSD5BCLTJY3SDDF7LJ36HHMQVMNSQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.074452992 (76h54m28.505533113s) [noise=true , address=77.90.31.17:4791 , piece_id=OITGVAJE3KT7KZNQZPZROK64UH7X3DYX43QG7I5AT6LNM5FAA3WA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.075748340 (76h54m28.506828471s) [noise=true , address=104.36.82.3:4791 , piece_id=XFIV3AWJYDLGLCBSCYGXYGKJKFILJP2RE3XSPFXDQBIUGIO4DUVA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.087394404 (76h54m28.518474535s) [noise=true , address=104.36.82.37:4655 , piece_id=KZ4TE53475C6A7J76KYSLCJQY2FPSA765ZEHUYZ6AP7IVLEDPWQA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.103935743 (76h54m28.535015874s) [noise=true , address=104.36.82.21:4494 , piece_id=K6ZZNIMGOUUK57X3FRG2UOIQSZ3LZNMEM6RARYTNDZXYBMACAJWA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.124051121 (76h54m28.555131262s) [noise=true , address=104.36.82.14:4255 , piece_id=M5F55V4YVJ3MIWSJNJYFIIV4PBZDDNAIYDT42YFNWD7RTJGVPABA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.177175989 (76h54m28.60825612s) [noise=true , address=104.36.82.4:4833 , piece_id=QWFWTTMK3J2RUOGRBE4KXAEZKR4ZIHQSQKG5DQNFMOYUX3EISRKA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.189359731 (76h54m28.620439862s) [noise=true , address=156.146.43.225:4461 , piece_id=TCWHADOK5P2YCXYMWBEIJVLNWR52UQXDHBEJHCBHMJOJEJSMSFUQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.196129264 (76h54m28.627209395s) [noise=true , address=104.36.82.5:4868 , piece_id=OLLMACTMEK7YPD52IFAUDBXVWB7HAOVOKRDPRURVKLSYBHHUADWA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.196547093 (76h54m28.627627234s) [noise=true , address=104.36.82.50:4013 , piece_id=NLMRU6XQQDO3TZ65JTJPRXIQW636OU6E547AFRXW4I7K32AWXPOQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.196609021 (76h54m28.627689163s) [seg_pos={0 0}, upload=80162]: Segment reached optimal threshold of 14 pieces. Aug 11 22:20:34.196768076 (76h54m28.627848207s) [noise=true , address=104.36.82.39:4726 , piece_id=P6KXVXBJB35DOM656QZ5FGM3BT2TXEPIIHROPB74O2DUVGGFTC4Q, seg_pos={0 0}, upload=80162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4): protocol: expected piece hash; context canceled; EOF Aug 11 22:20:34.196810928 (76h54m28.627891059s) [noise=true , address=104.36.82.18:4391 , piece_id=GBL5TYMJQLTU3VD4QGZDUGCNMCFTFTHSXXMBSC4UGKAFNWQMAVMA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MHmmjheT4VDX93MiQNzQyTWkxZFzz2PwNvdRfsevZRbj6qmJS): protocol: expected piece hash; context canceled; EOF Aug 11 22:20:34.196863489 (76h54m28.62794361s) [noise=true , address=104.36.82.44:4881 , piece_id=5FOV2NBGOV4DWAP374W6ZTUQEVTKB7NZCAF6PETPKW3J2OXRYFZA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 11 22:20:34.196931038 (76h54m28.628011169s) [noise=true , address=104.36.82.38:4716 , piece_id=EU436Z7WJ4TMNMQA5LBYMMIYZPA7DGXBRV7Y4Z5LO75A3K53FYCQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MAHcnhvjvD74dpLS5S3m751NzfjvJ8a9ZvHwA7mdXUEXm9DAX): protocol: expected piece hash; context canceled; EOF Aug 11 22:20:34.196948211 (76h54m28.628028332s) [seg_pos={0 0}, upload=80162]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:20:34.197022533 (76h54m28.628102664s) [upload=80162]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:20:34.197027934 (76h54m28.628108065s) [upload=80162]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:20:34.509243036 (76h54m28.940323177s) [upload=80162]: Done uploading segments... Aug 11 22:20:34.509266030 (76h54m28.940346171s) [upload=80162]: Upload finished. err: <nil> Duration: 7.002469074s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X.X................] duration: 2.09337393s FAIL (2025-08-11 22:23:25 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after d295b8eeb563de4b48b879f424f9ad08c7fb4dd3bebf44de27a7ca55039b02cb != before 8ab40e22d894e0fc1b2b6af3e54ab06e9aa1481b89a729d8b5523518ea3a89da ======LOGS====== Aug 11 22:11:29.756339814 (76h45m24.187419945s) [upload=80005]: Starting upload Aug 11 22:11:29.756390561 (76h45m24.187470683s) [upload=80005]: Done starting upload Aug 11 22:11:29.756461917 (76h45m24.187542038s) [upload=80005]: Uploading segments... Aug 11 22:11:29.756603629 (76h45m24.18768377s) [upload=80005]: Got next segment. Inline: true Aug 11 22:11:29.756615802 (76h45m24.187695933s) [upload=80005]: Waiting for error group managing segments... Aug 11 22:11:29.756677580 (76h45m24.187757711s) [upload=80005]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:11:29.756683782 (76h45m24.187763913s) [upload=80005]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 22:11:29.756686688 (76h45m24.187766819s) [upload=80005]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:11:30.039257370 (76h45m24.470337501s) [upload=80005]: Done uploading segments... Aug 11 22:11:30.039274463 (76h45m24.470354594s) [upload=80005]: Upload finished. err: <nil> Duration:* 2.0934001s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [X.........................................X.X...............] duration: 1.965807508s FAIL (2025-08-11 22:23:06 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after d295b8eeb563de4b48b879f424f9ad08c7fb4dd3bebf44de27a7ca55039b02cb != before 8ab40e22d894e0fc1b2b6af3e54ab06e9aa1481b89a729d8b5523518ea3a89da ======LOGS====== Aug 11 22:11:29.756339814 (76h45m24.187419945s) [upload=80005]: Starting upload Aug 11 22:11:29.756390561 (76h45m24.187470683s) [upload=80005]: Done starting upload Aug 11 22:11:29.756461917 (76h45m24.187542038s) [upload=80005]: Uploading segments... Aug 11 22:11:29.756603629 (76h45m24.18768377s) [upload=80005]: Got next segment. Inline: true Aug 11 22:11:29.756615802 (76h45m24.187695933s) [upload=80005]: Waiting for error group managing segments... Aug 11 22:11:29.756677580 (76h45m24.187757711s) [upload=80005]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:11:29.756683782 (76h45m24.187763913s) [upload=80005]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 22:11:29.756686688 (76h45m24.187766819s) [upload=80005]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:11:30.039257370 (76h45m24.470337501s) [upload=80005]: Done uploading segments... Aug 11 22:11:30.039274463 (76h45m24.470354594s) [upload=80005]: Upload finished. err: <nil> Duration:* 1.965833688s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [........X............X..............................X....X..] duration: 6.335930139s FAIL (2025-08-11 22:22:38 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 22:20:31.574625288 (76h54m26.005705419s) [upload=80162]: Starting upload Aug 11 22:20:31.574678641 (76h54m26.005758762s) [upload=80162]: Done starting upload Aug 11 22:20:31.574807807 (76h54m26.005887938s) [upload=80162]: Uploading segments... Aug 11 22:20:31.574925383 (76h54m26.006005514s) [upload=80162]: Got next segment. Inline: false Aug 11 22:20:31.574978033 (76h54m26.006058175s) [upload=80162]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:20:31.574984195 (76h54m26.006064326s) [upload=80162]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:20:32.026275643 (76h54m26.457355784s) [seg_pos={0 0}, upload=80162]: Begin upload segment... Aug 11 22:20:32.026336149 (76h54m26.45741628s) [seg_pos={0 0}, upload=80162]: Done begin upload segment. Aug 11 22:20:32.026364853 (76h54m26.457445015s) [noise=true , address=104.36.82.39:4726 , piece_id=P6KXVXBJB35DOM656QZ5FGM3BT2TXEPIIHROPB74O2DUVGGFTC4Q, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.026403458 (76h54m26.457483589s) [noise=true , address=104.36.82.4:4833 , piece_id=QWFWTTMK3J2RUOGRBE4KXAEZKR4ZIHQSQKG5DQNFMOYUX3EISRKA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.026702028 (76h54m26.457782159s) [noise=true , address=104.36.82.44:4881 , piece_id=5FOV2NBGOV4DWAP374W6ZTUQEVTKB7NZCAF6PETPKW3J2OXRYFZA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.026892152 (76h54m26.457972273s) [noise=true , address=104.36.82.37:4655 , piece_id=KZ4TE53475C6A7J76KYSLCJQY2FPSA765ZEHUYZ6AP7IVLEDPWQA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.026937660 (76h54m26.458017791s) [noise=true , address=104.36.82.18:4391 , piece_id=GBL5TYMJQLTU3VD4QGZDUGCNMCFTFTHSXXMBSC4UGKAFNWQMAVMA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.027173652 (76h54m26.458253773s) [noise=true , address=104.36.82.5:4868 , piece_id=OLLMACTMEK7YPD52IFAUDBXVWB7HAOVOKRDPRURVKLSYBHHUADWA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.027962971 (76h54m26.459043092s) [noise=true , address=104.36.82.3:4791 , piece_id=XFIV3AWJYDLGLCBSCYGXYGKJKFILJP2RE3XSPFXDQBIUGIO4DUVA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.028296229 (76h54m26.45937636s) [noise=true , address=64.49.13.140:4506 , piece_id=QEZVLMNSKUE3USGZ7V2G4RIP43KNJ3QUXACA34TF2UJY2X6WPOVQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.028559102 (76h54m26.459639223s) [noise=true , address=104.36.82.50:4013 , piece_id=NLMRU6XQQDO3TZ65JTJPRXIQW636OU6E547AFRXW4I7K32AWXPOQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.028812717 (76h54m26.459892838s) [noise=true , address=104.36.82.21:4494 , piece_id=K6ZZNIMGOUUK57X3FRG2UOIQSZ3LZNMEM6RARYTNDZXYBMACAJWA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.029064418 (76h54m26.460144539s) [noise=true , address=77.90.31.17:4791 , piece_id=OITGVAJE3KT7KZNQZPZROK64UH7X3DYX43QG7I5AT6LNM5FAA3WA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.029894658 (76h54m26.460974779s) [noise=true , address=104.36.82.46:4505 , piece_id=UKTBYDHNP3BHKGBM7YIMNO5FSD5BCLTJY3SDDF7LJ36HHMQVMNSQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.030316414 (76h54m26.461396545s) [noise=true , address=156.146.43.225:4461 , piece_id=TCWHADOK5P2YCXYMWBEIJVLNWR52UQXDHBEJHCBHMJOJEJSMSFUQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.030549089 (76h54m26.46162922s) [noise=true , address=104.36.82.61:4382 , piece_id=ZURJAZXSHDX6CRHYEAZCLPVCNADTQNRKO7SETLALVFZSZCS6I3UQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.030599746 (76h54m26.461679877s) [noise=true , address=104.36.82.38:4716 , piece_id=EU436Z7WJ4TMNMQA5LBYMMIYZPA7DGXBRV7Y4Z5LO75A3K53FYCQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.030833865 (76h54m26.461913986s) [noise=true , address=79.127.220.98:4423 , piece_id=RO4OG3I2MMYL2ULFLOJDG4TGN6NSA3ETUZ63NXHSWE3ZUTJEJOCA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.031060648 (76h54m26.462140779s) [noise=true , address=104.36.82.19:4425 , piece_id=RUH3QKTVKS6Q6MTLMF76AH62VCV2S6AVXRLMM72MLQCLEDFYBTDA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.031290207 (76h54m26.462370338s) [noise=true , address=104.36.82.14:4255 , piece_id=M5F55V4YVJ3MIWSJNJYFIIV4PBZDDNAIYDT42YFNWD7RTJGVPABA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:33.144545294 (76h54m27.575625425s) [upload=80162]: Next returned nil segment Aug 11 22:20:33.144561866 (76h54m27.575641997s) [upload=80162]: Waiting for error group managing segments... Aug 11 22:20:33.426713607 (76h54m27.857793738s) [noise=true , address=64.49.13.140:4506 , piece_id=QEZVLMNSKUE3USGZ7V2G4RIP43KNJ3QUXACA34TF2UJY2X6WPOVQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:33.881181071 (76h54m28.312261202s) [noise=true , address=79.127.220.98:4423 , piece_id=RO4OG3I2MMYL2ULFLOJDG4TGN6NSA3ETUZ63NXHSWE3ZUTJEJOCA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.000438465 (76h54m28.431518606s) [noise=true , address=104.36.82.61:4382 , piece_id=ZURJAZXSHDX6CRHYEAZCLPVCNADTQNRKO7SETLALVFZSZCS6I3UQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.028136351 (76h54m28.459216482s) [noise=true , address=104.36.82.19:4425 , piece_id=RUH3QKTVKS6Q6MTLMF76AH62VCV2S6AVXRLMM72MLQCLEDFYBTDA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.044195869 (76h54m28.475276001s) [noise=true , address=104.36.82.46:4505 , piece_id=UKTBYDHNP3BHKGBM7YIMNO5FSD5BCLTJY3SDDF7LJ36HHMQVMNSQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.074452992 (76h54m28.505533113s) [noise=true , address=77.90.31.17:4791 , piece_id=OITGVAJE3KT7KZNQZPZROK64UH7X3DYX43QG7I5AT6LNM5FAA3WA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.075748340 (76h54m28.506828471s) [noise=true , address=104.36.82.3:4791 , piece_id=XFIV3AWJYDLGLCBSCYGXYGKJKFILJP2RE3XSPFXDQBIUGIO4DUVA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.087394404 (76h54m28.518474535s) [noise=true , address=104.36.82.37:4655 , piece_id=KZ4TE53475C6A7J76KYSLCJQY2FPSA765ZEHUYZ6AP7IVLEDPWQA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.103935743 (76h54m28.535015874s) [noise=true , address=104.36.82.21:4494 , piece_id=K6ZZNIMGOUUK57X3FRG2UOIQSZ3LZNMEM6RARYTNDZXYBMACAJWA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.124051121 (76h54m28.555131262s) [noise=true , address=104.36.82.14:4255 , piece_id=M5F55V4YVJ3MIWSJNJYFIIV4PBZDDNAIYDT42YFNWD7RTJGVPABA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.177175989 (76h54m28.60825612s) [noise=true , address=104.36.82.4:4833 , piece_id=QWFWTTMK3J2RUOGRBE4KXAEZKR4ZIHQSQKG5DQNFMOYUX3EISRKA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.189359731 (76h54m28.620439862s) [noise=true , address=156.146.43.225:4461 , piece_id=TCWHADOK5P2YCXYMWBEIJVLNWR52UQXDHBEJHCBHMJOJEJSMSFUQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.196129264 (76h54m28.627209395s) [noise=true , address=104.36.82.5:4868 , piece_id=OLLMACTMEK7YPD52IFAUDBXVWB7HAOVOKRDPRURVKLSYBHHUADWA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.196547093 (76h54m28.627627234s) [noise=true , address=104.36.82.50:4013 , piece_id=NLMRU6XQQDO3TZ65JTJPRXIQW636OU6E547AFRXW4I7K32AWXPOQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.196609021 (76h54m28.627689163s) [seg_pos={0 0}, upload=80162]: Segment reached optimal threshold of 14 pieces. Aug 11 22:20:34.196768076 (76h54m28.627848207s) [noise=true , address=104.36.82.39:4726 , piece_id=P6KXVXBJB35DOM656QZ5FGM3BT2TXEPIIHROPB74O2DUVGGFTC4Q, seg_pos={0 0}, upload=80162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4): protocol: expected piece hash; context canceled; EOF Aug 11 22:20:34.196810928 (76h54m28.627891059s) [noise=true , address=104.36.82.18:4391 , piece_id=GBL5TYMJQLTU3VD4QGZDUGCNMCFTFTHSXXMBSC4UGKAFNWQMAVMA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MHmmjheT4VDX93MiQNzQyTWkxZFzz2PwNvdRfsevZRbj6qmJS): protocol: expected piece hash; context canceled; EOF Aug 11 22:20:34.196863489 (76h54m28.62794361s) [noise=true , address=104.36.82.44:4881 , piece_id=5FOV2NBGOV4DWAP374W6ZTUQEVTKB7NZCAF6PETPKW3J2OXRYFZA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 11 22:20:34.196931038 (76h54m28.628011169s) [noise=true , address=104.36.82.38:4716 , piece_id=EU436Z7WJ4TMNMQA5LBYMMIYZPA7DGXBRV7Y4Z5LO75A3K53FYCQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MAHcnhvjvD74dpLS5S3m751NzfjvJ8a9ZvHwA7mdXUEXm9DAX): protocol: expected piece hash; context canceled; EOF Aug 11 22:20:34.196948211 (76h54m28.628028332s) [seg_pos={0 0}, upload=80162]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:20:34.197022533 (76h54m28.628102664s) [upload=80162]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:20:34.197027934 (76h54m28.628108065s) [upload=80162]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:20:34.509243036 (76h54m28.940323177s) [upload=80162]: Done uploading segments... Aug 11 22:20:34.509266030 (76h54m28.940346171s) [upload=80162]: Upload finished. err: <nil> Duration: 6.335952873s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.X.........................................X.X..............] duration: 1.949377938s FAIL (2025-08-11 22:22:13 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after d295b8eeb563de4b48b879f424f9ad08c7fb4dd3bebf44de27a7ca55039b02cb != before 8ab40e22d894e0fc1b2b6af3e54ab06e9aa1481b89a729d8b5523518ea3a89da ======LOGS====== Aug 11 22:11:29.756339814 (76h45m24.187419945s) [upload=80005]: Starting upload Aug 11 22:11:29.756390561 (76h45m24.187470683s) [upload=80005]: Done starting upload Aug 11 22:11:29.756461917 (76h45m24.187542038s) [upload=80005]: Uploading segments... Aug 11 22:11:29.756603629 (76h45m24.18768377s) [upload=80005]: Got next segment. Inline: true Aug 11 22:11:29.756615802 (76h45m24.187695933s) [upload=80005]: Waiting for error group managing segments... Aug 11 22:11:29.756677580 (76h45m24.187757711s) [upload=80005]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:11:29.756683782 (76h45m24.187763913s) [upload=80005]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 22:11:29.756686688 (76h45m24.187766819s) [upload=80005]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:11:30.039257370 (76h45m24.470337501s) [upload=80005]: Done uploading segments... Aug 11 22:11:30.039274463 (76h45m24.470354594s) [upload=80005]: Upload finished. err: <nil> Duration:* 1.949404198s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [.........X............X..............................X....X.] duration: 6.40082393s FAIL (2025-08-11 22:21:33 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 22:20:31.574625288 (76h54m26.005705419s) [upload=80162]: Starting upload Aug 11 22:20:31.574678641 (76h54m26.005758762s) [upload=80162]: Done starting upload Aug 11 22:20:31.574807807 (76h54m26.005887938s) [upload=80162]: Uploading segments... Aug 11 22:20:31.574925383 (76h54m26.006005514s) [upload=80162]: Got next segment. Inline: false Aug 11 22:20:31.574978033 (76h54m26.006058175s) [upload=80162]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:20:31.574984195 (76h54m26.006064326s) [upload=80162]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:20:32.026275643 (76h54m26.457355784s) [seg_pos={0 0}, upload=80162]: Begin upload segment... Aug 11 22:20:32.026336149 (76h54m26.45741628s) [seg_pos={0 0}, upload=80162]: Done begin upload segment. Aug 11 22:20:32.026364853 (76h54m26.457445015s) [noise=true , address=104.36.82.39:4726 , piece_id=P6KXVXBJB35DOM656QZ5FGM3BT2TXEPIIHROPB74O2DUVGGFTC4Q, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.026403458 (76h54m26.457483589s) [noise=true , address=104.36.82.4:4833 , piece_id=QWFWTTMK3J2RUOGRBE4KXAEZKR4ZIHQSQKG5DQNFMOYUX3EISRKA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.026702028 (76h54m26.457782159s) [noise=true , address=104.36.82.44:4881 , piece_id=5FOV2NBGOV4DWAP374W6ZTUQEVTKB7NZCAF6PETPKW3J2OXRYFZA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.026892152 (76h54m26.457972273s) [noise=true , address=104.36.82.37:4655 , piece_id=KZ4TE53475C6A7J76KYSLCJQY2FPSA765ZEHUYZ6AP7IVLEDPWQA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.026937660 (76h54m26.458017791s) [noise=true , address=104.36.82.18:4391 , piece_id=GBL5TYMJQLTU3VD4QGZDUGCNMCFTFTHSXXMBSC4UGKAFNWQMAVMA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.027173652 (76h54m26.458253773s) [noise=true , address=104.36.82.5:4868 , piece_id=OLLMACTMEK7YPD52IFAUDBXVWB7HAOVOKRDPRURVKLSYBHHUADWA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.027962971 (76h54m26.459043092s) [noise=true , address=104.36.82.3:4791 , piece_id=XFIV3AWJYDLGLCBSCYGXYGKJKFILJP2RE3XSPFXDQBIUGIO4DUVA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.028296229 (76h54m26.45937636s) [noise=true , address=64.49.13.140:4506 , piece_id=QEZVLMNSKUE3USGZ7V2G4RIP43KNJ3QUXACA34TF2UJY2X6WPOVQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.028559102 (76h54m26.459639223s) [noise=true , address=104.36.82.50:4013 , piece_id=NLMRU6XQQDO3TZ65JTJPRXIQW636OU6E547AFRXW4I7K32AWXPOQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.028812717 (76h54m26.459892838s) [noise=true , address=104.36.82.21:4494 , piece_id=K6ZZNIMGOUUK57X3FRG2UOIQSZ3LZNMEM6RARYTNDZXYBMACAJWA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.029064418 (76h54m26.460144539s) [noise=true , address=77.90.31.17:4791 , piece_id=OITGVAJE3KT7KZNQZPZROK64UH7X3DYX43QG7I5AT6LNM5FAA3WA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.029894658 (76h54m26.460974779s) [noise=true , address=104.36.82.46:4505 , piece_id=UKTBYDHNP3BHKGBM7YIMNO5FSD5BCLTJY3SDDF7LJ36HHMQVMNSQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.030316414 (76h54m26.461396545s) [noise=true , address=156.146.43.225:4461 , piece_id=TCWHADOK5P2YCXYMWBEIJVLNWR52UQXDHBEJHCBHMJOJEJSMSFUQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.030549089 (76h54m26.46162922s) [noise=true , address=104.36.82.61:4382 , piece_id=ZURJAZXSHDX6CRHYEAZCLPVCNADTQNRKO7SETLALVFZSZCS6I3UQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.030599746 (76h54m26.461679877s) [noise=true , address=104.36.82.38:4716 , piece_id=EU436Z7WJ4TMNMQA5LBYMMIYZPA7DGXBRV7Y4Z5LO75A3K53FYCQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.030833865 (76h54m26.461913986s) [noise=true , address=79.127.220.98:4423 , piece_id=RO4OG3I2MMYL2ULFLOJDG4TGN6NSA3ETUZ63NXHSWE3ZUTJEJOCA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.031060648 (76h54m26.462140779s) [noise=true , address=104.36.82.19:4425 , piece_id=RUH3QKTVKS6Q6MTLMF76AH62VCV2S6AVXRLMM72MLQCLEDFYBTDA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.031290207 (76h54m26.462370338s) [noise=true , address=104.36.82.14:4255 , piece_id=M5F55V4YVJ3MIWSJNJYFIIV4PBZDDNAIYDT42YFNWD7RTJGVPABA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:33.144545294 (76h54m27.575625425s) [upload=80162]: Next returned nil segment Aug 11 22:20:33.144561866 (76h54m27.575641997s) [upload=80162]: Waiting for error group managing segments... Aug 11 22:20:33.426713607 (76h54m27.857793738s) [noise=true , address=64.49.13.140:4506 , piece_id=QEZVLMNSKUE3USGZ7V2G4RIP43KNJ3QUXACA34TF2UJY2X6WPOVQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:33.881181071 (76h54m28.312261202s) [noise=true , address=79.127.220.98:4423 , piece_id=RO4OG3I2MMYL2ULFLOJDG4TGN6NSA3ETUZ63NXHSWE3ZUTJEJOCA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.000438465 (76h54m28.431518606s) [noise=true , address=104.36.82.61:4382 , piece_id=ZURJAZXSHDX6CRHYEAZCLPVCNADTQNRKO7SETLALVFZSZCS6I3UQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.028136351 (76h54m28.459216482s) [noise=true , address=104.36.82.19:4425 , piece_id=RUH3QKTVKS6Q6MTLMF76AH62VCV2S6AVXRLMM72MLQCLEDFYBTDA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.044195869 (76h54m28.475276001s) [noise=true , address=104.36.82.46:4505 , piece_id=UKTBYDHNP3BHKGBM7YIMNO5FSD5BCLTJY3SDDF7LJ36HHMQVMNSQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.074452992 (76h54m28.505533113s) [noise=true , address=77.90.31.17:4791 , piece_id=OITGVAJE3KT7KZNQZPZROK64UH7X3DYX43QG7I5AT6LNM5FAA3WA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.075748340 (76h54m28.506828471s) [noise=true , address=104.36.82.3:4791 , piece_id=XFIV3AWJYDLGLCBSCYGXYGKJKFILJP2RE3XSPFXDQBIUGIO4DUVA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.087394404 (76h54m28.518474535s) [noise=true , address=104.36.82.37:4655 , piece_id=KZ4TE53475C6A7J76KYSLCJQY2FPSA765ZEHUYZ6AP7IVLEDPWQA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.103935743 (76h54m28.535015874s) [noise=true , address=104.36.82.21:4494 , piece_id=K6ZZNIMGOUUK57X3FRG2UOIQSZ3LZNMEM6RARYTNDZXYBMACAJWA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.124051121 (76h54m28.555131262s) [noise=true , address=104.36.82.14:4255 , piece_id=M5F55V4YVJ3MIWSJNJYFIIV4PBZDDNAIYDT42YFNWD7RTJGVPABA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.177175989 (76h54m28.60825612s) [noise=true , address=104.36.82.4:4833 , piece_id=QWFWTTMK3J2RUOGRBE4KXAEZKR4ZIHQSQKG5DQNFMOYUX3EISRKA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.189359731 (76h54m28.620439862s) [noise=true , address=156.146.43.225:4461 , piece_id=TCWHADOK5P2YCXYMWBEIJVLNWR52UQXDHBEJHCBHMJOJEJSMSFUQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.196129264 (76h54m28.627209395s) [noise=true , address=104.36.82.5:4868 , piece_id=OLLMACTMEK7YPD52IFAUDBXVWB7HAOVOKRDPRURVKLSYBHHUADWA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.196547093 (76h54m28.627627234s) [noise=true , address=104.36.82.50:4013 , piece_id=NLMRU6XQQDO3TZ65JTJPRXIQW636OU6E547AFRXW4I7K32AWXPOQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.196609021 (76h54m28.627689163s) [seg_pos={0 0}, upload=80162]: Segment reached optimal threshold of 14 pieces. Aug 11 22:20:34.196768076 (76h54m28.627848207s) [noise=true , address=104.36.82.39:4726 , piece_id=P6KXVXBJB35DOM656QZ5FGM3BT2TXEPIIHROPB74O2DUVGGFTC4Q, seg_pos={0 0}, upload=80162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4): protocol: expected piece hash; context canceled; EOF Aug 11 22:20:34.196810928 (76h54m28.627891059s) [noise=true , address=104.36.82.18:4391 , piece_id=GBL5TYMJQLTU3VD4QGZDUGCNMCFTFTHSXXMBSC4UGKAFNWQMAVMA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MHmmjheT4VDX93MiQNzQyTWkxZFzz2PwNvdRfsevZRbj6qmJS): protocol: expected piece hash; context canceled; EOF Aug 11 22:20:34.196863489 (76h54m28.62794361s) [noise=true , address=104.36.82.44:4881 , piece_id=5FOV2NBGOV4DWAP374W6ZTUQEVTKB7NZCAF6PETPKW3J2OXRYFZA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 11 22:20:34.196931038 (76h54m28.628011169s) [noise=true , address=104.36.82.38:4716 , piece_id=EU436Z7WJ4TMNMQA5LBYMMIYZPA7DGXBRV7Y4Z5LO75A3K53FYCQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MAHcnhvjvD74dpLS5S3m751NzfjvJ8a9ZvHwA7mdXUEXm9DAX): protocol: expected piece hash; context canceled; EOF Aug 11 22:20:34.196948211 (76h54m28.628028332s) [seg_pos={0 0}, upload=80162]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:20:34.197022533 (76h54m28.628102664s) [upload=80162]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:20:34.197027934 (76h54m28.628108065s) [upload=80162]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:20:34.509243036 (76h54m28.940323177s) [upload=80162]: Done uploading segments... Aug 11 22:20:34.509266030 (76h54m28.940346171s) [upload=80162]: Upload finished. err: <nil> Duration: 6.400861262s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..X.........................................X.X.............] duration: 2.014203826s FAIL (2025-08-11 22:21:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after d295b8eeb563de4b48b879f424f9ad08c7fb4dd3bebf44de27a7ca55039b02cb != before 8ab40e22d894e0fc1b2b6af3e54ab06e9aa1481b89a729d8b5523518ea3a89da ======LOGS====== Aug 11 22:11:29.756339814 (76h45m24.187419945s) [upload=80005]: Starting upload Aug 11 22:11:29.756390561 (76h45m24.187470683s) [upload=80005]: Done starting upload Aug 11 22:11:29.756461917 (76h45m24.187542038s) [upload=80005]: Uploading segments... Aug 11 22:11:29.756603629 (76h45m24.18768377s) [upload=80005]: Got next segment. Inline: true Aug 11 22:11:29.756615802 (76h45m24.187695933s) [upload=80005]: Waiting for error group managing segments... Aug 11 22:11:29.756677580 (76h45m24.187757711s) [upload=80005]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:11:29.756683782 (76h45m24.187763913s) [upload=80005]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 22:11:29.756686688 (76h45m24.187766819s) [upload=80005]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:11:30.039257370 (76h45m24.470337501s) [upload=80005]: Done uploading segments... Aug 11 22:11:30.039274463 (76h45m24.470354594s) [upload=80005]: Upload finished. err: <nil> Duration:* 2.014230417s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 4.151202562s FAIL (2025-08-11 22:21:05 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 17) ======LOGS====== 4SRO752OWZG4Q5T6CLSA, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:47.435217419 (76h14m41.86629755s) [noise=true , address=89.149.201.147:4001 , piece_id=RKJZS5OX3EUD3HGFCRBIUVORRKRBGZ2NMDUKCFPRZW2AGFBLKYDA, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:47.435490742 (76h14m41.866570873s) [noise=true , address=89.149.201.147:4016 , piece_id=XKZQCPO5CGT43AYUQQGKWRPWBZFNU3W2VKW2Y4D3B6CYRNWRB5LQ, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:47.435707035 (76h14m41.866787176s) [noise=true , address=89.149.201.147:4004 , piece_id=GKCEZV6XYZVKP5XMXGYXCDEESZW747VNHGJOYWK5JTQDXDT6RJTA, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:48.239516310 (76h14m42.670596441s) [upload=79474]: Next returned nil segment Aug 11 21:40:48.239549052 (76h14m42.670629173s) [upload=79474]: Waiting for error group managing segments... Aug 11 21:40:48.609972490 (76h14m43.041052621s) [noise=true , address=89.149.201.147:4008 , piece_id=PSP6FLFFPH6LWBEBPXOXF7BIXIEBPL6N5JJJGWKK7BDW5DV3B4VQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.614486426 (76h14m43.045566557s) [noise=true , address=89.149.201.147:4022 , piece_id=FSOKKKC75TFGUTPMR5G6555ICDWHIKNHDBP6B57OADUSHAPH6GDA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.616257926 (76h14m43.047338057s) [noise=true , address=89.149.201.147:4016 , piece_id=XKZQCPO5CGT43AYUQQGKWRPWBZFNU3W2VKW2Y4D3B6CYRNWRB5LQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.621293161 (76h14m43.052373282s) [noise=true , address=89.149.201.147:4004 , piece_id=GKCEZV6XYZVKP5XMXGYXCDEESZW747VNHGJOYWK5JTQDXDT6RJTA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.626661412 (76h14m43.057741543s) [noise=true , address=81.171.14.70:4038 , piece_id=Z64RWC56JGOQMCQWITBQR5OE3P3AYVVWQBHIY4K42AZCTI4AP5YA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.636033735 (76h14m43.067113866s) [noise=true , address=81.171.14.70:4026 , piece_id=4GNYVJ46JRDGYCZSZTXKHCDXTPPOYPJK73XAVZZN5UERRCV3XV6A, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.640209745 (76h14m43.071289876s) [noise=true , address=89.149.201.147:4012 , piece_id=I5YST5TWDCBXTW3XLBEZAG42NCQOCJ5VLSQ3O5BYGR5DUEPOMRBQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.642681474 (76h14m43.073761595s) [noise=true , address=89.149.201.147:4007 , piece_id=YDDPTURQWLPNJJHXOCESM64SEXF5AN37JSSQUUKY7HEDERFMSXWA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.645004419 (76h14m43.07608455s) [noise=true , address=89.149.201.147:4015 , piece_id=6D5FIUSLWJ3YGG4FNGV6EL5H47GNJN25GDMK57XH54JJPREGIRHA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.648884623 (76h14m43.079964754s) [noise=true , address=81.171.14.70:4027 , piece_id=4YKLDKWWINPAF3CRJDUFPDOS4QHL5IYOWIQT7ZOLGZYYXV33GUGQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.650426162 (76h14m43.081506293s) [noise=true , address=81.171.14.70:4032 , piece_id=7DBHWCTPKNTOQSMRI7Z23RPQWGDXQ5I2V4CGUGHFEWFP4P5KL74Q, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.650438025 (76h14m43.081518156s) [noise=true , address=89.149.201.147:4011 , piece_id=3MMNZVMZPGS77URWNUKRRBSX6NMTHIPMRRJWZ6RLLCPW2KXY2WEQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.652018830 (76h14m43.083098961s) [noise=true , address=81.171.14.70:4043 , piece_id=SPNWQM77OMTQPH36DH72T65IGAJP4JU6P52DTNRT3LJ4JVR3O6EQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.658234463 (76h14m43.089314594s) [noise=true , address=81.171.14.70:4047 , piece_id=E3ZKADZBMEO5T7X5HM6ZTLCIN5PQBFKNJSORWIJ4MPUNVRYLUNSA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.659300161 (76h14m43.090380292s) [noise=true , address=89.149.201.147:4001 , piece_id=RKJZS5OX3EUD3HGFCRBIUVORRKRBGZ2NMDUKCFPRZW2AGFBLKYDA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.660027774 (76h14m43.091107905s) [noise=true , address=81.171.14.70:4039 , piece_id=CLAXUB4OGSUJ3WFV7EAVCCRQLRYYOULWECFPEIJOHNDS2DYNCCTQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.679805807 (76h14m43.110885938s) [noise=true , address=81.171.14.70:4045 , piece_id=H3BKI4JHRL7BEBIBWTJZNYU63S3PRCQO7FQPR6QCADJT6IZAY2JA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:41:46.602808629 (76h15m41.03388876s) [noise=true , address=185.167.204.205:4013 , piece_id=G5VQFVD74USTWPZQANS3DS3GVZKNQHBQ32CG6GM2BVNJQJBZX7JQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602837273 (76h15m41.033917394s) [noise=true , address=185.167.204.205:4009 , piece_id=M7GYQHCX6ZAOX2FTDV2WOD3LTT4UYXYGMUKRO5TWMA6RJZW5XTUA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602856751 (76h15m41.033936872s) [noise=true , address=185.167.204.206:4037 , piece_id=WOOJ4QNO6V2QERDBHC76CE7ZINRYOYHJ2UPHMNYSWUHNV436NXAA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12nEq1PMWr39K5LBUcViEtEb1KTnsJLjMaBbNGuqpc13WdZb18R, address:185.167.204.206:4037): protocol: write tcp 188.166.225.170:45748->185.167.204.206:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602871879 (76h15m41.033952s) [noise=true , address=185.167.204.205:4032 , piece_id=7SYA6MKGKBW4NSJHD3BUVYPCMNHTKF3VO2MSMWYUE3G3G2ZCEJBA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602890335 (76h15m41.033970456s) [noise=true , address=185.167.204.206:4038 , piece_id=3NI34S2BMRUFFWWCURLWDYQBIR5VDTZCLE5JSZNZX2JFMJQC3FKQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: rpc: dial tcp 185.167.204.206:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602901646 (76h15m41.033981777s) [noise=true , address=185.167.204.205:4023 , piece_id=FFNPVDRQSVZFKPRE5IQCEHMUA3SBZZV4XC4QJESNRUZQLPSEGZ2Q, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: rpc: dial tcp 185.167.204.205:4023: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602919721 (76h15m41.033999852s) [noise=true , address=185.167.204.206:4072 , piece_id=NTKD7PR6XECRZXUZA767CXZY7VYIFLPM2RENI5ZP3TDU6UVXFM4Q, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: rpc: dial tcp 185.167.204.206:4072: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602932555 (76h15m41.034012686s) [noise=true , address=185.167.204.205:4014 , piece_id=NLF3JAJEOLTK4FPIHPQ4QCBHWQKW2AVGSWCOJDMMOGHSI6EUCBOQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602949328 (76h15m41.034029449s) [noise=true , address=185.167.204.205:4011 , piece_id=UJCY3N7L4OUJL5LZFS6GVER3RDEWZMZTJTZRD3CD4JFQRUZM32UA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: write tcp 188.166.225.170:50060->185.167.204.205:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602962153 (76h15m41.034042284s) [noise=true , address=185.167.204.206:4052 , piece_id=OZW7EGYLJ24I7UYQ357XMBRAMVPALBC3L2MT3YU6SN3MGGC767QQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602981068 (76h15m41.034061199s) [noise=true , address=185.167.204.206:4041 , piece_id=LSRJUXV7L2VGR6XOF74R6HG5QLXBNXNF4SRO752OWZG4Q5T6CLSA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.603000215 (76h15m41.034080346s) [seg_pos={0 0}, upload=79474]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil> Aug 11 21:41:46.778560597 (76h15m41.209640728s) [upload=79474]: Done uploading segments... Aug 11 21:41:46.778585545 (76h15m41.209665676s) [upload=79474]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17) Duration: 4.151234093s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...X.........................................X.X............] duration: 1.869520995s FAIL (2025-08-11 22:20:49 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after d295b8eeb563de4b48b879f424f9ad08c7fb4dd3bebf44de27a7ca55039b02cb != before 8ab40e22d894e0fc1b2b6af3e54ab06e9aa1481b89a729d8b5523518ea3a89da ======LOGS====== Aug 11 22:11:29.756339814 (76h45m24.187419945s) [upload=80005]: Starting upload Aug 11 22:11:29.756390561 (76h45m24.187470683s) [upload=80005]: Done starting upload Aug 11 22:11:29.756461917 (76h45m24.187542038s) [upload=80005]: Uploading segments... Aug 11 22:11:29.756603629 (76h45m24.18768377s) [upload=80005]: Got next segment. Inline: true Aug 11 22:11:29.756615802 (76h45m24.187695933s) [upload=80005]: Waiting for error group managing segments... Aug 11 22:11:29.756677580 (76h45m24.187757711s) [upload=80005]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:11:29.756683782 (76h45m24.187763913s) [upload=80005]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 22:11:29.756686688 (76h45m24.187766819s) [upload=80005]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:11:30.039257370 (76h45m24.470337501s) [upload=80005]: Done uploading segments... Aug 11 22:11:30.039274463 (76h45m24.470354594s) [upload=80005]: Upload finished. err: <nil> Duration:* 1.869547758s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 4 out of 60 is failed (threshold=3) [..........X............X..............................X....X] duration: 4.033969213s FAIL (2025-08-11 22:20:34 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M ======LOGS====== Aug 11 22:20:31.574625288 (76h54m26.005705419s) [upload=80162]: Starting upload Aug 11 22:20:31.574678641 (76h54m26.005758762s) [upload=80162]: Done starting upload Aug 11 22:20:31.574807807 (76h54m26.005887938s) [upload=80162]: Uploading segments... Aug 11 22:20:31.574925383 (76h54m26.006005514s) [upload=80162]: Got next segment. Inline: false Aug 11 22:20:31.574978033 (76h54m26.006058175s) [upload=80162]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:20:31.574984195 (76h54m26.006064326s) [upload=80162]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:20:32.026275643 (76h54m26.457355784s) [seg_pos={0 0}, upload=80162]: Begin upload segment... Aug 11 22:20:32.026336149 (76h54m26.45741628s) [seg_pos={0 0}, upload=80162]: Done begin upload segment. Aug 11 22:20:32.026364853 (76h54m26.457445015s) [noise=true , address=104.36.82.39:4726 , piece_id=P6KXVXBJB35DOM656QZ5FGM3BT2TXEPIIHROPB74O2DUVGGFTC4Q, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.026403458 (76h54m26.457483589s) [noise=true , address=104.36.82.4:4833 , piece_id=QWFWTTMK3J2RUOGRBE4KXAEZKR4ZIHQSQKG5DQNFMOYUX3EISRKA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.026702028 (76h54m26.457782159s) [noise=true , address=104.36.82.44:4881 , piece_id=5FOV2NBGOV4DWAP374W6ZTUQEVTKB7NZCAF6PETPKW3J2OXRYFZA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.026892152 (76h54m26.457972273s) [noise=true , address=104.36.82.37:4655 , piece_id=KZ4TE53475C6A7J76KYSLCJQY2FPSA765ZEHUYZ6AP7IVLEDPWQA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.026937660 (76h54m26.458017791s) [noise=true , address=104.36.82.18:4391 , piece_id=GBL5TYMJQLTU3VD4QGZDUGCNMCFTFTHSXXMBSC4UGKAFNWQMAVMA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.027173652 (76h54m26.458253773s) [noise=true , address=104.36.82.5:4868 , piece_id=OLLMACTMEK7YPD52IFAUDBXVWB7HAOVOKRDPRURVKLSYBHHUADWA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.027962971 (76h54m26.459043092s) [noise=true , address=104.36.82.3:4791 , piece_id=XFIV3AWJYDLGLCBSCYGXYGKJKFILJP2RE3XSPFXDQBIUGIO4DUVA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.028296229 (76h54m26.45937636s) [noise=true , address=64.49.13.140:4506 , piece_id=QEZVLMNSKUE3USGZ7V2G4RIP43KNJ3QUXACA34TF2UJY2X6WPOVQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.028559102 (76h54m26.459639223s) [noise=true , address=104.36.82.50:4013 , piece_id=NLMRU6XQQDO3TZ65JTJPRXIQW636OU6E547AFRXW4I7K32AWXPOQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.028812717 (76h54m26.459892838s) [noise=true , address=104.36.82.21:4494 , piece_id=K6ZZNIMGOUUK57X3FRG2UOIQSZ3LZNMEM6RARYTNDZXYBMACAJWA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.029064418 (76h54m26.460144539s) [noise=true , address=77.90.31.17:4791 , piece_id=OITGVAJE3KT7KZNQZPZROK64UH7X3DYX43QG7I5AT6LNM5FAA3WA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.029894658 (76h54m26.460974779s) [noise=true , address=104.36.82.46:4505 , piece_id=UKTBYDHNP3BHKGBM7YIMNO5FSD5BCLTJY3SDDF7LJ36HHMQVMNSQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.030316414 (76h54m26.461396545s) [noise=true , address=156.146.43.225:4461 , piece_id=TCWHADOK5P2YCXYMWBEIJVLNWR52UQXDHBEJHCBHMJOJEJSMSFUQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.030549089 (76h54m26.46162922s) [noise=true , address=104.36.82.61:4382 , piece_id=ZURJAZXSHDX6CRHYEAZCLPVCNADTQNRKO7SETLALVFZSZCS6I3UQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.030599746 (76h54m26.461679877s) [noise=true , address=104.36.82.38:4716 , piece_id=EU436Z7WJ4TMNMQA5LBYMMIYZPA7DGXBRV7Y4Z5LO75A3K53FYCQ, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.030833865 (76h54m26.461913986s) [noise=true , address=79.127.220.98:4423 , piece_id=RO4OG3I2MMYL2ULFLOJDG4TGN6NSA3ETUZ63NXHSWE3ZUTJEJOCA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.031060648 (76h54m26.462140779s) [noise=true , address=104.36.82.19:4425 , piece_id=RUH3QKTVKS6Q6MTLMF76AH62VCV2S6AVXRLMM72MLQCLEDFYBTDA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:32.031290207 (76h54m26.462370338s) [noise=true , address=104.36.82.14:4255 , piece_id=M5F55V4YVJ3MIWSJNJYFIIV4PBZDDNAIYDT42YFNWD7RTJGVPABA, seg_pos={0 0}, upload=80162]: Uploading piece... Aug 11 22:20:33.144545294 (76h54m27.575625425s) [upload=80162]: Next returned nil segment Aug 11 22:20:33.144561866 (76h54m27.575641997s) [upload=80162]: Waiting for error group managing segments... Aug 11 22:20:33.426713607 (76h54m27.857793738s) [noise=true , address=64.49.13.140:4506 , piece_id=QEZVLMNSKUE3USGZ7V2G4RIP43KNJ3QUXACA34TF2UJY2X6WPOVQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:33.881181071 (76h54m28.312261202s) [noise=true , address=79.127.220.98:4423 , piece_id=RO4OG3I2MMYL2ULFLOJDG4TGN6NSA3ETUZ63NXHSWE3ZUTJEJOCA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.000438465 (76h54m28.431518606s) [noise=true , address=104.36.82.61:4382 , piece_id=ZURJAZXSHDX6CRHYEAZCLPVCNADTQNRKO7SETLALVFZSZCS6I3UQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.028136351 (76h54m28.459216482s) [noise=true , address=104.36.82.19:4425 , piece_id=RUH3QKTVKS6Q6MTLMF76AH62VCV2S6AVXRLMM72MLQCLEDFYBTDA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.044195869 (76h54m28.475276001s) [noise=true , address=104.36.82.46:4505 , piece_id=UKTBYDHNP3BHKGBM7YIMNO5FSD5BCLTJY3SDDF7LJ36HHMQVMNSQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.074452992 (76h54m28.505533113s) [noise=true , address=77.90.31.17:4791 , piece_id=OITGVAJE3KT7KZNQZPZROK64UH7X3DYX43QG7I5AT6LNM5FAA3WA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.075748340 (76h54m28.506828471s) [noise=true , address=104.36.82.3:4791 , piece_id=XFIV3AWJYDLGLCBSCYGXYGKJKFILJP2RE3XSPFXDQBIUGIO4DUVA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.087394404 (76h54m28.518474535s) [noise=true , address=104.36.82.37:4655 , piece_id=KZ4TE53475C6A7J76KYSLCJQY2FPSA765ZEHUYZ6AP7IVLEDPWQA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.103935743 (76h54m28.535015874s) [noise=true , address=104.36.82.21:4494 , piece_id=K6ZZNIMGOUUK57X3FRG2UOIQSZ3LZNMEM6RARYTNDZXYBMACAJWA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.124051121 (76h54m28.555131262s) [noise=true , address=104.36.82.14:4255 , piece_id=M5F55V4YVJ3MIWSJNJYFIIV4PBZDDNAIYDT42YFNWD7RTJGVPABA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.177175989 (76h54m28.60825612s) [noise=true , address=104.36.82.4:4833 , piece_id=QWFWTTMK3J2RUOGRBE4KXAEZKR4ZIHQSQKG5DQNFMOYUX3EISRKA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.189359731 (76h54m28.620439862s) [noise=true , address=156.146.43.225:4461 , piece_id=TCWHADOK5P2YCXYMWBEIJVLNWR52UQXDHBEJHCBHMJOJEJSMSFUQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.196129264 (76h54m28.627209395s) [noise=true , address=104.36.82.5:4868 , piece_id=OLLMACTMEK7YPD52IFAUDBXVWB7HAOVOKRDPRURVKLSYBHHUADWA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.196547093 (76h54m28.627627234s) [noise=true , address=104.36.82.50:4013 , piece_id=NLMRU6XQQDO3TZ65JTJPRXIQW636OU6E547AFRXW4I7K32AWXPOQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: <nil> Aug 11 22:20:34.196609021 (76h54m28.627689163s) [seg_pos={0 0}, upload=80162]: Segment reached optimal threshold of 14 pieces. Aug 11 22:20:34.196768076 (76h54m28.627848207s) [noise=true , address=104.36.82.39:4726 , piece_id=P6KXVXBJB35DOM656QZ5FGM3BT2TXEPIIHROPB74O2DUVGGFTC4Q, seg_pos={0 0}, upload=80162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ACUxMRYJG7bzfXw6i1ioF6FSzbQvuWmZgrgcH8XhCxcncycL4): protocol: expected piece hash; context canceled; EOF Aug 11 22:20:34.196810928 (76h54m28.627891059s) [noise=true , address=104.36.82.18:4391 , piece_id=GBL5TYMJQLTU3VD4QGZDUGCNMCFTFTHSXXMBSC4UGKAFNWQMAVMA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MHmmjheT4VDX93MiQNzQyTWkxZFzz2PwNvdRfsevZRbj6qmJS): protocol: expected piece hash; context canceled; EOF Aug 11 22:20:34.196863489 (76h54m28.62794361s) [noise=true , address=104.36.82.44:4881 , piece_id=5FOV2NBGOV4DWAP374W6ZTUQEVTKB7NZCAF6PETPKW3J2OXRYFZA, seg_pos={0 0}, upload=80162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF Aug 11 22:20:34.196931038 (76h54m28.628011169s) [noise=true , address=104.36.82.38:4716 , piece_id=EU436Z7WJ4TMNMQA5LBYMMIYZPA7DGXBRV7Y4Z5LO75A3K53FYCQ, seg_pos={0 0}, upload=80162]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MAHcnhvjvD74dpLS5S3m751NzfjvJ8a9ZvHwA7mdXUEXm9DAX): protocol: expected piece hash; context canceled; EOF Aug 11 22:20:34.196948211 (76h54m28.628028332s) [seg_pos={0 0}, upload=80162]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:20:34.197022533 (76h54m28.628102664s) [upload=80162]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:20:34.197027934 (76h54m28.628108065s) [upload=80162]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:20:34.509243036 (76h54m28.940323177s) [upload=80162]: Done uploading segments... Aug 11 22:20:34.509266030 (76h54m28.940346171s) [upload=80162]: Upload finished. err: <nil> Duration: 4.034001234s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [XX..........................................................] duration: 4.263956495s FAIL (2025-08-11 22:20:27 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 17) ======LOGS====== 4SRO752OWZG4Q5T6CLSA, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:47.435217419 (76h14m41.86629755s) [noise=true , address=89.149.201.147:4001 , piece_id=RKJZS5OX3EUD3HGFCRBIUVORRKRBGZ2NMDUKCFPRZW2AGFBLKYDA, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:47.435490742 (76h14m41.866570873s) [noise=true , address=89.149.201.147:4016 , piece_id=XKZQCPO5CGT43AYUQQGKWRPWBZFNU3W2VKW2Y4D3B6CYRNWRB5LQ, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:47.435707035 (76h14m41.866787176s) [noise=true , address=89.149.201.147:4004 , piece_id=GKCEZV6XYZVKP5XMXGYXCDEESZW747VNHGJOYWK5JTQDXDT6RJTA, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:48.239516310 (76h14m42.670596441s) [upload=79474]: Next returned nil segment Aug 11 21:40:48.239549052 (76h14m42.670629173s) [upload=79474]: Waiting for error group managing segments... Aug 11 21:40:48.609972490 (76h14m43.041052621s) [noise=true , address=89.149.201.147:4008 , piece_id=PSP6FLFFPH6LWBEBPXOXF7BIXIEBPL6N5JJJGWKK7BDW5DV3B4VQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.614486426 (76h14m43.045566557s) [noise=true , address=89.149.201.147:4022 , piece_id=FSOKKKC75TFGUTPMR5G6555ICDWHIKNHDBP6B57OADUSHAPH6GDA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.616257926 (76h14m43.047338057s) [noise=true , address=89.149.201.147:4016 , piece_id=XKZQCPO5CGT43AYUQQGKWRPWBZFNU3W2VKW2Y4D3B6CYRNWRB5LQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.621293161 (76h14m43.052373282s) [noise=true , address=89.149.201.147:4004 , piece_id=GKCEZV6XYZVKP5XMXGYXCDEESZW747VNHGJOYWK5JTQDXDT6RJTA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.626661412 (76h14m43.057741543s) [noise=true , address=81.171.14.70:4038 , piece_id=Z64RWC56JGOQMCQWITBQR5OE3P3AYVVWQBHIY4K42AZCTI4AP5YA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.636033735 (76h14m43.067113866s) [noise=true , address=81.171.14.70:4026 , piece_id=4GNYVJ46JRDGYCZSZTXKHCDXTPPOYPJK73XAVZZN5UERRCV3XV6A, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.640209745 (76h14m43.071289876s) [noise=true , address=89.149.201.147:4012 , piece_id=I5YST5TWDCBXTW3XLBEZAG42NCQOCJ5VLSQ3O5BYGR5DUEPOMRBQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.642681474 (76h14m43.073761595s) [noise=true , address=89.149.201.147:4007 , piece_id=YDDPTURQWLPNJJHXOCESM64SEXF5AN37JSSQUUKY7HEDERFMSXWA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.645004419 (76h14m43.07608455s) [noise=true , address=89.149.201.147:4015 , piece_id=6D5FIUSLWJ3YGG4FNGV6EL5H47GNJN25GDMK57XH54JJPREGIRHA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.648884623 (76h14m43.079964754s) [noise=true , address=81.171.14.70:4027 , piece_id=4YKLDKWWINPAF3CRJDUFPDOS4QHL5IYOWIQT7ZOLGZYYXV33GUGQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.650426162 (76h14m43.081506293s) [noise=true , address=81.171.14.70:4032 , piece_id=7DBHWCTPKNTOQSMRI7Z23RPQWGDXQ5I2V4CGUGHFEWFP4P5KL74Q, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.650438025 (76h14m43.081518156s) [noise=true , address=89.149.201.147:4011 , piece_id=3MMNZVMZPGS77URWNUKRRBSX6NMTHIPMRRJWZ6RLLCPW2KXY2WEQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.652018830 (76h14m43.083098961s) [noise=true , address=81.171.14.70:4043 , piece_id=SPNWQM77OMTQPH36DH72T65IGAJP4JU6P52DTNRT3LJ4JVR3O6EQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.658234463 (76h14m43.089314594s) [noise=true , address=81.171.14.70:4047 , piece_id=E3ZKADZBMEO5T7X5HM6ZTLCIN5PQBFKNJSORWIJ4MPUNVRYLUNSA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.659300161 (76h14m43.090380292s) [noise=true , address=89.149.201.147:4001 , piece_id=RKJZS5OX3EUD3HGFCRBIUVORRKRBGZ2NMDUKCFPRZW2AGFBLKYDA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.660027774 (76h14m43.091107905s) [noise=true , address=81.171.14.70:4039 , piece_id=CLAXUB4OGSUJ3WFV7EAVCCRQLRYYOULWECFPEIJOHNDS2DYNCCTQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.679805807 (76h14m43.110885938s) [noise=true , address=81.171.14.70:4045 , piece_id=H3BKI4JHRL7BEBIBWTJZNYU63S3PRCQO7FQPR6QCADJT6IZAY2JA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:41:46.602808629 (76h15m41.03388876s) [noise=true , address=185.167.204.205:4013 , piece_id=G5VQFVD74USTWPZQANS3DS3GVZKNQHBQ32CG6GM2BVNJQJBZX7JQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602837273 (76h15m41.033917394s) [noise=true , address=185.167.204.205:4009 , piece_id=M7GYQHCX6ZAOX2FTDV2WOD3LTT4UYXYGMUKRO5TWMA6RJZW5XTUA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602856751 (76h15m41.033936872s) [noise=true , address=185.167.204.206:4037 , piece_id=WOOJ4QNO6V2QERDBHC76CE7ZINRYOYHJ2UPHMNYSWUHNV436NXAA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12nEq1PMWr39K5LBUcViEtEb1KTnsJLjMaBbNGuqpc13WdZb18R, address:185.167.204.206:4037): protocol: write tcp 188.166.225.170:45748->185.167.204.206:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602871879 (76h15m41.033952s) [noise=true , address=185.167.204.205:4032 , piece_id=7SYA6MKGKBW4NSJHD3BUVYPCMNHTKF3VO2MSMWYUE3G3G2ZCEJBA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602890335 (76h15m41.033970456s) [noise=true , address=185.167.204.206:4038 , piece_id=3NI34S2BMRUFFWWCURLWDYQBIR5VDTZCLE5JSZNZX2JFMJQC3FKQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: rpc: dial tcp 185.167.204.206:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602901646 (76h15m41.033981777s) [noise=true , address=185.167.204.205:4023 , piece_id=FFNPVDRQSVZFKPRE5IQCEHMUA3SBZZV4XC4QJESNRUZQLPSEGZ2Q, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: rpc: dial tcp 185.167.204.205:4023: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602919721 (76h15m41.033999852s) [noise=true , address=185.167.204.206:4072 , piece_id=NTKD7PR6XECRZXUZA767CXZY7VYIFLPM2RENI5ZP3TDU6UVXFM4Q, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: rpc: dial tcp 185.167.204.206:4072: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602932555 (76h15m41.034012686s) [noise=true , address=185.167.204.205:4014 , piece_id=NLF3JAJEOLTK4FPIHPQ4QCBHWQKW2AVGSWCOJDMMOGHSI6EUCBOQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602949328 (76h15m41.034029449s) [noise=true , address=185.167.204.205:4011 , piece_id=UJCY3N7L4OUJL5LZFS6GVER3RDEWZMZTJTZRD3CD4JFQRUZM32UA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: write tcp 188.166.225.170:50060->185.167.204.205:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602962153 (76h15m41.034042284s) [noise=true , address=185.167.204.206:4052 , piece_id=OZW7EGYLJ24I7UYQ357XMBRAMVPALBC3L2MT3YU6SN3MGGC767QQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602981068 (76h15m41.034061199s) [noise=true , address=185.167.204.206:4041 , piece_id=LSRJUXV7L2VGR6XOF74R6HG5QLXBNXNF4SRO752OWZG4Q5T6CLSA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.603000215 (76h15m41.034080346s) [seg_pos={0 0}, upload=79474]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil> Aug 11 21:41:46.778560597 (76h15m41.209640728s) [upload=79474]: Done uploading segments... Aug 11 21:41:46.778585545 (76h15m41.209665676s) [upload=79474]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17) Duration: 4.263984579s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........X............X..............................X....] duration: 7.429020954s FAIL (2025-08-11 22:20:19 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 756734e5fe5aacc912a117be42418de9d74c6a969be799843b3b6e158dbae1f0 != before f90f0abc2f6e52593c1b4257def406a4152737656ca4e5dcff878c955ea374b9 ======LOGS====== Aug 11 22:17:45.390768560 (76h51m39.821848691s) [upload=80112]: Starting upload Aug 11 22:17:45.390818554 (76h51m39.821898685s) [upload=80112]: Done starting upload Aug 11 22:17:45.390934647 (76h51m39.822014788s) [upload=80112]: Uploading segments... Aug 11 22:17:45.391041151 (76h51m39.822121292s) [upload=80112]: Got next segment. Inline: false Aug 11 22:17:45.391085936 (76h51m39.822166067s) [upload=80112]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:17:45.391091447 (76h51m39.822171578s) [upload=80112]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:17:46.020620439 (76h51m40.45170057s) [seg_pos={0 0}, upload=80112]: Begin upload segment... Aug 11 22:17:46.020671556 (76h51m40.451751677s) [seg_pos={0 0}, upload=80112]: Done begin upload segment. Aug 11 22:17:46.020692717 (76h51m40.451772848s) [noise=true , address=64.49.13.27:4959 , piece_id=KV4U2P4NBCIRPF4NLH6EIHEFRH5GVGRSH3LB2F7HIHEN2FDBUJBA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.020733225 (76h51m40.451813356s) [noise=true , address=104.36.82.46:4492 , piece_id=B4KBH2TWVFYYYNQHQEBYCDCHN3QQD5NP6TZFNNDWJM2I57ZLWYUA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.021078204 (76h51m40.452158335s) [noise=true , address=104.36.82.42:4827 , piece_id=WWRWBWREVJUV6LQD4APAHLAA7GVHXEWX4Y7TYOEUZ6WTMIOMPM7A, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.021162876 (76h51m40.452243007s) [noise=true , address=104.36.82.34:4564 , piece_id=PFBML5JMRRODB67EWDYGQCXM757GGPXAOOKWVXMAZQHQBVWCS5VQ, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.021351287 (76h51m40.452431418s) [noise=true , address=104.36.82.5:4846 , piece_id=GY6F7CCISK6M52RILLN443AFXDYFOXOYDQNMDOFEP7WZYP3OKV3A, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.021848057 (76h51m40.452928188s) [noise=true , address=104.36.82.62:4435 , piece_id=GG6LKKY5JG2U6MEJND4ZCGWLP6356HONFI7C5O46DKIXW7VFA33Q, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.021937329 (76h51m40.45301746s) [noise=true , address=104.36.82.9:4008 , piece_id=WBTKQQ5WCYIV4R6MG4TACIF7WI3TC7JAO6K35M3JPCQZ4CUZNP6Q, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.022384644 (76h51m40.453464775s) [noise=true , address=64.49.13.138:4487 , piece_id=VAXCN755CK6W5JIFKRN62IOM4V6SABWZ3I66A4NGH5DLBDBMLSKA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.022722891 (76h51m40.453803022s) [noise=true , address=79.127.205.234:4600 , piece_id=BJ2RSZYG2QZLAECCB6IV3QWNO7FUN5GYYMHX7OOOUANMNAJRBITA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.023272483 (76h51m40.454352614s) [noise=true , address=193.149.164.143:4693 , piece_id=UBXV6NRFCXIESASUMUBU5Z2ZDZVACL45JIPN5HW57NXIVS6Z3XVQ, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.023623805 (76h51m40.454703936s) [noise=true , address=64.49.13.170:4722 , piece_id=CYFRQQR567OT6UFWC2BTMNA6QP6VSZCAPKXM6F66GSOCFR3QF63Q, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.024032137 (76h51m40.455112268s) [noise=true , address=104.36.82.61:4402 , piece_id=YTLOBJSYCTQPFJNQGOOTFWOA4FBLVPH3CUUHDPP6Z2N6Q4XPLEOA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.024460216 (76h51m40.455540347s) [noise=true , address=104.36.82.8:4988 , piece_id=A74RKDTLNSF35O5BQMFBO3VZSM356IT7JOF72REVXMVQED4P7QAQ, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.024746373 (76h51m40.455826504s) [noise=true , address=104.36.82.17:4345 , piece_id=IIPOLWUADV7YO4ULANL3APTLQSA4ZFEDHQ63EWBKXY4DF6DX63DA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.034125720 (76h51m40.465205851s) [noise=true , address=104.36.82.23:4446 , piece_id=UM2YZ2JSGQIJ2BYPIY27HGUN6BOWSZVF7774XXZ63EC65NBWGETA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.034459087 (76h51m40.465539218s) [noise=true , address=104.36.82.19:4431 , piece_id=PKC6PDUCBM3G7KXNERVA74VCOOVMPKZMKVXJEK7XD3FRFEAYKRAQ, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.034747659 (76h51m40.46582778s) [noise=true , address=77.90.31.14:4678 , piece_id=YSRDQQGIGDI3MMLSC7A6ORWZJCE72U24RNFBLC5MB6OWRQHNLGSA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.035026874 (76h51m40.466107005s) [noise=true , address=104.36.82.18:4366 , piece_id=YJAPAERA6HCQQIK5Y3GGX2YF7MWT4SBWNPBG6GROXPRIUNWDIFDA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:47.173903245 (76h51m41.604983376s) [upload=80112]: Next returned nil segment Aug 11 22:17:47.173919425 (76h51m41.604999556s) [upload=80112]: Waiting for error group managing segments... Aug 11 22:17:47.490868386 (76h51m41.921948517s) [noise=true , address=64.49.13.138:4487 , piece_id=VAXCN755CK6W5JIFKRN62IOM4V6SABWZ3I66A4NGH5DLBDBMLSKA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:47.507960559 (76h51m41.93904068s) [noise=true , address=79.127.205.234:4600 , piece_id=BJ2RSZYG2QZLAECCB6IV3QWNO7FUN5GYYMHX7OOOUANMNAJRBITA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:47.544288628 (76h51m41.97536876s) [noise=true , address=64.49.13.170:4722 , piece_id=CYFRQQR567OT6UFWC2BTMNA6QP6VSZCAPKXM6F66GSOCFR3QF63Q, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:47.550382108 (76h51m41.981462239s) [noise=true , address=193.149.164.143:4693 , piece_id=UBXV6NRFCXIESASUMUBU5Z2ZDZVACL45JIPN5HW57NXIVS6Z3XVQ, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:47.556377930 (76h51m41.987458051s) [noise=true , address=64.49.13.27:4959 , piece_id=KV4U2P4NBCIRPF4NLH6EIHEFRH5GVGRSH3LB2F7HIHEN2FDBUJBA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.006078293 (76h51m42.437158434s) [noise=true , address=104.36.82.46:4492 , piece_id=B4KBH2TWVFYYYNQHQEBYCDCHN3QQD5NP6TZFNNDWJM2I57ZLWYUA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.011273122 (76h51m42.442353273s) [noise=true , address=104.36.82.62:4435 , piece_id=GG6LKKY5JG2U6MEJND4ZCGWLP6356HONFI7C5O46DKIXW7VFA33Q, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.019925798 (76h51m42.451005929s) [noise=true , address=104.36.82.23:4446 , piece_id=UM2YZ2JSGQIJ2BYPIY27HGUN6BOWSZVF7774XXZ63EC65NBWGETA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.095164618 (76h51m42.526244749s) [noise=true , address=104.36.82.34:4564 , piece_id=PFBML5JMRRODB67EWDYGQCXM757GGPXAOOKWVXMAZQHQBVWCS5VQ, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.130420175 (76h51m42.561500306s) [noise=true , address=104.36.82.9:4008 , piece_id=WBTKQQ5WCYIV4R6MG4TACIF7WI3TC7JAO6K35M3JPCQZ4CUZNP6Q, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.144363894 (76h51m42.575444026s) [noise=true , address=104.36.82.17:4345 , piece_id=IIPOLWUADV7YO4ULANL3APTLQSA4ZFEDHQ63EWBKXY4DF6DX63DA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.169714420 (76h51m42.600794551s) [noise=true , address=104.36.82.18:4366 , piece_id=YJAPAERA6HCQQIK5Y3GGX2YF7MWT4SBWNPBG6GROXPRIUNWDIFDA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.197368642 (76h51m42.628448763s) [noise=true , address=104.36.82.42:4827 , piece_id=WWRWBWREVJUV6LQD4APAHLAA7GVHXEWX4Y7TYOEUZ6WTMIOMPM7A, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.217110746 (76h51m42.648190867s) [noise=true , address=77.90.31.14:4678 , piece_id=YSRDQQGIGDI3MMLSC7A6ORWZJCE72U24RNFBLC5MB6OWRQHNLGSA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.217135393 (76h51m42.648215514s) [seg_pos={0 0}, upload=80112]: Segment reached optimal threshold of 14 pieces. Aug 11 22:17:48.217375642 (76h51m42.648455774s) [noise=true , address=104.36.82.5:4846 , piece_id=GY6F7CCISK6M52RILLN443AFXDYFOXOYDQNMDOFEP7WZYP3OKV3A, seg_pos={0 0}, upload=80112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 11 22:17:48.217408495 (76h51m42.648488626s) [noise=true , address=104.36.82.8:4988 , piece_id=A74RKDTLNSF35O5BQMFBO3VZSM356IT7JOF72REVXMVQED4P7QAQ, seg_pos={0 0}, upload=80112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Qs9EDisetfkwcMS8r1d1twWZoTzaz2QZAo2aJakM53ZyJs2Je): protocol: expected piece hash; context canceled; EOF Aug 11 22:17:48.217441529 (76h51m42.64852166s) [noise=true , address=104.36.82.19:4431 , piece_id=PKC6PDUCBM3G7KXNERVA74VCOOVMPKZMKVXJEK7XD3FRFEAYKRAQ, seg_pos={0 0}, upload=80112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12E2efGqgEca5TeZV1bWeH9fcQqrmdNwxuU6kMH26McLkLdxNGR): protocol: rpc: dial tcp 104.36.82.19:4431: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 22:17:48.217472859 (76h51m42.64855299s) [noise=true , address=104.36.82.61:4402 , piece_id=YTLOBJSYCTQPFJNQGOOTFWOA4FBLVPH3CUUHDPP6Z2N6Q4XPLEOA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122bkrGG8zk64AMrcY5h9Xynm2updzvAWsSuQi8tMnjSpQKzJVg): protocol: write tcp 188.166.225.170:55318->104.36.82.61:4402: use of closed network connection; write tcp 188.166.225.170:55318->104.36.82.61:4402: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55318->104.36.82.61:4402: use of closed network connection Aug 11 22:17:48.217488709 (76h51m42.64856884s) [seg_pos={0 0}, upload=80112]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:17:48.217545728 (76h51m42.648625859s) [upload=80112]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:17:48.217549456 (76h51m42.648629587s) [upload=80112]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:17:48.565497198 (76h51m42.996577329s) [upload=80112]: Done uploading segments... Aug 11 22:17:48.565517457 (76h51m42.996597588s) [upload=80112]: Upload finished. err: <nil> Duration: 7.429073032s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [............X............X..............................X...] duration: 6.266069698s FAIL (2025-08-11 22:19:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 756734e5fe5aacc912a117be42418de9d74c6a969be799843b3b6e158dbae1f0 != before f90f0abc2f6e52593c1b4257def406a4152737656ca4e5dcff878c955ea374b9 ======LOGS====== Aug 11 22:17:45.390768560 (76h51m39.821848691s) [upload=80112]: Starting upload Aug 11 22:17:45.390818554 (76h51m39.821898685s) [upload=80112]: Done starting upload Aug 11 22:17:45.390934647 (76h51m39.822014788s) [upload=80112]: Uploading segments... Aug 11 22:17:45.391041151 (76h51m39.822121292s) [upload=80112]: Got next segment. Inline: false Aug 11 22:17:45.391085936 (76h51m39.822166067s) [upload=80112]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:17:45.391091447 (76h51m39.822171578s) [upload=80112]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:17:46.020620439 (76h51m40.45170057s) [seg_pos={0 0}, upload=80112]: Begin upload segment... Aug 11 22:17:46.020671556 (76h51m40.451751677s) [seg_pos={0 0}, upload=80112]: Done begin upload segment. Aug 11 22:17:46.020692717 (76h51m40.451772848s) [noise=true , address=64.49.13.27:4959 , piece_id=KV4U2P4NBCIRPF4NLH6EIHEFRH5GVGRSH3LB2F7HIHEN2FDBUJBA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.020733225 (76h51m40.451813356s) [noise=true , address=104.36.82.46:4492 , piece_id=B4KBH2TWVFYYYNQHQEBYCDCHN3QQD5NP6TZFNNDWJM2I57ZLWYUA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.021078204 (76h51m40.452158335s) [noise=true , address=104.36.82.42:4827 , piece_id=WWRWBWREVJUV6LQD4APAHLAA7GVHXEWX4Y7TYOEUZ6WTMIOMPM7A, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.021162876 (76h51m40.452243007s) [noise=true , address=104.36.82.34:4564 , piece_id=PFBML5JMRRODB67EWDYGQCXM757GGPXAOOKWVXMAZQHQBVWCS5VQ, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.021351287 (76h51m40.452431418s) [noise=true , address=104.36.82.5:4846 , piece_id=GY6F7CCISK6M52RILLN443AFXDYFOXOYDQNMDOFEP7WZYP3OKV3A, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.021848057 (76h51m40.452928188s) [noise=true , address=104.36.82.62:4435 , piece_id=GG6LKKY5JG2U6MEJND4ZCGWLP6356HONFI7C5O46DKIXW7VFA33Q, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.021937329 (76h51m40.45301746s) [noise=true , address=104.36.82.9:4008 , piece_id=WBTKQQ5WCYIV4R6MG4TACIF7WI3TC7JAO6K35M3JPCQZ4CUZNP6Q, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.022384644 (76h51m40.453464775s) [noise=true , address=64.49.13.138:4487 , piece_id=VAXCN755CK6W5JIFKRN62IOM4V6SABWZ3I66A4NGH5DLBDBMLSKA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.022722891 (76h51m40.453803022s) [noise=true , address=79.127.205.234:4600 , piece_id=BJ2RSZYG2QZLAECCB6IV3QWNO7FUN5GYYMHX7OOOUANMNAJRBITA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.023272483 (76h51m40.454352614s) [noise=true , address=193.149.164.143:4693 , piece_id=UBXV6NRFCXIESASUMUBU5Z2ZDZVACL45JIPN5HW57NXIVS6Z3XVQ, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.023623805 (76h51m40.454703936s) [noise=true , address=64.49.13.170:4722 , piece_id=CYFRQQR567OT6UFWC2BTMNA6QP6VSZCAPKXM6F66GSOCFR3QF63Q, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.024032137 (76h51m40.455112268s) [noise=true , address=104.36.82.61:4402 , piece_id=YTLOBJSYCTQPFJNQGOOTFWOA4FBLVPH3CUUHDPP6Z2N6Q4XPLEOA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.024460216 (76h51m40.455540347s) [noise=true , address=104.36.82.8:4988 , piece_id=A74RKDTLNSF35O5BQMFBO3VZSM356IT7JOF72REVXMVQED4P7QAQ, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.024746373 (76h51m40.455826504s) [noise=true , address=104.36.82.17:4345 , piece_id=IIPOLWUADV7YO4ULANL3APTLQSA4ZFEDHQ63EWBKXY4DF6DX63DA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.034125720 (76h51m40.465205851s) [noise=true , address=104.36.82.23:4446 , piece_id=UM2YZ2JSGQIJ2BYPIY27HGUN6BOWSZVF7774XXZ63EC65NBWGETA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.034459087 (76h51m40.465539218s) [noise=true , address=104.36.82.19:4431 , piece_id=PKC6PDUCBM3G7KXNERVA74VCOOVMPKZMKVXJEK7XD3FRFEAYKRAQ, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.034747659 (76h51m40.46582778s) [noise=true , address=77.90.31.14:4678 , piece_id=YSRDQQGIGDI3MMLSC7A6ORWZJCE72U24RNFBLC5MB6OWRQHNLGSA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.035026874 (76h51m40.466107005s) [noise=true , address=104.36.82.18:4366 , piece_id=YJAPAERA6HCQQIK5Y3GGX2YF7MWT4SBWNPBG6GROXPRIUNWDIFDA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:47.173903245 (76h51m41.604983376s) [upload=80112]: Next returned nil segment Aug 11 22:17:47.173919425 (76h51m41.604999556s) [upload=80112]: Waiting for error group managing segments... Aug 11 22:17:47.490868386 (76h51m41.921948517s) [noise=true , address=64.49.13.138:4487 , piece_id=VAXCN755CK6W5JIFKRN62IOM4V6SABWZ3I66A4NGH5DLBDBMLSKA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:47.507960559 (76h51m41.93904068s) [noise=true , address=79.127.205.234:4600 , piece_id=BJ2RSZYG2QZLAECCB6IV3QWNO7FUN5GYYMHX7OOOUANMNAJRBITA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:47.544288628 (76h51m41.97536876s) [noise=true , address=64.49.13.170:4722 , piece_id=CYFRQQR567OT6UFWC2BTMNA6QP6VSZCAPKXM6F66GSOCFR3QF63Q, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:47.550382108 (76h51m41.981462239s) [noise=true , address=193.149.164.143:4693 , piece_id=UBXV6NRFCXIESASUMUBU5Z2ZDZVACL45JIPN5HW57NXIVS6Z3XVQ, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:47.556377930 (76h51m41.987458051s) [noise=true , address=64.49.13.27:4959 , piece_id=KV4U2P4NBCIRPF4NLH6EIHEFRH5GVGRSH3LB2F7HIHEN2FDBUJBA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.006078293 (76h51m42.437158434s) [noise=true , address=104.36.82.46:4492 , piece_id=B4KBH2TWVFYYYNQHQEBYCDCHN3QQD5NP6TZFNNDWJM2I57ZLWYUA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.011273122 (76h51m42.442353273s) [noise=true , address=104.36.82.62:4435 , piece_id=GG6LKKY5JG2U6MEJND4ZCGWLP6356HONFI7C5O46DKIXW7VFA33Q, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.019925798 (76h51m42.451005929s) [noise=true , address=104.36.82.23:4446 , piece_id=UM2YZ2JSGQIJ2BYPIY27HGUN6BOWSZVF7774XXZ63EC65NBWGETA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.095164618 (76h51m42.526244749s) [noise=true , address=104.36.82.34:4564 , piece_id=PFBML5JMRRODB67EWDYGQCXM757GGPXAOOKWVXMAZQHQBVWCS5VQ, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.130420175 (76h51m42.561500306s) [noise=true , address=104.36.82.9:4008 , piece_id=WBTKQQ5WCYIV4R6MG4TACIF7WI3TC7JAO6K35M3JPCQZ4CUZNP6Q, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.144363894 (76h51m42.575444026s) [noise=true , address=104.36.82.17:4345 , piece_id=IIPOLWUADV7YO4ULANL3APTLQSA4ZFEDHQ63EWBKXY4DF6DX63DA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.169714420 (76h51m42.600794551s) [noise=true , address=104.36.82.18:4366 , piece_id=YJAPAERA6HCQQIK5Y3GGX2YF7MWT4SBWNPBG6GROXPRIUNWDIFDA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.197368642 (76h51m42.628448763s) [noise=true , address=104.36.82.42:4827 , piece_id=WWRWBWREVJUV6LQD4APAHLAA7GVHXEWX4Y7TYOEUZ6WTMIOMPM7A, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.217110746 (76h51m42.648190867s) [noise=true , address=77.90.31.14:4678 , piece_id=YSRDQQGIGDI3MMLSC7A6ORWZJCE72U24RNFBLC5MB6OWRQHNLGSA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.217135393 (76h51m42.648215514s) [seg_pos={0 0}, upload=80112]: Segment reached optimal threshold of 14 pieces. Aug 11 22:17:48.217375642 (76h51m42.648455774s) [noise=true , address=104.36.82.5:4846 , piece_id=GY6F7CCISK6M52RILLN443AFXDYFOXOYDQNMDOFEP7WZYP3OKV3A, seg_pos={0 0}, upload=80112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 11 22:17:48.217408495 (76h51m42.648488626s) [noise=true , address=104.36.82.8:4988 , piece_id=A74RKDTLNSF35O5BQMFBO3VZSM356IT7JOF72REVXMVQED4P7QAQ, seg_pos={0 0}, upload=80112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Qs9EDisetfkwcMS8r1d1twWZoTzaz2QZAo2aJakM53ZyJs2Je): protocol: expected piece hash; context canceled; EOF Aug 11 22:17:48.217441529 (76h51m42.64852166s) [noise=true , address=104.36.82.19:4431 , piece_id=PKC6PDUCBM3G7KXNERVA74VCOOVMPKZMKVXJEK7XD3FRFEAYKRAQ, seg_pos={0 0}, upload=80112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12E2efGqgEca5TeZV1bWeH9fcQqrmdNwxuU6kMH26McLkLdxNGR): protocol: rpc: dial tcp 104.36.82.19:4431: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 22:17:48.217472859 (76h51m42.64855299s) [noise=true , address=104.36.82.61:4402 , piece_id=YTLOBJSYCTQPFJNQGOOTFWOA4FBLVPH3CUUHDPP6Z2N6Q4XPLEOA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122bkrGG8zk64AMrcY5h9Xynm2updzvAWsSuQi8tMnjSpQKzJVg): protocol: write tcp 188.166.225.170:55318->104.36.82.61:4402: use of closed network connection; write tcp 188.166.225.170:55318->104.36.82.61:4402: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55318->104.36.82.61:4402: use of closed network connection Aug 11 22:17:48.217488709 (76h51m42.64856884s) [seg_pos={0 0}, upload=80112]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:17:48.217545728 (76h51m42.648625859s) [upload=80112]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:17:48.217549456 (76h51m42.648629587s) [upload=80112]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:17:48.565497198 (76h51m42.996577329s) [upload=80112]: Done uploading segments... Aug 11 22:17:48.565517457 (76h51m42.996597588s) [upload=80112]: Upload finished. err: <nil> Duration: 6.266095286s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....X.........................................X.X...........] duration: 1.909990769s FAIL (2025-08-11 22:19:45 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after d295b8eeb563de4b48b879f424f9ad08c7fb4dd3bebf44de27a7ca55039b02cb != before 8ab40e22d894e0fc1b2b6af3e54ab06e9aa1481b89a729d8b5523518ea3a89da ======LOGS====== Aug 11 22:11:29.756339814 (76h45m24.187419945s) [upload=80005]: Starting upload Aug 11 22:11:29.756390561 (76h45m24.187470683s) [upload=80005]: Done starting upload Aug 11 22:11:29.756461917 (76h45m24.187542038s) [upload=80005]: Uploading segments... Aug 11 22:11:29.756603629 (76h45m24.18768377s) [upload=80005]: Got next segment. Inline: true Aug 11 22:11:29.756615802 (76h45m24.187695933s) [upload=80005]: Waiting for error group managing segments... Aug 11 22:11:29.756677580 (76h45m24.187757711s) [upload=80005]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:11:29.756683782 (76h45m24.187763913s) [upload=80005]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 22:11:29.756686688 (76h45m24.187766819s) [upload=80005]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:11:30.039257370 (76h45m24.470337501s) [upload=80005]: Done uploading segments... Aug 11 22:11:30.039274463 (76h45m24.470354594s) [upload=80005]: Upload finished. err: <nil> Duration:* 1.910017791s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.XX.........................................................] duration: 3.813031589s FAIL (2025-08-11 22:19:36 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 17) ======LOGS====== 4SRO752OWZG4Q5T6CLSA, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:47.435217419 (76h14m41.86629755s) [noise=true , address=89.149.201.147:4001 , piece_id=RKJZS5OX3EUD3HGFCRBIUVORRKRBGZ2NMDUKCFPRZW2AGFBLKYDA, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:47.435490742 (76h14m41.866570873s) [noise=true , address=89.149.201.147:4016 , piece_id=XKZQCPO5CGT43AYUQQGKWRPWBZFNU3W2VKW2Y4D3B6CYRNWRB5LQ, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:47.435707035 (76h14m41.866787176s) [noise=true , address=89.149.201.147:4004 , piece_id=GKCEZV6XYZVKP5XMXGYXCDEESZW747VNHGJOYWK5JTQDXDT6RJTA, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:48.239516310 (76h14m42.670596441s) [upload=79474]: Next returned nil segment Aug 11 21:40:48.239549052 (76h14m42.670629173s) [upload=79474]: Waiting for error group managing segments... Aug 11 21:40:48.609972490 (76h14m43.041052621s) [noise=true , address=89.149.201.147:4008 , piece_id=PSP6FLFFPH6LWBEBPXOXF7BIXIEBPL6N5JJJGWKK7BDW5DV3B4VQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.614486426 (76h14m43.045566557s) [noise=true , address=89.149.201.147:4022 , piece_id=FSOKKKC75TFGUTPMR5G6555ICDWHIKNHDBP6B57OADUSHAPH6GDA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.616257926 (76h14m43.047338057s) [noise=true , address=89.149.201.147:4016 , piece_id=XKZQCPO5CGT43AYUQQGKWRPWBZFNU3W2VKW2Y4D3B6CYRNWRB5LQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.621293161 (76h14m43.052373282s) [noise=true , address=89.149.201.147:4004 , piece_id=GKCEZV6XYZVKP5XMXGYXCDEESZW747VNHGJOYWK5JTQDXDT6RJTA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.626661412 (76h14m43.057741543s) [noise=true , address=81.171.14.70:4038 , piece_id=Z64RWC56JGOQMCQWITBQR5OE3P3AYVVWQBHIY4K42AZCTI4AP5YA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.636033735 (76h14m43.067113866s) [noise=true , address=81.171.14.70:4026 , piece_id=4GNYVJ46JRDGYCZSZTXKHCDXTPPOYPJK73XAVZZN5UERRCV3XV6A, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.640209745 (76h14m43.071289876s) [noise=true , address=89.149.201.147:4012 , piece_id=I5YST5TWDCBXTW3XLBEZAG42NCQOCJ5VLSQ3O5BYGR5DUEPOMRBQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.642681474 (76h14m43.073761595s) [noise=true , address=89.149.201.147:4007 , piece_id=YDDPTURQWLPNJJHXOCESM64SEXF5AN37JSSQUUKY7HEDERFMSXWA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.645004419 (76h14m43.07608455s) [noise=true , address=89.149.201.147:4015 , piece_id=6D5FIUSLWJ3YGG4FNGV6EL5H47GNJN25GDMK57XH54JJPREGIRHA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.648884623 (76h14m43.079964754s) [noise=true , address=81.171.14.70:4027 , piece_id=4YKLDKWWINPAF3CRJDUFPDOS4QHL5IYOWIQT7ZOLGZYYXV33GUGQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.650426162 (76h14m43.081506293s) [noise=true , address=81.171.14.70:4032 , piece_id=7DBHWCTPKNTOQSMRI7Z23RPQWGDXQ5I2V4CGUGHFEWFP4P5KL74Q, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.650438025 (76h14m43.081518156s) [noise=true , address=89.149.201.147:4011 , piece_id=3MMNZVMZPGS77URWNUKRRBSX6NMTHIPMRRJWZ6RLLCPW2KXY2WEQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.652018830 (76h14m43.083098961s) [noise=true , address=81.171.14.70:4043 , piece_id=SPNWQM77OMTQPH36DH72T65IGAJP4JU6P52DTNRT3LJ4JVR3O6EQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.658234463 (76h14m43.089314594s) [noise=true , address=81.171.14.70:4047 , piece_id=E3ZKADZBMEO5T7X5HM6ZTLCIN5PQBFKNJSORWIJ4MPUNVRYLUNSA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.659300161 (76h14m43.090380292s) [noise=true , address=89.149.201.147:4001 , piece_id=RKJZS5OX3EUD3HGFCRBIUVORRKRBGZ2NMDUKCFPRZW2AGFBLKYDA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.660027774 (76h14m43.091107905s) [noise=true , address=81.171.14.70:4039 , piece_id=CLAXUB4OGSUJ3WFV7EAVCCRQLRYYOULWECFPEIJOHNDS2DYNCCTQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.679805807 (76h14m43.110885938s) [noise=true , address=81.171.14.70:4045 , piece_id=H3BKI4JHRL7BEBIBWTJZNYU63S3PRCQO7FQPR6QCADJT6IZAY2JA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:41:46.602808629 (76h15m41.03388876s) [noise=true , address=185.167.204.205:4013 , piece_id=G5VQFVD74USTWPZQANS3DS3GVZKNQHBQ32CG6GM2BVNJQJBZX7JQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602837273 (76h15m41.033917394s) [noise=true , address=185.167.204.205:4009 , piece_id=M7GYQHCX6ZAOX2FTDV2WOD3LTT4UYXYGMUKRO5TWMA6RJZW5XTUA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602856751 (76h15m41.033936872s) [noise=true , address=185.167.204.206:4037 , piece_id=WOOJ4QNO6V2QERDBHC76CE7ZINRYOYHJ2UPHMNYSWUHNV436NXAA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12nEq1PMWr39K5LBUcViEtEb1KTnsJLjMaBbNGuqpc13WdZb18R, address:185.167.204.206:4037): protocol: write tcp 188.166.225.170:45748->185.167.204.206:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602871879 (76h15m41.033952s) [noise=true , address=185.167.204.205:4032 , piece_id=7SYA6MKGKBW4NSJHD3BUVYPCMNHTKF3VO2MSMWYUE3G3G2ZCEJBA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602890335 (76h15m41.033970456s) [noise=true , address=185.167.204.206:4038 , piece_id=3NI34S2BMRUFFWWCURLWDYQBIR5VDTZCLE5JSZNZX2JFMJQC3FKQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: rpc: dial tcp 185.167.204.206:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602901646 (76h15m41.033981777s) [noise=true , address=185.167.204.205:4023 , piece_id=FFNPVDRQSVZFKPRE5IQCEHMUA3SBZZV4XC4QJESNRUZQLPSEGZ2Q, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: rpc: dial tcp 185.167.204.205:4023: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602919721 (76h15m41.033999852s) [noise=true , address=185.167.204.206:4072 , piece_id=NTKD7PR6XECRZXUZA767CXZY7VYIFLPM2RENI5ZP3TDU6UVXFM4Q, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: rpc: dial tcp 185.167.204.206:4072: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602932555 (76h15m41.034012686s) [noise=true , address=185.167.204.205:4014 , piece_id=NLF3JAJEOLTK4FPIHPQ4QCBHWQKW2AVGSWCOJDMMOGHSI6EUCBOQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602949328 (76h15m41.034029449s) [noise=true , address=185.167.204.205:4011 , piece_id=UJCY3N7L4OUJL5LZFS6GVER3RDEWZMZTJTZRD3CD4JFQRUZM32UA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: write tcp 188.166.225.170:50060->185.167.204.205:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602962153 (76h15m41.034042284s) [noise=true , address=185.167.204.206:4052 , piece_id=OZW7EGYLJ24I7UYQ357XMBRAMVPALBC3L2MT3YU6SN3MGGC767QQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602981068 (76h15m41.034061199s) [noise=true , address=185.167.204.206:4041 , piece_id=LSRJUXV7L2VGR6XOF74R6HG5QLXBNXNF4SRO752OWZG4Q5T6CLSA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.603000215 (76h15m41.034080346s) [seg_pos={0 0}, upload=79474]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil> Aug 11 21:41:46.778560597 (76h15m41.209640728s) [upload=79474]: Done uploading segments... Aug 11 21:41:46.778585545 (76h15m41.209665676s) [upload=79474]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17) Duration: 3.813057979s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............X............X..............................X..] duration: 6.831480826s FAIL (2025-08-11 22:19:32 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 756734e5fe5aacc912a117be42418de9d74c6a969be799843b3b6e158dbae1f0 != before f90f0abc2f6e52593c1b4257def406a4152737656ca4e5dcff878c955ea374b9 ======LOGS====== Aug 11 22:17:45.390768560 (76h51m39.821848691s) [upload=80112]: Starting upload Aug 11 22:17:45.390818554 (76h51m39.821898685s) [upload=80112]: Done starting upload Aug 11 22:17:45.390934647 (76h51m39.822014788s) [upload=80112]: Uploading segments... Aug 11 22:17:45.391041151 (76h51m39.822121292s) [upload=80112]: Got next segment. Inline: false Aug 11 22:17:45.391085936 (76h51m39.822166067s) [upload=80112]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:17:45.391091447 (76h51m39.822171578s) [upload=80112]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:17:46.020620439 (76h51m40.45170057s) [seg_pos={0 0}, upload=80112]: Begin upload segment... Aug 11 22:17:46.020671556 (76h51m40.451751677s) [seg_pos={0 0}, upload=80112]: Done begin upload segment. Aug 11 22:17:46.020692717 (76h51m40.451772848s) [noise=true , address=64.49.13.27:4959 , piece_id=KV4U2P4NBCIRPF4NLH6EIHEFRH5GVGRSH3LB2F7HIHEN2FDBUJBA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.020733225 (76h51m40.451813356s) [noise=true , address=104.36.82.46:4492 , piece_id=B4KBH2TWVFYYYNQHQEBYCDCHN3QQD5NP6TZFNNDWJM2I57ZLWYUA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.021078204 (76h51m40.452158335s) [noise=true , address=104.36.82.42:4827 , piece_id=WWRWBWREVJUV6LQD4APAHLAA7GVHXEWX4Y7TYOEUZ6WTMIOMPM7A, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.021162876 (76h51m40.452243007s) [noise=true , address=104.36.82.34:4564 , piece_id=PFBML5JMRRODB67EWDYGQCXM757GGPXAOOKWVXMAZQHQBVWCS5VQ, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.021351287 (76h51m40.452431418s) [noise=true , address=104.36.82.5:4846 , piece_id=GY6F7CCISK6M52RILLN443AFXDYFOXOYDQNMDOFEP7WZYP3OKV3A, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.021848057 (76h51m40.452928188s) [noise=true , address=104.36.82.62:4435 , piece_id=GG6LKKY5JG2U6MEJND4ZCGWLP6356HONFI7C5O46DKIXW7VFA33Q, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.021937329 (76h51m40.45301746s) [noise=true , address=104.36.82.9:4008 , piece_id=WBTKQQ5WCYIV4R6MG4TACIF7WI3TC7JAO6K35M3JPCQZ4CUZNP6Q, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.022384644 (76h51m40.453464775s) [noise=true , address=64.49.13.138:4487 , piece_id=VAXCN755CK6W5JIFKRN62IOM4V6SABWZ3I66A4NGH5DLBDBMLSKA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.022722891 (76h51m40.453803022s) [noise=true , address=79.127.205.234:4600 , piece_id=BJ2RSZYG2QZLAECCB6IV3QWNO7FUN5GYYMHX7OOOUANMNAJRBITA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.023272483 (76h51m40.454352614s) [noise=true , address=193.149.164.143:4693 , piece_id=UBXV6NRFCXIESASUMUBU5Z2ZDZVACL45JIPN5HW57NXIVS6Z3XVQ, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.023623805 (76h51m40.454703936s) [noise=true , address=64.49.13.170:4722 , piece_id=CYFRQQR567OT6UFWC2BTMNA6QP6VSZCAPKXM6F66GSOCFR3QF63Q, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.024032137 (76h51m40.455112268s) [noise=true , address=104.36.82.61:4402 , piece_id=YTLOBJSYCTQPFJNQGOOTFWOA4FBLVPH3CUUHDPP6Z2N6Q4XPLEOA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.024460216 (76h51m40.455540347s) [noise=true , address=104.36.82.8:4988 , piece_id=A74RKDTLNSF35O5BQMFBO3VZSM356IT7JOF72REVXMVQED4P7QAQ, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.024746373 (76h51m40.455826504s) [noise=true , address=104.36.82.17:4345 , piece_id=IIPOLWUADV7YO4ULANL3APTLQSA4ZFEDHQ63EWBKXY4DF6DX63DA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.034125720 (76h51m40.465205851s) [noise=true , address=104.36.82.23:4446 , piece_id=UM2YZ2JSGQIJ2BYPIY27HGUN6BOWSZVF7774XXZ63EC65NBWGETA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.034459087 (76h51m40.465539218s) [noise=true , address=104.36.82.19:4431 , piece_id=PKC6PDUCBM3G7KXNERVA74VCOOVMPKZMKVXJEK7XD3FRFEAYKRAQ, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.034747659 (76h51m40.46582778s) [noise=true , address=77.90.31.14:4678 , piece_id=YSRDQQGIGDI3MMLSC7A6ORWZJCE72U24RNFBLC5MB6OWRQHNLGSA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.035026874 (76h51m40.466107005s) [noise=true , address=104.36.82.18:4366 , piece_id=YJAPAERA6HCQQIK5Y3GGX2YF7MWT4SBWNPBG6GROXPRIUNWDIFDA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:47.173903245 (76h51m41.604983376s) [upload=80112]: Next returned nil segment Aug 11 22:17:47.173919425 (76h51m41.604999556s) [upload=80112]: Waiting for error group managing segments... Aug 11 22:17:47.490868386 (76h51m41.921948517s) [noise=true , address=64.49.13.138:4487 , piece_id=VAXCN755CK6W5JIFKRN62IOM4V6SABWZ3I66A4NGH5DLBDBMLSKA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:47.507960559 (76h51m41.93904068s) [noise=true , address=79.127.205.234:4600 , piece_id=BJ2RSZYG2QZLAECCB6IV3QWNO7FUN5GYYMHX7OOOUANMNAJRBITA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:47.544288628 (76h51m41.97536876s) [noise=true , address=64.49.13.170:4722 , piece_id=CYFRQQR567OT6UFWC2BTMNA6QP6VSZCAPKXM6F66GSOCFR3QF63Q, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:47.550382108 (76h51m41.981462239s) [noise=true , address=193.149.164.143:4693 , piece_id=UBXV6NRFCXIESASUMUBU5Z2ZDZVACL45JIPN5HW57NXIVS6Z3XVQ, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:47.556377930 (76h51m41.987458051s) [noise=true , address=64.49.13.27:4959 , piece_id=KV4U2P4NBCIRPF4NLH6EIHEFRH5GVGRSH3LB2F7HIHEN2FDBUJBA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.006078293 (76h51m42.437158434s) [noise=true , address=104.36.82.46:4492 , piece_id=B4KBH2TWVFYYYNQHQEBYCDCHN3QQD5NP6TZFNNDWJM2I57ZLWYUA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.011273122 (76h51m42.442353273s) [noise=true , address=104.36.82.62:4435 , piece_id=GG6LKKY5JG2U6MEJND4ZCGWLP6356HONFI7C5O46DKIXW7VFA33Q, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.019925798 (76h51m42.451005929s) [noise=true , address=104.36.82.23:4446 , piece_id=UM2YZ2JSGQIJ2BYPIY27HGUN6BOWSZVF7774XXZ63EC65NBWGETA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.095164618 (76h51m42.526244749s) [noise=true , address=104.36.82.34:4564 , piece_id=PFBML5JMRRODB67EWDYGQCXM757GGPXAOOKWVXMAZQHQBVWCS5VQ, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.130420175 (76h51m42.561500306s) [noise=true , address=104.36.82.9:4008 , piece_id=WBTKQQ5WCYIV4R6MG4TACIF7WI3TC7JAO6K35M3JPCQZ4CUZNP6Q, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.144363894 (76h51m42.575444026s) [noise=true , address=104.36.82.17:4345 , piece_id=IIPOLWUADV7YO4ULANL3APTLQSA4ZFEDHQ63EWBKXY4DF6DX63DA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.169714420 (76h51m42.600794551s) [noise=true , address=104.36.82.18:4366 , piece_id=YJAPAERA6HCQQIK5Y3GGX2YF7MWT4SBWNPBG6GROXPRIUNWDIFDA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.197368642 (76h51m42.628448763s) [noise=true , address=104.36.82.42:4827 , piece_id=WWRWBWREVJUV6LQD4APAHLAA7GVHXEWX4Y7TYOEUZ6WTMIOMPM7A, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.217110746 (76h51m42.648190867s) [noise=true , address=77.90.31.14:4678 , piece_id=YSRDQQGIGDI3MMLSC7A6ORWZJCE72U24RNFBLC5MB6OWRQHNLGSA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.217135393 (76h51m42.648215514s) [seg_pos={0 0}, upload=80112]: Segment reached optimal threshold of 14 pieces. Aug 11 22:17:48.217375642 (76h51m42.648455774s) [noise=true , address=104.36.82.5:4846 , piece_id=GY6F7CCISK6M52RILLN443AFXDYFOXOYDQNMDOFEP7WZYP3OKV3A, seg_pos={0 0}, upload=80112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 11 22:17:48.217408495 (76h51m42.648488626s) [noise=true , address=104.36.82.8:4988 , piece_id=A74RKDTLNSF35O5BQMFBO3VZSM356IT7JOF72REVXMVQED4P7QAQ, seg_pos={0 0}, upload=80112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Qs9EDisetfkwcMS8r1d1twWZoTzaz2QZAo2aJakM53ZyJs2Je): protocol: expected piece hash; context canceled; EOF Aug 11 22:17:48.217441529 (76h51m42.64852166s) [noise=true , address=104.36.82.19:4431 , piece_id=PKC6PDUCBM3G7KXNERVA74VCOOVMPKZMKVXJEK7XD3FRFEAYKRAQ, seg_pos={0 0}, upload=80112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12E2efGqgEca5TeZV1bWeH9fcQqrmdNwxuU6kMH26McLkLdxNGR): protocol: rpc: dial tcp 104.36.82.19:4431: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 22:17:48.217472859 (76h51m42.64855299s) [noise=true , address=104.36.82.61:4402 , piece_id=YTLOBJSYCTQPFJNQGOOTFWOA4FBLVPH3CUUHDPP6Z2N6Q4XPLEOA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122bkrGG8zk64AMrcY5h9Xynm2updzvAWsSuQi8tMnjSpQKzJVg): protocol: write tcp 188.166.225.170:55318->104.36.82.61:4402: use of closed network connection; write tcp 188.166.225.170:55318->104.36.82.61:4402: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55318->104.36.82.61:4402: use of closed network connection Aug 11 22:17:48.217488709 (76h51m42.64856884s) [seg_pos={0 0}, upload=80112]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:17:48.217545728 (76h51m42.648625859s) [upload=80112]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:17:48.217549456 (76h51m42.648629587s) [upload=80112]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:17:48.565497198 (76h51m42.996577329s) [upload=80112]: Done uploading segments... Aug 11 22:17:48.565517457 (76h51m42.996597588s) [upload=80112]: Upload finished. err: <nil> Duration: 6.831497869s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....X.........................................X.X..........] duration: 1.841789933s FAIL (2025-08-11 22:19:27 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after d295b8eeb563de4b48b879f424f9ad08c7fb4dd3bebf44de27a7ca55039b02cb != before 8ab40e22d894e0fc1b2b6af3e54ab06e9aa1481b89a729d8b5523518ea3a89da ======LOGS====== Aug 11 22:11:29.756339814 (76h45m24.187419945s) [upload=80005]: Starting upload Aug 11 22:11:29.756390561 (76h45m24.187470683s) [upload=80005]: Done starting upload Aug 11 22:11:29.756461917 (76h45m24.187542038s) [upload=80005]: Uploading segments... Aug 11 22:11:29.756603629 (76h45m24.18768377s) [upload=80005]: Got next segment. Inline: true Aug 11 22:11:29.756615802 (76h45m24.187695933s) [upload=80005]: Waiting for error group managing segments... Aug 11 22:11:29.756677580 (76h45m24.187757711s) [upload=80005]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:11:29.756683782 (76h45m24.187763913s) [upload=80005]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 22:11:29.756686688 (76h45m24.187766819s) [upload=80005]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:11:30.039257370 (76h45m24.470337501s) [upload=80005]: Done uploading segments... Aug 11 22:11:30.039274463 (76h45m24.470354594s) [upload=80005]: Upload finished. err: <nil> Duration:* 1.84181488s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [..XX........................................................] duration: 3.883659266s FAIL (2025-08-11 22:19:20 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 17) ======LOGS====== 4SRO752OWZG4Q5T6CLSA, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:47.435217419 (76h14m41.86629755s) [noise=true , address=89.149.201.147:4001 , piece_id=RKJZS5OX3EUD3HGFCRBIUVORRKRBGZ2NMDUKCFPRZW2AGFBLKYDA, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:47.435490742 (76h14m41.866570873s) [noise=true , address=89.149.201.147:4016 , piece_id=XKZQCPO5CGT43AYUQQGKWRPWBZFNU3W2VKW2Y4D3B6CYRNWRB5LQ, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:47.435707035 (76h14m41.866787176s) [noise=true , address=89.149.201.147:4004 , piece_id=GKCEZV6XYZVKP5XMXGYXCDEESZW747VNHGJOYWK5JTQDXDT6RJTA, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:48.239516310 (76h14m42.670596441s) [upload=79474]: Next returned nil segment Aug 11 21:40:48.239549052 (76h14m42.670629173s) [upload=79474]: Waiting for error group managing segments... Aug 11 21:40:48.609972490 (76h14m43.041052621s) [noise=true , address=89.149.201.147:4008 , piece_id=PSP6FLFFPH6LWBEBPXOXF7BIXIEBPL6N5JJJGWKK7BDW5DV3B4VQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.614486426 (76h14m43.045566557s) [noise=true , address=89.149.201.147:4022 , piece_id=FSOKKKC75TFGUTPMR5G6555ICDWHIKNHDBP6B57OADUSHAPH6GDA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.616257926 (76h14m43.047338057s) [noise=true , address=89.149.201.147:4016 , piece_id=XKZQCPO5CGT43AYUQQGKWRPWBZFNU3W2VKW2Y4D3B6CYRNWRB5LQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.621293161 (76h14m43.052373282s) [noise=true , address=89.149.201.147:4004 , piece_id=GKCEZV6XYZVKP5XMXGYXCDEESZW747VNHGJOYWK5JTQDXDT6RJTA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.626661412 (76h14m43.057741543s) [noise=true , address=81.171.14.70:4038 , piece_id=Z64RWC56JGOQMCQWITBQR5OE3P3AYVVWQBHIY4K42AZCTI4AP5YA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.636033735 (76h14m43.067113866s) [noise=true , address=81.171.14.70:4026 , piece_id=4GNYVJ46JRDGYCZSZTXKHCDXTPPOYPJK73XAVZZN5UERRCV3XV6A, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.640209745 (76h14m43.071289876s) [noise=true , address=89.149.201.147:4012 , piece_id=I5YST5TWDCBXTW3XLBEZAG42NCQOCJ5VLSQ3O5BYGR5DUEPOMRBQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.642681474 (76h14m43.073761595s) [noise=true , address=89.149.201.147:4007 , piece_id=YDDPTURQWLPNJJHXOCESM64SEXF5AN37JSSQUUKY7HEDERFMSXWA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.645004419 (76h14m43.07608455s) [noise=true , address=89.149.201.147:4015 , piece_id=6D5FIUSLWJ3YGG4FNGV6EL5H47GNJN25GDMK57XH54JJPREGIRHA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.648884623 (76h14m43.079964754s) [noise=true , address=81.171.14.70:4027 , piece_id=4YKLDKWWINPAF3CRJDUFPDOS4QHL5IYOWIQT7ZOLGZYYXV33GUGQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.650426162 (76h14m43.081506293s) [noise=true , address=81.171.14.70:4032 , piece_id=7DBHWCTPKNTOQSMRI7Z23RPQWGDXQ5I2V4CGUGHFEWFP4P5KL74Q, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.650438025 (76h14m43.081518156s) [noise=true , address=89.149.201.147:4011 , piece_id=3MMNZVMZPGS77URWNUKRRBSX6NMTHIPMRRJWZ6RLLCPW2KXY2WEQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.652018830 (76h14m43.083098961s) [noise=true , address=81.171.14.70:4043 , piece_id=SPNWQM77OMTQPH36DH72T65IGAJP4JU6P52DTNRT3LJ4JVR3O6EQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.658234463 (76h14m43.089314594s) [noise=true , address=81.171.14.70:4047 , piece_id=E3ZKADZBMEO5T7X5HM6ZTLCIN5PQBFKNJSORWIJ4MPUNVRYLUNSA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.659300161 (76h14m43.090380292s) [noise=true , address=89.149.201.147:4001 , piece_id=RKJZS5OX3EUD3HGFCRBIUVORRKRBGZ2NMDUKCFPRZW2AGFBLKYDA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.660027774 (76h14m43.091107905s) [noise=true , address=81.171.14.70:4039 , piece_id=CLAXUB4OGSUJ3WFV7EAVCCRQLRYYOULWECFPEIJOHNDS2DYNCCTQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.679805807 (76h14m43.110885938s) [noise=true , address=81.171.14.70:4045 , piece_id=H3BKI4JHRL7BEBIBWTJZNYU63S3PRCQO7FQPR6QCADJT6IZAY2JA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:41:46.602808629 (76h15m41.03388876s) [noise=true , address=185.167.204.205:4013 , piece_id=G5VQFVD74USTWPZQANS3DS3GVZKNQHBQ32CG6GM2BVNJQJBZX7JQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602837273 (76h15m41.033917394s) [noise=true , address=185.167.204.205:4009 , piece_id=M7GYQHCX6ZAOX2FTDV2WOD3LTT4UYXYGMUKRO5TWMA6RJZW5XTUA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602856751 (76h15m41.033936872s) [noise=true , address=185.167.204.206:4037 , piece_id=WOOJ4QNO6V2QERDBHC76CE7ZINRYOYHJ2UPHMNYSWUHNV436NXAA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12nEq1PMWr39K5LBUcViEtEb1KTnsJLjMaBbNGuqpc13WdZb18R, address:185.167.204.206:4037): protocol: write tcp 188.166.225.170:45748->185.167.204.206:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602871879 (76h15m41.033952s) [noise=true , address=185.167.204.205:4032 , piece_id=7SYA6MKGKBW4NSJHD3BUVYPCMNHTKF3VO2MSMWYUE3G3G2ZCEJBA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602890335 (76h15m41.033970456s) [noise=true , address=185.167.204.206:4038 , piece_id=3NI34S2BMRUFFWWCURLWDYQBIR5VDTZCLE5JSZNZX2JFMJQC3FKQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: rpc: dial tcp 185.167.204.206:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602901646 (76h15m41.033981777s) [noise=true , address=185.167.204.205:4023 , piece_id=FFNPVDRQSVZFKPRE5IQCEHMUA3SBZZV4XC4QJESNRUZQLPSEGZ2Q, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: rpc: dial tcp 185.167.204.205:4023: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602919721 (76h15m41.033999852s) [noise=true , address=185.167.204.206:4072 , piece_id=NTKD7PR6XECRZXUZA767CXZY7VYIFLPM2RENI5ZP3TDU6UVXFM4Q, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: rpc: dial tcp 185.167.204.206:4072: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602932555 (76h15m41.034012686s) [noise=true , address=185.167.204.205:4014 , piece_id=NLF3JAJEOLTK4FPIHPQ4QCBHWQKW2AVGSWCOJDMMOGHSI6EUCBOQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602949328 (76h15m41.034029449s) [noise=true , address=185.167.204.205:4011 , piece_id=UJCY3N7L4OUJL5LZFS6GVER3RDEWZMZTJTZRD3CD4JFQRUZM32UA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: write tcp 188.166.225.170:50060->185.167.204.205:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602962153 (76h15m41.034042284s) [noise=true , address=185.167.204.206:4052 , piece_id=OZW7EGYLJ24I7UYQ357XMBRAMVPALBC3L2MT3YU6SN3MGGC767QQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602981068 (76h15m41.034061199s) [noise=true , address=185.167.204.206:4041 , piece_id=LSRJUXV7L2VGR6XOF74R6HG5QLXBNXNF4SRO752OWZG4Q5T6CLSA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.603000215 (76h15m41.034080346s) [seg_pos={0 0}, upload=79474]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil> Aug 11 21:41:46.778560597 (76h15m41.209640728s) [upload=79474]: Done uploading segments... Aug 11 21:41:46.778585545 (76h15m41.209665676s) [upload=79474]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17) Duration: 3.88367652s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [...XX.......................................................] duration: 4.132386803s FAIL (2025-08-11 22:19:02 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 17) ======LOGS====== 4SRO752OWZG4Q5T6CLSA, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:47.435217419 (76h14m41.86629755s) [noise=true , address=89.149.201.147:4001 , piece_id=RKJZS5OX3EUD3HGFCRBIUVORRKRBGZ2NMDUKCFPRZW2AGFBLKYDA, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:47.435490742 (76h14m41.866570873s) [noise=true , address=89.149.201.147:4016 , piece_id=XKZQCPO5CGT43AYUQQGKWRPWBZFNU3W2VKW2Y4D3B6CYRNWRB5LQ, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:47.435707035 (76h14m41.866787176s) [noise=true , address=89.149.201.147:4004 , piece_id=GKCEZV6XYZVKP5XMXGYXCDEESZW747VNHGJOYWK5JTQDXDT6RJTA, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:48.239516310 (76h14m42.670596441s) [upload=79474]: Next returned nil segment Aug 11 21:40:48.239549052 (76h14m42.670629173s) [upload=79474]: Waiting for error group managing segments... Aug 11 21:40:48.609972490 (76h14m43.041052621s) [noise=true , address=89.149.201.147:4008 , piece_id=PSP6FLFFPH6LWBEBPXOXF7BIXIEBPL6N5JJJGWKK7BDW5DV3B4VQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.614486426 (76h14m43.045566557s) [noise=true , address=89.149.201.147:4022 , piece_id=FSOKKKC75TFGUTPMR5G6555ICDWHIKNHDBP6B57OADUSHAPH6GDA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.616257926 (76h14m43.047338057s) [noise=true , address=89.149.201.147:4016 , piece_id=XKZQCPO5CGT43AYUQQGKWRPWBZFNU3W2VKW2Y4D3B6CYRNWRB5LQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.621293161 (76h14m43.052373282s) [noise=true , address=89.149.201.147:4004 , piece_id=GKCEZV6XYZVKP5XMXGYXCDEESZW747VNHGJOYWK5JTQDXDT6RJTA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.626661412 (76h14m43.057741543s) [noise=true , address=81.171.14.70:4038 , piece_id=Z64RWC56JGOQMCQWITBQR5OE3P3AYVVWQBHIY4K42AZCTI4AP5YA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.636033735 (76h14m43.067113866s) [noise=true , address=81.171.14.70:4026 , piece_id=4GNYVJ46JRDGYCZSZTXKHCDXTPPOYPJK73XAVZZN5UERRCV3XV6A, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.640209745 (76h14m43.071289876s) [noise=true , address=89.149.201.147:4012 , piece_id=I5YST5TWDCBXTW3XLBEZAG42NCQOCJ5VLSQ3O5BYGR5DUEPOMRBQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.642681474 (76h14m43.073761595s) [noise=true , address=89.149.201.147:4007 , piece_id=YDDPTURQWLPNJJHXOCESM64SEXF5AN37JSSQUUKY7HEDERFMSXWA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.645004419 (76h14m43.07608455s) [noise=true , address=89.149.201.147:4015 , piece_id=6D5FIUSLWJ3YGG4FNGV6EL5H47GNJN25GDMK57XH54JJPREGIRHA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.648884623 (76h14m43.079964754s) [noise=true , address=81.171.14.70:4027 , piece_id=4YKLDKWWINPAF3CRJDUFPDOS4QHL5IYOWIQT7ZOLGZYYXV33GUGQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.650426162 (76h14m43.081506293s) [noise=true , address=81.171.14.70:4032 , piece_id=7DBHWCTPKNTOQSMRI7Z23RPQWGDXQ5I2V4CGUGHFEWFP4P5KL74Q, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.650438025 (76h14m43.081518156s) [noise=true , address=89.149.201.147:4011 , piece_id=3MMNZVMZPGS77URWNUKRRBSX6NMTHIPMRRJWZ6RLLCPW2KXY2WEQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.652018830 (76h14m43.083098961s) [noise=true , address=81.171.14.70:4043 , piece_id=SPNWQM77OMTQPH36DH72T65IGAJP4JU6P52DTNRT3LJ4JVR3O6EQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.658234463 (76h14m43.089314594s) [noise=true , address=81.171.14.70:4047 , piece_id=E3ZKADZBMEO5T7X5HM6ZTLCIN5PQBFKNJSORWIJ4MPUNVRYLUNSA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.659300161 (76h14m43.090380292s) [noise=true , address=89.149.201.147:4001 , piece_id=RKJZS5OX3EUD3HGFCRBIUVORRKRBGZ2NMDUKCFPRZW2AGFBLKYDA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.660027774 (76h14m43.091107905s) [noise=true , address=81.171.14.70:4039 , piece_id=CLAXUB4OGSUJ3WFV7EAVCCRQLRYYOULWECFPEIJOHNDS2DYNCCTQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.679805807 (76h14m43.110885938s) [noise=true , address=81.171.14.70:4045 , piece_id=H3BKI4JHRL7BEBIBWTJZNYU63S3PRCQO7FQPR6QCADJT6IZAY2JA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:41:46.602808629 (76h15m41.03388876s) [noise=true , address=185.167.204.205:4013 , piece_id=G5VQFVD74USTWPZQANS3DS3GVZKNQHBQ32CG6GM2BVNJQJBZX7JQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602837273 (76h15m41.033917394s) [noise=true , address=185.167.204.205:4009 , piece_id=M7GYQHCX6ZAOX2FTDV2WOD3LTT4UYXYGMUKRO5TWMA6RJZW5XTUA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602856751 (76h15m41.033936872s) [noise=true , address=185.167.204.206:4037 , piece_id=WOOJ4QNO6V2QERDBHC76CE7ZINRYOYHJ2UPHMNYSWUHNV436NXAA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12nEq1PMWr39K5LBUcViEtEb1KTnsJLjMaBbNGuqpc13WdZb18R, address:185.167.204.206:4037): protocol: write tcp 188.166.225.170:45748->185.167.204.206:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602871879 (76h15m41.033952s) [noise=true , address=185.167.204.205:4032 , piece_id=7SYA6MKGKBW4NSJHD3BUVYPCMNHTKF3VO2MSMWYUE3G3G2ZCEJBA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602890335 (76h15m41.033970456s) [noise=true , address=185.167.204.206:4038 , piece_id=3NI34S2BMRUFFWWCURLWDYQBIR5VDTZCLE5JSZNZX2JFMJQC3FKQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: rpc: dial tcp 185.167.204.206:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602901646 (76h15m41.033981777s) [noise=true , address=185.167.204.205:4023 , piece_id=FFNPVDRQSVZFKPRE5IQCEHMUA3SBZZV4XC4QJESNRUZQLPSEGZ2Q, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: rpc: dial tcp 185.167.204.205:4023: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602919721 (76h15m41.033999852s) [noise=true , address=185.167.204.206:4072 , piece_id=NTKD7PR6XECRZXUZA767CXZY7VYIFLPM2RENI5ZP3TDU6UVXFM4Q, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: rpc: dial tcp 185.167.204.206:4072: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602932555 (76h15m41.034012686s) [noise=true , address=185.167.204.205:4014 , piece_id=NLF3JAJEOLTK4FPIHPQ4QCBHWQKW2AVGSWCOJDMMOGHSI6EUCBOQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602949328 (76h15m41.034029449s) [noise=true , address=185.167.204.205:4011 , piece_id=UJCY3N7L4OUJL5LZFS6GVER3RDEWZMZTJTZRD3CD4JFQRUZM32UA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: write tcp 188.166.225.170:50060->185.167.204.205:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602962153 (76h15m41.034042284s) [noise=true , address=185.167.204.206:4052 , piece_id=OZW7EGYLJ24I7UYQ357XMBRAMVPALBC3L2MT3YU6SN3MGGC767QQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602981068 (76h15m41.034061199s) [noise=true , address=185.167.204.206:4041 , piece_id=LSRJUXV7L2VGR6XOF74R6HG5QLXBNXNF4SRO752OWZG4Q5T6CLSA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.603000215 (76h15m41.034080346s) [seg_pos={0 0}, upload=79474]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil> Aug 11 21:41:46.778560597 (76h15m41.209640728s) [upload=79474]: Done uploading segments... Aug 11 21:41:46.778585545 (76h15m41.209665676s) [upload=79474]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17) Duration: 4.132410859s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............X............X..............................X.] duration: 6.544066136s FAIL (2025-08-11 22:18:57 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 756734e5fe5aacc912a117be42418de9d74c6a969be799843b3b6e158dbae1f0 != before f90f0abc2f6e52593c1b4257def406a4152737656ca4e5dcff878c955ea374b9 ======LOGS====== Aug 11 22:17:45.390768560 (76h51m39.821848691s) [upload=80112]: Starting upload Aug 11 22:17:45.390818554 (76h51m39.821898685s) [upload=80112]: Done starting upload Aug 11 22:17:45.390934647 (76h51m39.822014788s) [upload=80112]: Uploading segments... Aug 11 22:17:45.391041151 (76h51m39.822121292s) [upload=80112]: Got next segment. Inline: false Aug 11 22:17:45.391085936 (76h51m39.822166067s) [upload=80112]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:17:45.391091447 (76h51m39.822171578s) [upload=80112]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:17:46.020620439 (76h51m40.45170057s) [seg_pos={0 0}, upload=80112]: Begin upload segment... Aug 11 22:17:46.020671556 (76h51m40.451751677s) [seg_pos={0 0}, upload=80112]: Done begin upload segment. Aug 11 22:17:46.020692717 (76h51m40.451772848s) [noise=true , address=64.49.13.27:4959 , piece_id=KV4U2P4NBCIRPF4NLH6EIHEFRH5GVGRSH3LB2F7HIHEN2FDBUJBA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.020733225 (76h51m40.451813356s) [noise=true , address=104.36.82.46:4492 , piece_id=B4KBH2TWVFYYYNQHQEBYCDCHN3QQD5NP6TZFNNDWJM2I57ZLWYUA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.021078204 (76h51m40.452158335s) [noise=true , address=104.36.82.42:4827 , piece_id=WWRWBWREVJUV6LQD4APAHLAA7GVHXEWX4Y7TYOEUZ6WTMIOMPM7A, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.021162876 (76h51m40.452243007s) [noise=true , address=104.36.82.34:4564 , piece_id=PFBML5JMRRODB67EWDYGQCXM757GGPXAOOKWVXMAZQHQBVWCS5VQ, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.021351287 (76h51m40.452431418s) [noise=true , address=104.36.82.5:4846 , piece_id=GY6F7CCISK6M52RILLN443AFXDYFOXOYDQNMDOFEP7WZYP3OKV3A, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.021848057 (76h51m40.452928188s) [noise=true , address=104.36.82.62:4435 , piece_id=GG6LKKY5JG2U6MEJND4ZCGWLP6356HONFI7C5O46DKIXW7VFA33Q, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.021937329 (76h51m40.45301746s) [noise=true , address=104.36.82.9:4008 , piece_id=WBTKQQ5WCYIV4R6MG4TACIF7WI3TC7JAO6K35M3JPCQZ4CUZNP6Q, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.022384644 (76h51m40.453464775s) [noise=true , address=64.49.13.138:4487 , piece_id=VAXCN755CK6W5JIFKRN62IOM4V6SABWZ3I66A4NGH5DLBDBMLSKA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.022722891 (76h51m40.453803022s) [noise=true , address=79.127.205.234:4600 , piece_id=BJ2RSZYG2QZLAECCB6IV3QWNO7FUN5GYYMHX7OOOUANMNAJRBITA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.023272483 (76h51m40.454352614s) [noise=true , address=193.149.164.143:4693 , piece_id=UBXV6NRFCXIESASUMUBU5Z2ZDZVACL45JIPN5HW57NXIVS6Z3XVQ, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.023623805 (76h51m40.454703936s) [noise=true , address=64.49.13.170:4722 , piece_id=CYFRQQR567OT6UFWC2BTMNA6QP6VSZCAPKXM6F66GSOCFR3QF63Q, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.024032137 (76h51m40.455112268s) [noise=true , address=104.36.82.61:4402 , piece_id=YTLOBJSYCTQPFJNQGOOTFWOA4FBLVPH3CUUHDPP6Z2N6Q4XPLEOA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.024460216 (76h51m40.455540347s) [noise=true , address=104.36.82.8:4988 , piece_id=A74RKDTLNSF35O5BQMFBO3VZSM356IT7JOF72REVXMVQED4P7QAQ, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.024746373 (76h51m40.455826504s) [noise=true , address=104.36.82.17:4345 , piece_id=IIPOLWUADV7YO4ULANL3APTLQSA4ZFEDHQ63EWBKXY4DF6DX63DA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.034125720 (76h51m40.465205851s) [noise=true , address=104.36.82.23:4446 , piece_id=UM2YZ2JSGQIJ2BYPIY27HGUN6BOWSZVF7774XXZ63EC65NBWGETA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.034459087 (76h51m40.465539218s) [noise=true , address=104.36.82.19:4431 , piece_id=PKC6PDUCBM3G7KXNERVA74VCOOVMPKZMKVXJEK7XD3FRFEAYKRAQ, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.034747659 (76h51m40.46582778s) [noise=true , address=77.90.31.14:4678 , piece_id=YSRDQQGIGDI3MMLSC7A6ORWZJCE72U24RNFBLC5MB6OWRQHNLGSA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.035026874 (76h51m40.466107005s) [noise=true , address=104.36.82.18:4366 , piece_id=YJAPAERA6HCQQIK5Y3GGX2YF7MWT4SBWNPBG6GROXPRIUNWDIFDA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:47.173903245 (76h51m41.604983376s) [upload=80112]: Next returned nil segment Aug 11 22:17:47.173919425 (76h51m41.604999556s) [upload=80112]: Waiting for error group managing segments... Aug 11 22:17:47.490868386 (76h51m41.921948517s) [noise=true , address=64.49.13.138:4487 , piece_id=VAXCN755CK6W5JIFKRN62IOM4V6SABWZ3I66A4NGH5DLBDBMLSKA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:47.507960559 (76h51m41.93904068s) [noise=true , address=79.127.205.234:4600 , piece_id=BJ2RSZYG2QZLAECCB6IV3QWNO7FUN5GYYMHX7OOOUANMNAJRBITA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:47.544288628 (76h51m41.97536876s) [noise=true , address=64.49.13.170:4722 , piece_id=CYFRQQR567OT6UFWC2BTMNA6QP6VSZCAPKXM6F66GSOCFR3QF63Q, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:47.550382108 (76h51m41.981462239s) [noise=true , address=193.149.164.143:4693 , piece_id=UBXV6NRFCXIESASUMUBU5Z2ZDZVACL45JIPN5HW57NXIVS6Z3XVQ, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:47.556377930 (76h51m41.987458051s) [noise=true , address=64.49.13.27:4959 , piece_id=KV4U2P4NBCIRPF4NLH6EIHEFRH5GVGRSH3LB2F7HIHEN2FDBUJBA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.006078293 (76h51m42.437158434s) [noise=true , address=104.36.82.46:4492 , piece_id=B4KBH2TWVFYYYNQHQEBYCDCHN3QQD5NP6TZFNNDWJM2I57ZLWYUA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.011273122 (76h51m42.442353273s) [noise=true , address=104.36.82.62:4435 , piece_id=GG6LKKY5JG2U6MEJND4ZCGWLP6356HONFI7C5O46DKIXW7VFA33Q, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.019925798 (76h51m42.451005929s) [noise=true , address=104.36.82.23:4446 , piece_id=UM2YZ2JSGQIJ2BYPIY27HGUN6BOWSZVF7774XXZ63EC65NBWGETA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.095164618 (76h51m42.526244749s) [noise=true , address=104.36.82.34:4564 , piece_id=PFBML5JMRRODB67EWDYGQCXM757GGPXAOOKWVXMAZQHQBVWCS5VQ, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.130420175 (76h51m42.561500306s) [noise=true , address=104.36.82.9:4008 , piece_id=WBTKQQ5WCYIV4R6MG4TACIF7WI3TC7JAO6K35M3JPCQZ4CUZNP6Q, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.144363894 (76h51m42.575444026s) [noise=true , address=104.36.82.17:4345 , piece_id=IIPOLWUADV7YO4ULANL3APTLQSA4ZFEDHQ63EWBKXY4DF6DX63DA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.169714420 (76h51m42.600794551s) [noise=true , address=104.36.82.18:4366 , piece_id=YJAPAERA6HCQQIK5Y3GGX2YF7MWT4SBWNPBG6GROXPRIUNWDIFDA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.197368642 (76h51m42.628448763s) [noise=true , address=104.36.82.42:4827 , piece_id=WWRWBWREVJUV6LQD4APAHLAA7GVHXEWX4Y7TYOEUZ6WTMIOMPM7A, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.217110746 (76h51m42.648190867s) [noise=true , address=77.90.31.14:4678 , piece_id=YSRDQQGIGDI3MMLSC7A6ORWZJCE72U24RNFBLC5MB6OWRQHNLGSA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.217135393 (76h51m42.648215514s) [seg_pos={0 0}, upload=80112]: Segment reached optimal threshold of 14 pieces. Aug 11 22:17:48.217375642 (76h51m42.648455774s) [noise=true , address=104.36.82.5:4846 , piece_id=GY6F7CCISK6M52RILLN443AFXDYFOXOYDQNMDOFEP7WZYP3OKV3A, seg_pos={0 0}, upload=80112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 11 22:17:48.217408495 (76h51m42.648488626s) [noise=true , address=104.36.82.8:4988 , piece_id=A74RKDTLNSF35O5BQMFBO3VZSM356IT7JOF72REVXMVQED4P7QAQ, seg_pos={0 0}, upload=80112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Qs9EDisetfkwcMS8r1d1twWZoTzaz2QZAo2aJakM53ZyJs2Je): protocol: expected piece hash; context canceled; EOF Aug 11 22:17:48.217441529 (76h51m42.64852166s) [noise=true , address=104.36.82.19:4431 , piece_id=PKC6PDUCBM3G7KXNERVA74VCOOVMPKZMKVXJEK7XD3FRFEAYKRAQ, seg_pos={0 0}, upload=80112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12E2efGqgEca5TeZV1bWeH9fcQqrmdNwxuU6kMH26McLkLdxNGR): protocol: rpc: dial tcp 104.36.82.19:4431: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 22:17:48.217472859 (76h51m42.64855299s) [noise=true , address=104.36.82.61:4402 , piece_id=YTLOBJSYCTQPFJNQGOOTFWOA4FBLVPH3CUUHDPP6Z2N6Q4XPLEOA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122bkrGG8zk64AMrcY5h9Xynm2updzvAWsSuQi8tMnjSpQKzJVg): protocol: write tcp 188.166.225.170:55318->104.36.82.61:4402: use of closed network connection; write tcp 188.166.225.170:55318->104.36.82.61:4402: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55318->104.36.82.61:4402: use of closed network connection Aug 11 22:17:48.217488709 (76h51m42.64856884s) [seg_pos={0 0}, upload=80112]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:17:48.217545728 (76h51m42.648625859s) [upload=80112]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:17:48.217549456 (76h51m42.648629587s) [upload=80112]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:17:48.565497198 (76h51m42.996577329s) [upload=80112]: Done uploading segments... Aug 11 22:17:48.565517457 (76h51m42.996597588s) [upload=80112]: Upload finished. err: <nil> Duration: 6.544092967s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [....XX......................................................] duration: 4.222196901s FAIL (2025-08-11 22:18:46 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 17) ======LOGS====== 4SRO752OWZG4Q5T6CLSA, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:47.435217419 (76h14m41.86629755s) [noise=true , address=89.149.201.147:4001 , piece_id=RKJZS5OX3EUD3HGFCRBIUVORRKRBGZ2NMDUKCFPRZW2AGFBLKYDA, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:47.435490742 (76h14m41.866570873s) [noise=true , address=89.149.201.147:4016 , piece_id=XKZQCPO5CGT43AYUQQGKWRPWBZFNU3W2VKW2Y4D3B6CYRNWRB5LQ, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:47.435707035 (76h14m41.866787176s) [noise=true , address=89.149.201.147:4004 , piece_id=GKCEZV6XYZVKP5XMXGYXCDEESZW747VNHGJOYWK5JTQDXDT6RJTA, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:48.239516310 (76h14m42.670596441s) [upload=79474]: Next returned nil segment Aug 11 21:40:48.239549052 (76h14m42.670629173s) [upload=79474]: Waiting for error group managing segments... Aug 11 21:40:48.609972490 (76h14m43.041052621s) [noise=true , address=89.149.201.147:4008 , piece_id=PSP6FLFFPH6LWBEBPXOXF7BIXIEBPL6N5JJJGWKK7BDW5DV3B4VQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.614486426 (76h14m43.045566557s) [noise=true , address=89.149.201.147:4022 , piece_id=FSOKKKC75TFGUTPMR5G6555ICDWHIKNHDBP6B57OADUSHAPH6GDA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.616257926 (76h14m43.047338057s) [noise=true , address=89.149.201.147:4016 , piece_id=XKZQCPO5CGT43AYUQQGKWRPWBZFNU3W2VKW2Y4D3B6CYRNWRB5LQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.621293161 (76h14m43.052373282s) [noise=true , address=89.149.201.147:4004 , piece_id=GKCEZV6XYZVKP5XMXGYXCDEESZW747VNHGJOYWK5JTQDXDT6RJTA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.626661412 (76h14m43.057741543s) [noise=true , address=81.171.14.70:4038 , piece_id=Z64RWC56JGOQMCQWITBQR5OE3P3AYVVWQBHIY4K42AZCTI4AP5YA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.636033735 (76h14m43.067113866s) [noise=true , address=81.171.14.70:4026 , piece_id=4GNYVJ46JRDGYCZSZTXKHCDXTPPOYPJK73XAVZZN5UERRCV3XV6A, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.640209745 (76h14m43.071289876s) [noise=true , address=89.149.201.147:4012 , piece_id=I5YST5TWDCBXTW3XLBEZAG42NCQOCJ5VLSQ3O5BYGR5DUEPOMRBQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.642681474 (76h14m43.073761595s) [noise=true , address=89.149.201.147:4007 , piece_id=YDDPTURQWLPNJJHXOCESM64SEXF5AN37JSSQUUKY7HEDERFMSXWA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.645004419 (76h14m43.07608455s) [noise=true , address=89.149.201.147:4015 , piece_id=6D5FIUSLWJ3YGG4FNGV6EL5H47GNJN25GDMK57XH54JJPREGIRHA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.648884623 (76h14m43.079964754s) [noise=true , address=81.171.14.70:4027 , piece_id=4YKLDKWWINPAF3CRJDUFPDOS4QHL5IYOWIQT7ZOLGZYYXV33GUGQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.650426162 (76h14m43.081506293s) [noise=true , address=81.171.14.70:4032 , piece_id=7DBHWCTPKNTOQSMRI7Z23RPQWGDXQ5I2V4CGUGHFEWFP4P5KL74Q, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.650438025 (76h14m43.081518156s) [noise=true , address=89.149.201.147:4011 , piece_id=3MMNZVMZPGS77URWNUKRRBSX6NMTHIPMRRJWZ6RLLCPW2KXY2WEQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.652018830 (76h14m43.083098961s) [noise=true , address=81.171.14.70:4043 , piece_id=SPNWQM77OMTQPH36DH72T65IGAJP4JU6P52DTNRT3LJ4JVR3O6EQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.658234463 (76h14m43.089314594s) [noise=true , address=81.171.14.70:4047 , piece_id=E3ZKADZBMEO5T7X5HM6ZTLCIN5PQBFKNJSORWIJ4MPUNVRYLUNSA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.659300161 (76h14m43.090380292s) [noise=true , address=89.149.201.147:4001 , piece_id=RKJZS5OX3EUD3HGFCRBIUVORRKRBGZ2NMDUKCFPRZW2AGFBLKYDA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.660027774 (76h14m43.091107905s) [noise=true , address=81.171.14.70:4039 , piece_id=CLAXUB4OGSUJ3WFV7EAVCCRQLRYYOULWECFPEIJOHNDS2DYNCCTQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.679805807 (76h14m43.110885938s) [noise=true , address=81.171.14.70:4045 , piece_id=H3BKI4JHRL7BEBIBWTJZNYU63S3PRCQO7FQPR6QCADJT6IZAY2JA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:41:46.602808629 (76h15m41.03388876s) [noise=true , address=185.167.204.205:4013 , piece_id=G5VQFVD74USTWPZQANS3DS3GVZKNQHBQ32CG6GM2BVNJQJBZX7JQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602837273 (76h15m41.033917394s) [noise=true , address=185.167.204.205:4009 , piece_id=M7GYQHCX6ZAOX2FTDV2WOD3LTT4UYXYGMUKRO5TWMA6RJZW5XTUA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602856751 (76h15m41.033936872s) [noise=true , address=185.167.204.206:4037 , piece_id=WOOJ4QNO6V2QERDBHC76CE7ZINRYOYHJ2UPHMNYSWUHNV436NXAA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12nEq1PMWr39K5LBUcViEtEb1KTnsJLjMaBbNGuqpc13WdZb18R, address:185.167.204.206:4037): protocol: write tcp 188.166.225.170:45748->185.167.204.206:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602871879 (76h15m41.033952s) [noise=true , address=185.167.204.205:4032 , piece_id=7SYA6MKGKBW4NSJHD3BUVYPCMNHTKF3VO2MSMWYUE3G3G2ZCEJBA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602890335 (76h15m41.033970456s) [noise=true , address=185.167.204.206:4038 , piece_id=3NI34S2BMRUFFWWCURLWDYQBIR5VDTZCLE5JSZNZX2JFMJQC3FKQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: rpc: dial tcp 185.167.204.206:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602901646 (76h15m41.033981777s) [noise=true , address=185.167.204.205:4023 , piece_id=FFNPVDRQSVZFKPRE5IQCEHMUA3SBZZV4XC4QJESNRUZQLPSEGZ2Q, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: rpc: dial tcp 185.167.204.205:4023: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602919721 (76h15m41.033999852s) [noise=true , address=185.167.204.206:4072 , piece_id=NTKD7PR6XECRZXUZA767CXZY7VYIFLPM2RENI5ZP3TDU6UVXFM4Q, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: rpc: dial tcp 185.167.204.206:4072: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602932555 (76h15m41.034012686s) [noise=true , address=185.167.204.205:4014 , piece_id=NLF3JAJEOLTK4FPIHPQ4QCBHWQKW2AVGSWCOJDMMOGHSI6EUCBOQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602949328 (76h15m41.034029449s) [noise=true , address=185.167.204.205:4011 , piece_id=UJCY3N7L4OUJL5LZFS6GVER3RDEWZMZTJTZRD3CD4JFQRUZM32UA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: write tcp 188.166.225.170:50060->185.167.204.205:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602962153 (76h15m41.034042284s) [noise=true , address=185.167.204.206:4052 , piece_id=OZW7EGYLJ24I7UYQ357XMBRAMVPALBC3L2MT3YU6SN3MGGC767QQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602981068 (76h15m41.034061199s) [noise=true , address=185.167.204.206:4041 , piece_id=LSRJUXV7L2VGR6XOF74R6HG5QLXBNXNF4SRO752OWZG4Q5T6CLSA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.603000215 (76h15m41.034080346s) [seg_pos={0 0}, upload=79474]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil> Aug 11 21:41:46.778560597 (76h15m41.209640728s) [upload=79474]: Done uploading segments... Aug 11 21:41:46.778585545 (76h15m41.209665676s) [upload=79474]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17) Duration: 4.222225566s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......X.........................................X.X.........] duration: 1.924112479s FAIL (2025-08-11 22:18:22 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after d295b8eeb563de4b48b879f424f9ad08c7fb4dd3bebf44de27a7ca55039b02cb != before 8ab40e22d894e0fc1b2b6af3e54ab06e9aa1481b89a729d8b5523518ea3a89da ======LOGS====== Aug 11 22:11:29.756339814 (76h45m24.187419945s) [upload=80005]: Starting upload Aug 11 22:11:29.756390561 (76h45m24.187470683s) [upload=80005]: Done starting upload Aug 11 22:11:29.756461917 (76h45m24.187542038s) [upload=80005]: Uploading segments... Aug 11 22:11:29.756603629 (76h45m24.18768377s) [upload=80005]: Got next segment. Inline: true Aug 11 22:11:29.756615802 (76h45m24.187695933s) [upload=80005]: Waiting for error group managing segments... Aug 11 22:11:29.756677580 (76h45m24.187757711s) [upload=80005]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:11:29.756683782 (76h45m24.187763913s) [upload=80005]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 22:11:29.756686688 (76h45m24.187766819s) [upload=80005]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:11:30.039257370 (76h45m24.470337501s) [upload=80005]: Done uploading segments... Aug 11 22:11:30.039274463 (76h45m24.470354594s) [upload=80005]: Upload finished. err: <nil> Duration:* 1.92413908s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [.....XX.....................................................] duration: 3.971479126s FAIL (2025-08-11 22:18:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 17) ======LOGS====== 4SRO752OWZG4Q5T6CLSA, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:47.435217419 (76h14m41.86629755s) [noise=true , address=89.149.201.147:4001 , piece_id=RKJZS5OX3EUD3HGFCRBIUVORRKRBGZ2NMDUKCFPRZW2AGFBLKYDA, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:47.435490742 (76h14m41.866570873s) [noise=true , address=89.149.201.147:4016 , piece_id=XKZQCPO5CGT43AYUQQGKWRPWBZFNU3W2VKW2Y4D3B6CYRNWRB5LQ, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:47.435707035 (76h14m41.866787176s) [noise=true , address=89.149.201.147:4004 , piece_id=GKCEZV6XYZVKP5XMXGYXCDEESZW747VNHGJOYWK5JTQDXDT6RJTA, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:48.239516310 (76h14m42.670596441s) [upload=79474]: Next returned nil segment Aug 11 21:40:48.239549052 (76h14m42.670629173s) [upload=79474]: Waiting for error group managing segments... Aug 11 21:40:48.609972490 (76h14m43.041052621s) [noise=true , address=89.149.201.147:4008 , piece_id=PSP6FLFFPH6LWBEBPXOXF7BIXIEBPL6N5JJJGWKK7BDW5DV3B4VQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.614486426 (76h14m43.045566557s) [noise=true , address=89.149.201.147:4022 , piece_id=FSOKKKC75TFGUTPMR5G6555ICDWHIKNHDBP6B57OADUSHAPH6GDA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.616257926 (76h14m43.047338057s) [noise=true , address=89.149.201.147:4016 , piece_id=XKZQCPO5CGT43AYUQQGKWRPWBZFNU3W2VKW2Y4D3B6CYRNWRB5LQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.621293161 (76h14m43.052373282s) [noise=true , address=89.149.201.147:4004 , piece_id=GKCEZV6XYZVKP5XMXGYXCDEESZW747VNHGJOYWK5JTQDXDT6RJTA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.626661412 (76h14m43.057741543s) [noise=true , address=81.171.14.70:4038 , piece_id=Z64RWC56JGOQMCQWITBQR5OE3P3AYVVWQBHIY4K42AZCTI4AP5YA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.636033735 (76h14m43.067113866s) [noise=true , address=81.171.14.70:4026 , piece_id=4GNYVJ46JRDGYCZSZTXKHCDXTPPOYPJK73XAVZZN5UERRCV3XV6A, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.640209745 (76h14m43.071289876s) [noise=true , address=89.149.201.147:4012 , piece_id=I5YST5TWDCBXTW3XLBEZAG42NCQOCJ5VLSQ3O5BYGR5DUEPOMRBQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.642681474 (76h14m43.073761595s) [noise=true , address=89.149.201.147:4007 , piece_id=YDDPTURQWLPNJJHXOCESM64SEXF5AN37JSSQUUKY7HEDERFMSXWA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.645004419 (76h14m43.07608455s) [noise=true , address=89.149.201.147:4015 , piece_id=6D5FIUSLWJ3YGG4FNGV6EL5H47GNJN25GDMK57XH54JJPREGIRHA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.648884623 (76h14m43.079964754s) [noise=true , address=81.171.14.70:4027 , piece_id=4YKLDKWWINPAF3CRJDUFPDOS4QHL5IYOWIQT7ZOLGZYYXV33GUGQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.650426162 (76h14m43.081506293s) [noise=true , address=81.171.14.70:4032 , piece_id=7DBHWCTPKNTOQSMRI7Z23RPQWGDXQ5I2V4CGUGHFEWFP4P5KL74Q, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.650438025 (76h14m43.081518156s) [noise=true , address=89.149.201.147:4011 , piece_id=3MMNZVMZPGS77URWNUKRRBSX6NMTHIPMRRJWZ6RLLCPW2KXY2WEQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.652018830 (76h14m43.083098961s) [noise=true , address=81.171.14.70:4043 , piece_id=SPNWQM77OMTQPH36DH72T65IGAJP4JU6P52DTNRT3LJ4JVR3O6EQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.658234463 (76h14m43.089314594s) [noise=true , address=81.171.14.70:4047 , piece_id=E3ZKADZBMEO5T7X5HM6ZTLCIN5PQBFKNJSORWIJ4MPUNVRYLUNSA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.659300161 (76h14m43.090380292s) [noise=true , address=89.149.201.147:4001 , piece_id=RKJZS5OX3EUD3HGFCRBIUVORRKRBGZ2NMDUKCFPRZW2AGFBLKYDA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.660027774 (76h14m43.091107905s) [noise=true , address=81.171.14.70:4039 , piece_id=CLAXUB4OGSUJ3WFV7EAVCCRQLRYYOULWECFPEIJOHNDS2DYNCCTQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.679805807 (76h14m43.110885938s) [noise=true , address=81.171.14.70:4045 , piece_id=H3BKI4JHRL7BEBIBWTJZNYU63S3PRCQO7FQPR6QCADJT6IZAY2JA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:41:46.602808629 (76h15m41.03388876s) [noise=true , address=185.167.204.205:4013 , piece_id=G5VQFVD74USTWPZQANS3DS3GVZKNQHBQ32CG6GM2BVNJQJBZX7JQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602837273 (76h15m41.033917394s) [noise=true , address=185.167.204.205:4009 , piece_id=M7GYQHCX6ZAOX2FTDV2WOD3LTT4UYXYGMUKRO5TWMA6RJZW5XTUA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602856751 (76h15m41.033936872s) [noise=true , address=185.167.204.206:4037 , piece_id=WOOJ4QNO6V2QERDBHC76CE7ZINRYOYHJ2UPHMNYSWUHNV436NXAA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12nEq1PMWr39K5LBUcViEtEb1KTnsJLjMaBbNGuqpc13WdZb18R, address:185.167.204.206:4037): protocol: write tcp 188.166.225.170:45748->185.167.204.206:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602871879 (76h15m41.033952s) [noise=true , address=185.167.204.205:4032 , piece_id=7SYA6MKGKBW4NSJHD3BUVYPCMNHTKF3VO2MSMWYUE3G3G2ZCEJBA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602890335 (76h15m41.033970456s) [noise=true , address=185.167.204.206:4038 , piece_id=3NI34S2BMRUFFWWCURLWDYQBIR5VDTZCLE5JSZNZX2JFMJQC3FKQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: rpc: dial tcp 185.167.204.206:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602901646 (76h15m41.033981777s) [noise=true , address=185.167.204.205:4023 , piece_id=FFNPVDRQSVZFKPRE5IQCEHMUA3SBZZV4XC4QJESNRUZQLPSEGZ2Q, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: rpc: dial tcp 185.167.204.205:4023: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602919721 (76h15m41.033999852s) [noise=true , address=185.167.204.206:4072 , piece_id=NTKD7PR6XECRZXUZA767CXZY7VYIFLPM2RENI5ZP3TDU6UVXFM4Q, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: rpc: dial tcp 185.167.204.206:4072: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602932555 (76h15m41.034012686s) [noise=true , address=185.167.204.205:4014 , piece_id=NLF3JAJEOLTK4FPIHPQ4QCBHWQKW2AVGSWCOJDMMOGHSI6EUCBOQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602949328 (76h15m41.034029449s) [noise=true , address=185.167.204.205:4011 , piece_id=UJCY3N7L4OUJL5LZFS6GVER3RDEWZMZTJTZRD3CD4JFQRUZM32UA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: write tcp 188.166.225.170:50060->185.167.204.205:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602962153 (76h15m41.034042284s) [noise=true , address=185.167.204.206:4052 , piece_id=OZW7EGYLJ24I7UYQ357XMBRAMVPALBC3L2MT3YU6SN3MGGC767QQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602981068 (76h15m41.034061199s) [noise=true , address=185.167.204.206:4041 , piece_id=LSRJUXV7L2VGR6XOF74R6HG5QLXBNXNF4SRO752OWZG4Q5T6CLSA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.603000215 (76h15m41.034080346s) [seg_pos={0 0}, upload=79474]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil> Aug 11 21:41:46.778560597 (76h15m41.209640728s) [upload=79474]: Done uploading segments... Aug 11 21:41:46.778585545 (76h15m41.209665676s) [upload=79474]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17) Duration: 3.971553077s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 2 out of 60 is failed (threshold=3) [......XX....................................................] duration: 3.965790622s FAIL (2025-08-11 22:17:59 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 26 but got 17) ======LOGS====== 4SRO752OWZG4Q5T6CLSA, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:47.435217419 (76h14m41.86629755s) [noise=true , address=89.149.201.147:4001 , piece_id=RKJZS5OX3EUD3HGFCRBIUVORRKRBGZ2NMDUKCFPRZW2AGFBLKYDA, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:47.435490742 (76h14m41.866570873s) [noise=true , address=89.149.201.147:4016 , piece_id=XKZQCPO5CGT43AYUQQGKWRPWBZFNU3W2VKW2Y4D3B6CYRNWRB5LQ, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:47.435707035 (76h14m41.866787176s) [noise=true , address=89.149.201.147:4004 , piece_id=GKCEZV6XYZVKP5XMXGYXCDEESZW747VNHGJOYWK5JTQDXDT6RJTA, seg_pos={0 0}, upload=79474]: Uploading piece... Aug 11 21:40:48.239516310 (76h14m42.670596441s) [upload=79474]: Next returned nil segment Aug 11 21:40:48.239549052 (76h14m42.670629173s) [upload=79474]: Waiting for error group managing segments... Aug 11 21:40:48.609972490 (76h14m43.041052621s) [noise=true , address=89.149.201.147:4008 , piece_id=PSP6FLFFPH6LWBEBPXOXF7BIXIEBPL6N5JJJGWKK7BDW5DV3B4VQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.614486426 (76h14m43.045566557s) [noise=true , address=89.149.201.147:4022 , piece_id=FSOKKKC75TFGUTPMR5G6555ICDWHIKNHDBP6B57OADUSHAPH6GDA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.616257926 (76h14m43.047338057s) [noise=true , address=89.149.201.147:4016 , piece_id=XKZQCPO5CGT43AYUQQGKWRPWBZFNU3W2VKW2Y4D3B6CYRNWRB5LQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.621293161 (76h14m43.052373282s) [noise=true , address=89.149.201.147:4004 , piece_id=GKCEZV6XYZVKP5XMXGYXCDEESZW747VNHGJOYWK5JTQDXDT6RJTA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.626661412 (76h14m43.057741543s) [noise=true , address=81.171.14.70:4038 , piece_id=Z64RWC56JGOQMCQWITBQR5OE3P3AYVVWQBHIY4K42AZCTI4AP5YA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.636033735 (76h14m43.067113866s) [noise=true , address=81.171.14.70:4026 , piece_id=4GNYVJ46JRDGYCZSZTXKHCDXTPPOYPJK73XAVZZN5UERRCV3XV6A, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.640209745 (76h14m43.071289876s) [noise=true , address=89.149.201.147:4012 , piece_id=I5YST5TWDCBXTW3XLBEZAG42NCQOCJ5VLSQ3O5BYGR5DUEPOMRBQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.642681474 (76h14m43.073761595s) [noise=true , address=89.149.201.147:4007 , piece_id=YDDPTURQWLPNJJHXOCESM64SEXF5AN37JSSQUUKY7HEDERFMSXWA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.645004419 (76h14m43.07608455s) [noise=true , address=89.149.201.147:4015 , piece_id=6D5FIUSLWJ3YGG4FNGV6EL5H47GNJN25GDMK57XH54JJPREGIRHA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.648884623 (76h14m43.079964754s) [noise=true , address=81.171.14.70:4027 , piece_id=4YKLDKWWINPAF3CRJDUFPDOS4QHL5IYOWIQT7ZOLGZYYXV33GUGQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.650426162 (76h14m43.081506293s) [noise=true , address=81.171.14.70:4032 , piece_id=7DBHWCTPKNTOQSMRI7Z23RPQWGDXQ5I2V4CGUGHFEWFP4P5KL74Q, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.650438025 (76h14m43.081518156s) [noise=true , address=89.149.201.147:4011 , piece_id=3MMNZVMZPGS77URWNUKRRBSX6NMTHIPMRRJWZ6RLLCPW2KXY2WEQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.652018830 (76h14m43.083098961s) [noise=true , address=81.171.14.70:4043 , piece_id=SPNWQM77OMTQPH36DH72T65IGAJP4JU6P52DTNRT3LJ4JVR3O6EQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.658234463 (76h14m43.089314594s) [noise=true , address=81.171.14.70:4047 , piece_id=E3ZKADZBMEO5T7X5HM6ZTLCIN5PQBFKNJSORWIJ4MPUNVRYLUNSA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.659300161 (76h14m43.090380292s) [noise=true , address=89.149.201.147:4001 , piece_id=RKJZS5OX3EUD3HGFCRBIUVORRKRBGZ2NMDUKCFPRZW2AGFBLKYDA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.660027774 (76h14m43.091107905s) [noise=true , address=81.171.14.70:4039 , piece_id=CLAXUB4OGSUJ3WFV7EAVCCRQLRYYOULWECFPEIJOHNDS2DYNCCTQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:40:48.679805807 (76h14m43.110885938s) [noise=true , address=81.171.14.70:4045 , piece_id=H3BKI4JHRL7BEBIBWTJZNYU63S3PRCQO7FQPR6QCADJT6IZAY2JA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: <nil> Aug 11 21:41:46.602808629 (76h15m41.03388876s) [noise=true , address=185.167.204.205:4013 , piece_id=G5VQFVD74USTWPZQANS3DS3GVZKNQHBQ32CG6GM2BVNJQJBZX7JQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1DJ9zLuqKQthmHgaSqovGQo8Sq4h8ymNV3vYc5XapvsxCVBrL5, address:185.167.204.205:4013): protocol: rpc: dial tcp 185.167.204.205:4013: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602837273 (76h15m41.033917394s) [noise=true , address=185.167.204.205:4009 , piece_id=M7GYQHCX6ZAOX2FTDV2WOD3LTT4UYXYGMUKRO5TWMA6RJZW5XTUA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1bGUwUMQeVuL4HCvsRkMSPsgzByNWwMvx6t7HmQ7WLsXoJytgb, address:185.167.204.205:4009): protocol: rpc: dial tcp 185.167.204.205:4009: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602856751 (76h15m41.033936872s) [noise=true , address=185.167.204.206:4037 , piece_id=WOOJ4QNO6V2QERDBHC76CE7ZINRYOYHJ2UPHMNYSWUHNV436NXAA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12nEq1PMWr39K5LBUcViEtEb1KTnsJLjMaBbNGuqpc13WdZb18R, address:185.167.204.206:4037): protocol: write tcp 188.166.225.170:45748->185.167.204.206:4037: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602871879 (76h15m41.033952s) [noise=true , address=185.167.204.205:4032 , piece_id=7SYA6MKGKBW4NSJHD3BUVYPCMNHTKF3VO2MSMWYUE3G3G2ZCEJBA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12558dx7zMNDfabV55vSsP9XwdxXgoPM8aHW53femVZzkCRxsKN, address:185.167.204.205:4032): protocol: rpc: dial tcp 185.167.204.205:4032: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602890335 (76h15m41.033970456s) [noise=true , address=185.167.204.206:4038 , piece_id=3NI34S2BMRUFFWWCURLWDYQBIR5VDTZCLE5JSZNZX2JFMJQC3FKQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1jtjiXHQRFhyw6vb8A1RDPfe4j2283znmAZiZCBmrvFpQrqJiT, address:185.167.204.206:4038): protocol: rpc: dial tcp 185.167.204.206:4038: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602901646 (76h15m41.033981777s) [noise=true , address=185.167.204.205:4023 , piece_id=FFNPVDRQSVZFKPRE5IQCEHMUA3SBZZV4XC4QJESNRUZQLPSEGZ2Q, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12Mr4R5VQs9NbCHNZonSC42mesJNuJ2Co3BbU7LTfLPQwWEkQbo, address:185.167.204.205:4023): protocol: rpc: dial tcp 185.167.204.205:4023: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602919721 (76h15m41.033999852s) [noise=true , address=185.167.204.206:4072 , piece_id=NTKD7PR6XECRZXUZA767CXZY7VYIFLPM2RENI5ZP3TDU6UVXFM4Q, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:17uNR1rhasAqhitGStEMyeW7EmHrz7R87jr5nJB7S7CbZvy59v, address:185.167.204.206:4072): protocol: rpc: dial tcp 185.167.204.206:4072: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602932555 (76h15m41.034012686s) [noise=true , address=185.167.204.205:4014 , piece_id=NLF3JAJEOLTK4FPIHPQ4QCBHWQKW2AVGSWCOJDMMOGHSI6EUCBOQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12ajStqnU4gCGh2ffTPhrFAP9UtB8ybC9Y4pmgnHfx5hK3rVk8q, address:185.167.204.205:4014): protocol: rpc: dial tcp 185.167.204.205:4014: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602949328 (76h15m41.034029449s) [noise=true , address=185.167.204.205:4011 , piece_id=UJCY3N7L4OUJL5LZFS6GVER3RDEWZMZTJTZRD3CD4JFQRUZM32UA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12CiRxadZgQLgJ41bv86hSTEHLv2CzXC4jz9Q3r5dLEX6doYoZ3, address:185.167.204.205:4011): protocol: write tcp 188.166.225.170:50060->185.167.204.205:4011: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602962153 (76h15m41.034042284s) [noise=true , address=185.167.204.206:4052 , piece_id=OZW7EGYLJ24I7UYQ357XMBRAMVPALBC3L2MT3YU6SN3MGGC767QQ, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:12Xr3UmaAcshmxZMecu5i7VHA6LJxiZm9u6wngapEma3hz3tNmn, address:185.167.204.206:4052): protocol: rpc: dial tcp 185.167.204.206:4052: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.602981068 (76h15m41.034061199s) [noise=true , address=185.167.204.206:4041 , piece_id=LSRJUXV7L2VGR6XOF74R6HG5QLXBNXNF4SRO752OWZG4Q5T6CLSA, seg_pos={0 0}, upload=79474]: Done uploading piece. err: ecclient: upload failed (node:1m3rag6G75ZAJkXs6tMaHceq1e2mxp2LrYW8zct4p1Ra3pNhaC, address:185.167.204.206:4041): protocol: rpc: dial tcp 185.167.204.206:4041: i/o timeout; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 21:41:46.603000215 (76h15m41.034080346s) [seg_pos={0 0}, upload=79474]: Done waiting for segment. successful: 17 optimal: 26 errs: <nil> Aug 11 21:41:46.778560597 (76h15m41.209640728s) [upload=79474]: Done uploading segments... Aug 11 21:41:46.778585545 (76h15m41.209665676s) [upload=79474]: Upload finished. err: failed to upload enough pieces (needed at least 26 but got 17) Duration: 3.965818636s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............X............X..............................X] duration: 6.843137442s FAIL (2025-08-11 22:17:51 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after 756734e5fe5aacc912a117be42418de9d74c6a969be799843b3b6e158dbae1f0 != before f90f0abc2f6e52593c1b4257def406a4152737656ca4e5dcff878c955ea374b9 ======LOGS====== Aug 11 22:17:45.390768560 (76h51m39.821848691s) [upload=80112]: Starting upload Aug 11 22:17:45.390818554 (76h51m39.821898685s) [upload=80112]: Done starting upload Aug 11 22:17:45.390934647 (76h51m39.822014788s) [upload=80112]: Uploading segments... Aug 11 22:17:45.391041151 (76h51m39.822121292s) [upload=80112]: Got next segment. Inline: false Aug 11 22:17:45.391085936 (76h51m39.822166067s) [upload=80112]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:17:45.391091447 (76h51m39.822171578s) [upload=80112]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 11 22:17:46.020620439 (76h51m40.45170057s) [seg_pos={0 0}, upload=80112]: Begin upload segment... Aug 11 22:17:46.020671556 (76h51m40.451751677s) [seg_pos={0 0}, upload=80112]: Done begin upload segment. Aug 11 22:17:46.020692717 (76h51m40.451772848s) [noise=true , address=64.49.13.27:4959 , piece_id=KV4U2P4NBCIRPF4NLH6EIHEFRH5GVGRSH3LB2F7HIHEN2FDBUJBA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.020733225 (76h51m40.451813356s) [noise=true , address=104.36.82.46:4492 , piece_id=B4KBH2TWVFYYYNQHQEBYCDCHN3QQD5NP6TZFNNDWJM2I57ZLWYUA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.021078204 (76h51m40.452158335s) [noise=true , address=104.36.82.42:4827 , piece_id=WWRWBWREVJUV6LQD4APAHLAA7GVHXEWX4Y7TYOEUZ6WTMIOMPM7A, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.021162876 (76h51m40.452243007s) [noise=true , address=104.36.82.34:4564 , piece_id=PFBML5JMRRODB67EWDYGQCXM757GGPXAOOKWVXMAZQHQBVWCS5VQ, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.021351287 (76h51m40.452431418s) [noise=true , address=104.36.82.5:4846 , piece_id=GY6F7CCISK6M52RILLN443AFXDYFOXOYDQNMDOFEP7WZYP3OKV3A, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.021848057 (76h51m40.452928188s) [noise=true , address=104.36.82.62:4435 , piece_id=GG6LKKY5JG2U6MEJND4ZCGWLP6356HONFI7C5O46DKIXW7VFA33Q, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.021937329 (76h51m40.45301746s) [noise=true , address=104.36.82.9:4008 , piece_id=WBTKQQ5WCYIV4R6MG4TACIF7WI3TC7JAO6K35M3JPCQZ4CUZNP6Q, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.022384644 (76h51m40.453464775s) [noise=true , address=64.49.13.138:4487 , piece_id=VAXCN755CK6W5JIFKRN62IOM4V6SABWZ3I66A4NGH5DLBDBMLSKA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.022722891 (76h51m40.453803022s) [noise=true , address=79.127.205.234:4600 , piece_id=BJ2RSZYG2QZLAECCB6IV3QWNO7FUN5GYYMHX7OOOUANMNAJRBITA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.023272483 (76h51m40.454352614s) [noise=true , address=193.149.164.143:4693 , piece_id=UBXV6NRFCXIESASUMUBU5Z2ZDZVACL45JIPN5HW57NXIVS6Z3XVQ, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.023623805 (76h51m40.454703936s) [noise=true , address=64.49.13.170:4722 , piece_id=CYFRQQR567OT6UFWC2BTMNA6QP6VSZCAPKXM6F66GSOCFR3QF63Q, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.024032137 (76h51m40.455112268s) [noise=true , address=104.36.82.61:4402 , piece_id=YTLOBJSYCTQPFJNQGOOTFWOA4FBLVPH3CUUHDPP6Z2N6Q4XPLEOA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.024460216 (76h51m40.455540347s) [noise=true , address=104.36.82.8:4988 , piece_id=A74RKDTLNSF35O5BQMFBO3VZSM356IT7JOF72REVXMVQED4P7QAQ, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.024746373 (76h51m40.455826504s) [noise=true , address=104.36.82.17:4345 , piece_id=IIPOLWUADV7YO4ULANL3APTLQSA4ZFEDHQ63EWBKXY4DF6DX63DA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.034125720 (76h51m40.465205851s) [noise=true , address=104.36.82.23:4446 , piece_id=UM2YZ2JSGQIJ2BYPIY27HGUN6BOWSZVF7774XXZ63EC65NBWGETA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.034459087 (76h51m40.465539218s) [noise=true , address=104.36.82.19:4431 , piece_id=PKC6PDUCBM3G7KXNERVA74VCOOVMPKZMKVXJEK7XD3FRFEAYKRAQ, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.034747659 (76h51m40.46582778s) [noise=true , address=77.90.31.14:4678 , piece_id=YSRDQQGIGDI3MMLSC7A6ORWZJCE72U24RNFBLC5MB6OWRQHNLGSA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:46.035026874 (76h51m40.466107005s) [noise=true , address=104.36.82.18:4366 , piece_id=YJAPAERA6HCQQIK5Y3GGX2YF7MWT4SBWNPBG6GROXPRIUNWDIFDA, seg_pos={0 0}, upload=80112]: Uploading piece... Aug 11 22:17:47.173903245 (76h51m41.604983376s) [upload=80112]: Next returned nil segment Aug 11 22:17:47.173919425 (76h51m41.604999556s) [upload=80112]: Waiting for error group managing segments... Aug 11 22:17:47.490868386 (76h51m41.921948517s) [noise=true , address=64.49.13.138:4487 , piece_id=VAXCN755CK6W5JIFKRN62IOM4V6SABWZ3I66A4NGH5DLBDBMLSKA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:47.507960559 (76h51m41.93904068s) [noise=true , address=79.127.205.234:4600 , piece_id=BJ2RSZYG2QZLAECCB6IV3QWNO7FUN5GYYMHX7OOOUANMNAJRBITA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:47.544288628 (76h51m41.97536876s) [noise=true , address=64.49.13.170:4722 , piece_id=CYFRQQR567OT6UFWC2BTMNA6QP6VSZCAPKXM6F66GSOCFR3QF63Q, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:47.550382108 (76h51m41.981462239s) [noise=true , address=193.149.164.143:4693 , piece_id=UBXV6NRFCXIESASUMUBU5Z2ZDZVACL45JIPN5HW57NXIVS6Z3XVQ, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:47.556377930 (76h51m41.987458051s) [noise=true , address=64.49.13.27:4959 , piece_id=KV4U2P4NBCIRPF4NLH6EIHEFRH5GVGRSH3LB2F7HIHEN2FDBUJBA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.006078293 (76h51m42.437158434s) [noise=true , address=104.36.82.46:4492 , piece_id=B4KBH2TWVFYYYNQHQEBYCDCHN3QQD5NP6TZFNNDWJM2I57ZLWYUA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.011273122 (76h51m42.442353273s) [noise=true , address=104.36.82.62:4435 , piece_id=GG6LKKY5JG2U6MEJND4ZCGWLP6356HONFI7C5O46DKIXW7VFA33Q, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.019925798 (76h51m42.451005929s) [noise=true , address=104.36.82.23:4446 , piece_id=UM2YZ2JSGQIJ2BYPIY27HGUN6BOWSZVF7774XXZ63EC65NBWGETA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.095164618 (76h51m42.526244749s) [noise=true , address=104.36.82.34:4564 , piece_id=PFBML5JMRRODB67EWDYGQCXM757GGPXAOOKWVXMAZQHQBVWCS5VQ, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.130420175 (76h51m42.561500306s) [noise=true , address=104.36.82.9:4008 , piece_id=WBTKQQ5WCYIV4R6MG4TACIF7WI3TC7JAO6K35M3JPCQZ4CUZNP6Q, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.144363894 (76h51m42.575444026s) [noise=true , address=104.36.82.17:4345 , piece_id=IIPOLWUADV7YO4ULANL3APTLQSA4ZFEDHQ63EWBKXY4DF6DX63DA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.169714420 (76h51m42.600794551s) [noise=true , address=104.36.82.18:4366 , piece_id=YJAPAERA6HCQQIK5Y3GGX2YF7MWT4SBWNPBG6GROXPRIUNWDIFDA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.197368642 (76h51m42.628448763s) [noise=true , address=104.36.82.42:4827 , piece_id=WWRWBWREVJUV6LQD4APAHLAA7GVHXEWX4Y7TYOEUZ6WTMIOMPM7A, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.217110746 (76h51m42.648190867s) [noise=true , address=77.90.31.14:4678 , piece_id=YSRDQQGIGDI3MMLSC7A6ORWZJCE72U24RNFBLC5MB6OWRQHNLGSA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: <nil> Aug 11 22:17:48.217135393 (76h51m42.648215514s) [seg_pos={0 0}, upload=80112]: Segment reached optimal threshold of 14 pieces. Aug 11 22:17:48.217375642 (76h51m42.648455774s) [noise=true , address=104.36.82.5:4846 , piece_id=GY6F7CCISK6M52RILLN443AFXDYFOXOYDQNMDOFEP7WZYP3OKV3A, seg_pos={0 0}, upload=80112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12MRTmrurAdfTtQqWboq2Z44yrzBKivkihfXeZ9bkCeGPcLF6iR): protocol: expected piece hash; context canceled; EOF Aug 11 22:17:48.217408495 (76h51m42.648488626s) [noise=true , address=104.36.82.8:4988 , piece_id=A74RKDTLNSF35O5BQMFBO3VZSM356IT7JOF72REVXMVQED4P7QAQ, seg_pos={0 0}, upload=80112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Qs9EDisetfkwcMS8r1d1twWZoTzaz2QZAo2aJakM53ZyJs2Je): protocol: expected piece hash; context canceled; EOF Aug 11 22:17:48.217441529 (76h51m42.64852166s) [noise=true , address=104.36.82.19:4431 , piece_id=PKC6PDUCBM3G7KXNERVA74VCOOVMPKZMKVXJEK7XD3FRFEAYKRAQ, seg_pos={0 0}, upload=80112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12E2efGqgEca5TeZV1bWeH9fcQqrmdNwxuU6kMH26McLkLdxNGR): protocol: rpc: dial tcp 104.36.82.19:4431: operation was canceled; conn closed: op; piecestore: piecestore close: conn closed: op Aug 11 22:17:48.217472859 (76h51m42.64855299s) [noise=true , address=104.36.82.61:4402 , piece_id=YTLOBJSYCTQPFJNQGOOTFWOA4FBLVPH3CUUHDPP6Z2N6Q4XPLEOA, seg_pos={0 0}, upload=80112]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122bkrGG8zk64AMrcY5h9Xynm2updzvAWsSuQi8tMnjSpQKzJVg): protocol: write tcp 188.166.225.170:55318->104.36.82.61:4402: use of closed network connection; write tcp 188.166.225.170:55318->104.36.82.61:4402: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55318->104.36.82.61:4402: use of closed network connection Aug 11 22:17:48.217488709 (76h51m42.64856884s) [seg_pos={0 0}, upload=80112]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 11 22:17:48.217545728 (76h51m42.648625859s) [upload=80112]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 11 22:17:48.217549456 (76h51m42.648629587s) [upload=80112]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:17:48.565497198 (76h51m42.996577329s) [upload=80112]: Done uploading segments... Aug 11 22:17:48.565517457 (76h51m42.996597588s) [upload=80112]: Upload finished. err: <nil> Duration: 6.843165194s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......X.........................................X.X........] duration: 1.913259203s FAIL (2025-08-11 22:17:38 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after d295b8eeb563de4b48b879f424f9ad08c7fb4dd3bebf44de27a7ca55039b02cb != before 8ab40e22d894e0fc1b2b6af3e54ab06e9aa1481b89a729d8b5523518ea3a89da ======LOGS====== Aug 11 22:11:29.756339814 (76h45m24.187419945s) [upload=80005]: Starting upload Aug 11 22:11:29.756390561 (76h45m24.187470683s) [upload=80005]: Done starting upload Aug 11 22:11:29.756461917 (76h45m24.187542038s) [upload=80005]: Uploading segments... Aug 11 22:11:29.756603629 (76h45m24.18768377s) [upload=80005]: Got next segment. Inline: true Aug 11 22:11:29.756615802 (76h45m24.187695933s) [upload=80005]: Waiting for error group managing segments... Aug 11 22:11:29.756677580 (76h45m24.187757711s) [upload=80005]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:11:29.756683782 (76h45m24.187763913s) [upload=80005]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 22:11:29.756686688 (76h45m24.187766819s) [upload=80005]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:11:30.039257370 (76h45m24.470337501s) [upload=80005]: Done uploading segments... Aug 11 22:11:30.039274463 (76h45m24.470354594s) [upload=80005]: Upload finished. err: <nil> Duration:* 1.913279802s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........X.........................................X.X.......] duration: 1.9104051s FAIL (2025-08-11 22:17:12 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after d295b8eeb563de4b48b879f424f9ad08c7fb4dd3bebf44de27a7ca55039b02cb != before 8ab40e22d894e0fc1b2b6af3e54ab06e9aa1481b89a729d8b5523518ea3a89da ======LOGS====== Aug 11 22:11:29.756339814 (76h45m24.187419945s) [upload=80005]: Starting upload Aug 11 22:11:29.756390561 (76h45m24.187470683s) [upload=80005]: Done starting upload Aug 11 22:11:29.756461917 (76h45m24.187542038s) [upload=80005]: Uploading segments... Aug 11 22:11:29.756603629 (76h45m24.18768377s) [upload=80005]: Got next segment. Inline: true Aug 11 22:11:29.756615802 (76h45m24.187695933s) [upload=80005]: Waiting for error group managing segments... Aug 11 22:11:29.756677580 (76h45m24.187757711s) [upload=80005]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 11 22:11:29.756683782 (76h45m24.187763913s) [upload=80005]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 11 22:11:29.756686688 (76h45m24.187766819s) [upload=80005]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 11 22:11:30.039257370 (76h45m24.470337501s) [upload=80005]: Done uploading segments... Aug 11 22:11:30.039274463 (76h45m24.470354594s) [upload=80005]: Upload finished. err: <nil> Duration:* 1.910431901s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)