Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure

Orbiter Check History

Showing 50 of 353084 reports (Page 203 of 7062)
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [.................X...X......X............X..................]
duration: 
30.609952218s
trace: 
https://jaeger.dev.storj.io/trace/45b769fc71e13448
FAIL (2025-12-30 06:36:10 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
.577697683 (590h53m11.448780728s) [noise=true , address=193.149.164.143:4704 , piece_id=4T2IJIA6WHI5LMIUP5BLJLCD3GRY3A6PXR6G5OWJWUSYZT5ELGHQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578173528 (590h53m11.449256573s) [noise=true , address=64.49.13.27:4965     , piece_id=CO4O5F2IBZAAKBZBV3HWNNOXZOGLNNDPALWMQZ3DEM3MREASVFEA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578542992 (590h53m11.449626027s) [noise=true , address=77.90.31.15:4729     , piece_id=NVMXFEILHGT622IIPYYT4FFHC2WZLHMCZM4VT5WUPHRAPH3DX6TA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578846911 (590h53m11.449929946s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579458044 (590h53m11.450541089s) [noise=true , address=45.91.116.11:4150    , piece_id=E66IDHTJDLYLYJIOWMOIKOOWLXCUNCMBIQ7SQBAD3VTJF6VX5JLQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579891209 (590h53m11.450974245s) [noise=true , address=145.79.227.29:4945   , piece_id=SHL73IDEI54GRCWYNWHRUSJZZ4UUXREAX54DFJLTG5QPZCF5QKIQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579915535 (590h53m11.45099858s) [noise=true , address=145.79.227.30:4772   , piece_id=PVMD5DWRRPVARTSZ6O7HN6MUVTZUYWLYSNQR5GDMNKUJZGXMYPFQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580325466 (590h53m11.451408511s) [noise=true , address=77.90.31.12:4603     , piece_id=2I4L7F2WEGK5OSLODJSJ4672URBA7DUGXWZKTYB6ZNA2TQIGVXWA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580379599 (590h53m11.451462644s) [noise=true , address=77.90.31.14:4671     , piece_id=263TRISJ5ADFTX43ULSSGBAF2KMOXAPISJ56LLE53D74XOEMQ5EA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580692044 (590h53m11.451775089s) [noise=true , address=145.79.227.3:4175    , piece_id=UCV5WQNVWEAMEDBWDNXEVSQEGXPJE7KD6YSWC5A4WXYUKUCK4NLA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580857859 (590h53m11.451940894s) [noise=true , address=77.90.31.19:4860     , piece_id=U2MNFOAD7FHCDBE4FUYOROIP3P33ROJ7K75SF5Z747EFKFTF7RGA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581089210 (590h53m11.452172255s) [noise=true , address=145.79.227.44:4203   , piece_id=WHCKQ2FRLYAZE7Q6HYZNTS4EISVHZNAPDDKH34WN33ALK4MVK2EA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581351320 (590h53m11.452434355s) [noise=true , address=64.49.13.154:4928    , piece_id=SEVBZBMNGURP5TRUEBA4PHRSA6MNANVJUKINALJUWPQWBGKVYNTA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581457091 (590h53m11.452540126s) [noise=true , address=145.79.227.34:4909   , piece_id=3QSWTNR5LGUUAY3N5HJKSPL3TRQ6WO5F5OD4VTXKWHWUXUF7PVVQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581863144 (590h53m11.452946179s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.584010443 (590h53m11.455093478s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.585122791 (590h53m11.456205826s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:12.983305402 (590h53m12.854388447s) [upload=517998]: Next returned nil segment
Dec 30 06:22:12.983321313 (590h53m12.854404348s) [upload=517998]: Waiting for error group managing segments...
Dec 30 06:22:13.379703053 (590h53m13.250786088s) [noise=true , address=64.49.13.27:4965     , piece_id=CO4O5F2IBZAAKBZBV3HWNNOXZOGLNNDPALWMQZ3DEM3MREASVFEA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.418055622 (590h53m13.289138657s) [noise=true , address=145.79.227.3:4175    , piece_id=UCV5WQNVWEAMEDBWDNXEVSQEGXPJE7KD6YSWC5A4WXYUKUCK4NLA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.509034160 (590h53m13.380117205s) [noise=true , address=64.49.13.154:4928    , piece_id=SEVBZBMNGURP5TRUEBA4PHRSA6MNANVJUKINALJUWPQWBGKVYNTA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.642886154 (590h53m13.513969199s) [noise=true , address=77.90.31.14:4671     , piece_id=263TRISJ5ADFTX43ULSSGBAF2KMOXAPISJ56LLE53D74XOEMQ5EA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.788145520 (590h53m13.659228555s) [noise=true , address=77.90.31.12:4603     , piece_id=2I4L7F2WEGK5OSLODJSJ4672URBA7DUGXWZKTYB6ZNA2TQIGVXWA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.858878757 (590h53m13.729961792s) [noise=true , address=145.79.227.49:4369   , piece_id=XUEXGNJJIJ4DUBDNUV7CKF6J5JYHSLZAEPVGEDGBUBY42BIP4XEQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.879550569 (590h53m13.750633614s) [noise=true , address=145.79.227.34:4909   , piece_id=3QSWTNR5LGUUAY3N5HJKSPL3TRQ6WO5F5OD4VTXKWHWUXUF7PVVQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.940897723 (590h53m13.811980769s) [noise=true , address=77.90.31.19:4860     , piece_id=U2MNFOAD7FHCDBE4FUYOROIP3P33ROJ7K75SF5Z747EFKFTF7RGA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.989791936 (590h53m13.860874981s) [noise=true , address=45.91.116.11:4150    , piece_id=E66IDHTJDLYLYJIOWMOIKOOWLXCUNCMBIQ7SQBAD3VTJF6VX5JLQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.289516718 (590h53m14.160599753s) [noise=true , address=145.79.227.44:4203   , piece_id=WHCKQ2FRLYAZE7Q6HYZNTS4EISVHZNAPDDKH34WN33ALK4MVK2EA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.338651537 (590h53m14.209734582s) [noise=true , address=77.90.31.15:4729     , piece_id=NVMXFEILHGT622IIPYYT4FFHC2WZLHMCZM4VT5WUPHRAPH3DX6TA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.344145168 (590h53m14.215228213s) [noise=true , address=145.79.227.30:4772   , piece_id=PVMD5DWRRPVARTSZ6O7HN6MUVTZUYWLYSNQR5GDMNKUJZGXMYPFQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.667232847 (590h53m14.538315892s) [noise=true , address=193.149.164.143:4704 , piece_id=4T2IJIA6WHI5LMIUP5BLJLCD3GRY3A6PXR6G5OWJWUSYZT5ELGHQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.671388990 (590h53m14.542472025s) [noise=true , address=145.79.227.29:4945   , piece_id=SHL73IDEI54GRCWYNWHRUSJZZ4UUXREAX54DFJLTG5QPZCF5QKIQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.671415190 (590h53m14.542498226s) [seg_pos={0 0}, upload=517998]: Segment reached optimal threshold of 14 pieces.
Dec 30 06:22:14.671803600 (590h53m14.542886655s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hU1LwL2gX7rVnrNgzaBCYB37ziqf7s7aUgtF2Uc3antReQ6me): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.671814470 (590h53m14.542897525s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672014932 (590h53m14.543097977s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bhN3cR22QuAYihnnB3x3R97UZRWJ8sFPP8fjQcXZ7qhNZphZG): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672022637 (590h53m14.543105672s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672088933 (590h53m14.543171988s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672127677 (590h53m14.543210742s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672312739 (590h53m14.543395774s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSXWFiq27Dd2vBDD9vVnhDHVG59UmDKn3hVAhf3oyo5goVNaE): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672319953 (590h53m14.543402988s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672337847 (590h53m14.543420882s) [seg_pos={0 0}, upload=517998]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 30 06:22:14.672452947 (590h53m14.543535982s) [upload=517998]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:22:14.672458507 (590h53m14.543541542s) [upload=517998]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:22:14.981437069 (590h53m14.852520114s) [upload=517998]: Done uploading segments...
Dec 30 06:22:14.981456546 (590h53m14.852539581s) [upload=517998]: Upload finished. err: <nil>
Duration: 30.609970453s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
7 out of 60 is failed (threshold=6) [................X...........X..............XX...X......X..X.]
duration: 
5.00073036s
trace: 
https://jaeger.dev.storj.io/trace/30c47f8e5a5f412a
FAIL (2025-12-30 06:36:07 UTC) 
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.000758634s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.................................X..........................]
duration: 
6.318951765s
trace: 
https://jaeger.dev.storj.io/trace/deb96436003dee
FAIL (2025-12-30 06:35:57 UTC) 
orbiter warning: read tcp 188.166.225.170:52458->45.38.24.2:443: read: connection reset by peer
Duration: 6.31900643s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [..................X...X......X............X.................]
duration: 
40.321493938s
trace: 
https://jaeger.dev.storj.io/trace/45b769fc71e13448
FAIL (2025-12-30 06:35:39 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
.577697683 (590h53m11.448780728s) [noise=true , address=193.149.164.143:4704 , piece_id=4T2IJIA6WHI5LMIUP5BLJLCD3GRY3A6PXR6G5OWJWUSYZT5ELGHQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578173528 (590h53m11.449256573s) [noise=true , address=64.49.13.27:4965     , piece_id=CO4O5F2IBZAAKBZBV3HWNNOXZOGLNNDPALWMQZ3DEM3MREASVFEA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578542992 (590h53m11.449626027s) [noise=true , address=77.90.31.15:4729     , piece_id=NVMXFEILHGT622IIPYYT4FFHC2WZLHMCZM4VT5WUPHRAPH3DX6TA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578846911 (590h53m11.449929946s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579458044 (590h53m11.450541089s) [noise=true , address=45.91.116.11:4150    , piece_id=E66IDHTJDLYLYJIOWMOIKOOWLXCUNCMBIQ7SQBAD3VTJF6VX5JLQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579891209 (590h53m11.450974245s) [noise=true , address=145.79.227.29:4945   , piece_id=SHL73IDEI54GRCWYNWHRUSJZZ4UUXREAX54DFJLTG5QPZCF5QKIQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579915535 (590h53m11.45099858s) [noise=true , address=145.79.227.30:4772   , piece_id=PVMD5DWRRPVARTSZ6O7HN6MUVTZUYWLYSNQR5GDMNKUJZGXMYPFQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580325466 (590h53m11.451408511s) [noise=true , address=77.90.31.12:4603     , piece_id=2I4L7F2WEGK5OSLODJSJ4672URBA7DUGXWZKTYB6ZNA2TQIGVXWA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580379599 (590h53m11.451462644s) [noise=true , address=77.90.31.14:4671     , piece_id=263TRISJ5ADFTX43ULSSGBAF2KMOXAPISJ56LLE53D74XOEMQ5EA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580692044 (590h53m11.451775089s) [noise=true , address=145.79.227.3:4175    , piece_id=UCV5WQNVWEAMEDBWDNXEVSQEGXPJE7KD6YSWC5A4WXYUKUCK4NLA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580857859 (590h53m11.451940894s) [noise=true , address=77.90.31.19:4860     , piece_id=U2MNFOAD7FHCDBE4FUYOROIP3P33ROJ7K75SF5Z747EFKFTF7RGA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581089210 (590h53m11.452172255s) [noise=true , address=145.79.227.44:4203   , piece_id=WHCKQ2FRLYAZE7Q6HYZNTS4EISVHZNAPDDKH34WN33ALK4MVK2EA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581351320 (590h53m11.452434355s) [noise=true , address=64.49.13.154:4928    , piece_id=SEVBZBMNGURP5TRUEBA4PHRSA6MNANVJUKINALJUWPQWBGKVYNTA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581457091 (590h53m11.452540126s) [noise=true , address=145.79.227.34:4909   , piece_id=3QSWTNR5LGUUAY3N5HJKSPL3TRQ6WO5F5OD4VTXKWHWUXUF7PVVQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581863144 (590h53m11.452946179s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.584010443 (590h53m11.455093478s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.585122791 (590h53m11.456205826s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:12.983305402 (590h53m12.854388447s) [upload=517998]: Next returned nil segment
Dec 30 06:22:12.983321313 (590h53m12.854404348s) [upload=517998]: Waiting for error group managing segments...
Dec 30 06:22:13.379703053 (590h53m13.250786088s) [noise=true , address=64.49.13.27:4965     , piece_id=CO4O5F2IBZAAKBZBV3HWNNOXZOGLNNDPALWMQZ3DEM3MREASVFEA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.418055622 (590h53m13.289138657s) [noise=true , address=145.79.227.3:4175    , piece_id=UCV5WQNVWEAMEDBWDNXEVSQEGXPJE7KD6YSWC5A4WXYUKUCK4NLA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.509034160 (590h53m13.380117205s) [noise=true , address=64.49.13.154:4928    , piece_id=SEVBZBMNGURP5TRUEBA4PHRSA6MNANVJUKINALJUWPQWBGKVYNTA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.642886154 (590h53m13.513969199s) [noise=true , address=77.90.31.14:4671     , piece_id=263TRISJ5ADFTX43ULSSGBAF2KMOXAPISJ56LLE53D74XOEMQ5EA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.788145520 (590h53m13.659228555s) [noise=true , address=77.90.31.12:4603     , piece_id=2I4L7F2WEGK5OSLODJSJ4672URBA7DUGXWZKTYB6ZNA2TQIGVXWA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.858878757 (590h53m13.729961792s) [noise=true , address=145.79.227.49:4369   , piece_id=XUEXGNJJIJ4DUBDNUV7CKF6J5JYHSLZAEPVGEDGBUBY42BIP4XEQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.879550569 (590h53m13.750633614s) [noise=true , address=145.79.227.34:4909   , piece_id=3QSWTNR5LGUUAY3N5HJKSPL3TRQ6WO5F5OD4VTXKWHWUXUF7PVVQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.940897723 (590h53m13.811980769s) [noise=true , address=77.90.31.19:4860     , piece_id=U2MNFOAD7FHCDBE4FUYOROIP3P33ROJ7K75SF5Z747EFKFTF7RGA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.989791936 (590h53m13.860874981s) [noise=true , address=45.91.116.11:4150    , piece_id=E66IDHTJDLYLYJIOWMOIKOOWLXCUNCMBIQ7SQBAD3VTJF6VX5JLQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.289516718 (590h53m14.160599753s) [noise=true , address=145.79.227.44:4203   , piece_id=WHCKQ2FRLYAZE7Q6HYZNTS4EISVHZNAPDDKH34WN33ALK4MVK2EA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.338651537 (590h53m14.209734582s) [noise=true , address=77.90.31.15:4729     , piece_id=NVMXFEILHGT622IIPYYT4FFHC2WZLHMCZM4VT5WUPHRAPH3DX6TA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.344145168 (590h53m14.215228213s) [noise=true , address=145.79.227.30:4772   , piece_id=PVMD5DWRRPVARTSZ6O7HN6MUVTZUYWLYSNQR5GDMNKUJZGXMYPFQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.667232847 (590h53m14.538315892s) [noise=true , address=193.149.164.143:4704 , piece_id=4T2IJIA6WHI5LMIUP5BLJLCD3GRY3A6PXR6G5OWJWUSYZT5ELGHQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.671388990 (590h53m14.542472025s) [noise=true , address=145.79.227.29:4945   , piece_id=SHL73IDEI54GRCWYNWHRUSJZZ4UUXREAX54DFJLTG5QPZCF5QKIQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.671415190 (590h53m14.542498226s) [seg_pos={0 0}, upload=517998]: Segment reached optimal threshold of 14 pieces.
Dec 30 06:22:14.671803600 (590h53m14.542886655s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hU1LwL2gX7rVnrNgzaBCYB37ziqf7s7aUgtF2Uc3antReQ6me): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.671814470 (590h53m14.542897525s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672014932 (590h53m14.543097977s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bhN3cR22QuAYihnnB3x3R97UZRWJ8sFPP8fjQcXZ7qhNZphZG): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672022637 (590h53m14.543105672s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672088933 (590h53m14.543171988s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672127677 (590h53m14.543210742s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672312739 (590h53m14.543395774s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSXWFiq27Dd2vBDD9vVnhDHVG59UmDKn3hVAhf3oyo5goVNaE): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672319953 (590h53m14.543402988s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672337847 (590h53m14.543420882s) [seg_pos={0 0}, upload=517998]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 30 06:22:14.672452947 (590h53m14.543535982s) [upload=517998]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:22:14.672458507 (590h53m14.543541542s) [upload=517998]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:22:14.981437069 (590h53m14.852520114s) [upload=517998]: Done uploading segments...
Dec 30 06:22:14.981456546 (590h53m14.852539581s) [upload=517998]: Upload finished. err: <nil>
Duration: 40.321513255s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
15 out of 60 is failed (threshold=3) [.X..X..XX.......X..X......X....X...X..X.X.X.....X.......X.X.]
duration: 
6.961820107s
trace: 
https://jaeger.dev.storj.io/trace/883b4f2341882c2
FAIL (2025-12-30 06:35:37 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, Piece ID: WQVIB3ZIRZRQRJLCQL7JEL57ZFL47TA6VVK2W7S4MK46JXXNWIVQ) context deadline exceeded; piecestore: (Node ID: 1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, Piece ID: OMXR3BZFHSIYM6W4ZXMDZI3TYYMI7RTA22DTCBJ5QGUAT3K44IBA) context deadline exceeded; piecestore: (Node ID: 12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, Piece ID: QE5WGSHM4NIFVPUC4WKM7NJFF42UJN7NLLE64SR4PLO3FM2L2P6Q) context deadline exceeded
======LOGS======
starting upload
Dec 30 06:35:00.700709664 (591h6m0.571792699s) [upload=518200]: Uploading segments...
Dec 30 06:35:00.700855001 (591h6m0.571938046s) [upload=518200]: Got next segment. Inline: false
Dec 30 06:35:00.700902551 (591h6m0.571985596s) [upload=518200]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 30 06:35:00.700907551 (591h6m0.571990586s) [upload=518200]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 30 06:35:00.945523006 (591h6m0.816606071s) [seg_pos={0 0}, upload=518200]: Begin upload segment...
Dec 30 06:35:00.945576387 (591h6m0.816659422s) [seg_pos={0 0}, upload=518200]: Done begin upload segment.
Dec 30 06:35:00.945623758 (591h6m0.816706803s) [noise=true , address=45.91.116.6:4973     , piece_id=TDJRK4WOVALL2ZRJ2MN3PSLLFDSUNIM65QZJKOKHHD4J7NUXHANA, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.945672631 (591h6m0.816755666s) [noise=true , address=145.79.227.45:4230   , piece_id=R4DIRT4O52SPMXRZJWDJX5I3N4RUAYUDPEJ2JKWFRTMVX4DT2GSQ, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.946423301 (591h6m0.817506346s) [noise=true , address=145.79.227.13:4804   , piece_id=YSM2HXZW6UUOW7QEOVEADHUUDJUZEDYTDHQAMFLBIW4SQUXDE5DQ, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.946941848 (591h6m0.818024893s) [noise=true , address=77.90.31.18:4808     , piece_id=AOFA43TQ4XIOZGUBLM5S4MCMWDLY3EDMA7TADNTMP3XYLZTFGCWA, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.947322032 (591h6m0.818405097s) [noise=true , address=145.79.227.34:4907   , piece_id=IFCQP7SQ3R3QWNBHNQIFNXVQZHDI6HWCRYOKJ6SLB2M64W2SZ46A, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.947811344 (591h6m0.818894389s) [noise=true , address=77.90.31.21:4877     , piece_id=PWB3DUUKENER2JLQ2THQB3SEU6IMLVAK2NFZMWLYBQJM2F65V72A, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.948024500 (591h6m0.819107535s) [noise=true , address=45.91.116.11:4117    , piece_id=WQVIB3ZIRZRQRJLCQL7JEL57ZFL47TA6VVK2W7S4MK46JXXNWIVQ, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.948488453 (591h6m0.819571498s) [noise=true , address=77.90.31.12:4590     , piece_id=OMXR3BZFHSIYM6W4ZXMDZI3TYYMI7RTA22DTCBJ5QGUAT3K44IBA, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.948539040 (591h6m0.819622085s) [noise=true , address=145.79.227.15:4875   , piece_id=LM7OQEBQZB352WGKRHJLDIJXYCGL5Q2LHQYETJFCVV4YRLJRGQAQ, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.948975420 (591h6m0.820058455s) [noise=true , address=77.90.31.10:4519     , piece_id=QE5WGSHM4NIFVPUC4WKM7NJFF42UJN7NLLE64SR4PLO3FM2L2P6Q, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.949027039 (591h6m0.820110084s) [noise=true , address=145.79.227.16:4909   , piece_id=QII6PXHXIVCKG473VVHSZC7BFAIERMARS2XE7BMPZVTD75CBN52A, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.949523544 (591h6m0.820606589s) [noise=true , address=45.91.116.9:4261     , piece_id=5CRNUHVNHHIPZ3R2WIINLHXCJLVPZB6XSYDVY4FURUB5JHJ5A3EQ, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.949539183 (591h6m0.820622218s) [noise=true , address=145.79.227.47:4267   , piece_id=OANW6JUI52D2R6PY6LJ474EREQFX66KB2I6Z75AHRQVJKVOSUDXQ, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.950071608 (591h6m0.821154653s) [noise=true , address=145.79.227.49:4339   , piece_id=ELCOJSDBE2KQ7ZG4STQT26CXHYQJECVOLJVVF63CJ6INZPFNXTFQ, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.950097677 (591h6m0.821180712s) [noise=true , address=145.79.227.46:4601   , piece_id=YRDRSSYAZGII36AL4LALOG73YTWAXPXVH4C2T4YGUIA6CMPVQTVQ, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.950788372 (591h6m0.821871417s) [noise=true , address=45.91.116.12:4227    , piece_id=3ZNXGVH5KZ5YHILFICJPB75GUEVUQG2GCSET5SGGEOBRB6TVNDPA, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:02.579512986 (591h6m2.450596031s) [upload=518200]: Next returned nil segment
Dec 30 06:35:02.579528937 (591h6m2.450611982s) [upload=518200]: Waiting for error group managing segments...
Dec 30 06:35:02.981880046 (591h6m2.852963091s) [noise=true , address=145.79.227.45:4230   , piece_id=R4DIRT4O52SPMXRZJWDJX5I3N4RUAYUDPEJ2JKWFRTMVX4DT2GSQ, seg_pos={0 0}, upload=518200]: Done uploading piece. err: <nil>
Dec 30 06:35:02.992028110 (591h6m2.863111165s) [noise=true , address=145.79.227.15:4875   , piece_id=LM7OQEBQZB352WGKRHJLDIJXYCGL5Q2LHQYETJFCVV4YRLJRGQAQ, seg_pos={0 0}, upload=518200]: Done uploading piece. err: <nil>
Dec 30 06:35:02.992318953 (591h6m2.863402018s) [noise=true , address=145.79.227.46:4601   , piece_id=YRDRSSYAZGII36AL4LALOG73YTWAXPXVH4C2T4YGUIA6CMPVQTVQ, seg_pos={0 0}, upload=518200]: Done uploading piece. err: <nil>
Dec 30 06:35:02.995375083 (591h6m2.866458128s) [noise=true , address=145.79.227.49:4339   , piece_id=ELCOJSDBE2KQ7ZG4STQT26CXHYQJECVOLJVVF63CJ6INZPFNXTFQ, seg_pos={0 0}, upload=518200]: Done uploading piece. err: <nil>
Dec 30 06:35:03.005058321 (591h6m2.876141366s) [noise=true , address=145.79.227.13:4804   , piece_id=YSM2HXZW6UUOW7QEOVEADHUUDJUZEDYTDHQAMFLBIW4SQUXDE5DQ, seg_pos={0 0}, upload=518200]: Done uploading piece. err: <nil>
Dec 30 06:35:03.060242390 (591h6m2.931325435s) [noise=true , address=145.79.227.16:4909   , piece_id=QII6PXHXIVCKG473VVHSZC7BFAIERMARS2XE7BMPZVTD75CBN52A, seg_pos={0 0}, upload=518200]: Done uploading piece. err: <nil>
Dec 30 06:35:03.064706310 (591h6m2.935789355s) [noise=true , address=145.79.227.47:4267   , piece_id=OANW6JUI52D2R6PY6LJ474EREQFX66KB2I6Z75AHRQVJKVOSUDXQ, seg_pos={0 0}, upload=518200]: Done uploading piece. err: <nil>
Dec 30 06:35:03.265292297 (591h6m3.136375342s) [noise=true , address=77.90.31.18:4808     , piece_id=AOFA43TQ4XIOZGUBLM5S4MCMWDLY3EDMA7TADNTMP3XYLZTFGCWA, seg_pos={0 0}, upload=518200]: Done uploading piece. err: <nil>
Dec 30 06:35:03.290314984 (591h6m3.161398059s) [noise=true , address=77.90.31.21:4877     , piece_id=PWB3DUUKENER2JLQ2THQB3SEU6IMLVAK2NFZMWLYBQJM2F65V72A, seg_pos={0 0}, upload=518200]: Done uploading piece. err: <nil>
Dec 30 06:35:03.479217344 (591h6m3.350300389s) [noise=true , address=45.91.116.11:4117    , piece_id=WQVIB3ZIRZRQRJLCQL7JEL57ZFL47TA6VVK2W7S4MK46JXXNWIVQ, seg_pos={0 0}, upload=518200]: Done uploading piece. err: <nil>
Dec 30 06:35:03.496983904 (591h6m3.368066949s) [noise=true , address=77.90.31.10:4519     , piece_id=QE5WGSHM4NIFVPUC4WKM7NJFF42UJN7NLLE64SR4PLO3FM2L2P6Q, seg_pos={0 0}, upload=518200]: Done uploading piece. err: <nil>
Dec 30 06:35:03.645769244 (591h6m3.516852299s) [noise=true , address=77.90.31.12:4590     , piece_id=OMXR3BZFHSIYM6W4ZXMDZI3TYYMI7RTA22DTCBJ5QGUAT3K44IBA, seg_pos={0 0}, upload=518200]: Done uploading piece. err: <nil>
Dec 30 06:35:03.686416803 (591h6m3.557499848s) [noise=true , address=45.91.116.6:4973     , piece_id=TDJRK4WOVALL2ZRJ2MN3PSLLFDSUNIM65QZJKOKHHD4J7NUXHANA, seg_pos={0 0}, upload=518200]: Done uploading piece. err: <nil>
Dec 30 06:35:03.686440759 (591h6m3.557523804s) [seg_pos={0 0}, upload=518200]: Segment reached optimal threshold of 13 pieces.
Dec 30 06:35:03.686716374 (591h6m3.557799419s) [noise=true , address=145.79.227.34:4907   , piece_id=IFCQP7SQ3R3QWNBHNQIFNXVQZHDI6HWCRYOKJ6SLB2M64W2SZ46A, seg_pos={0 0}, upload=518200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF
Dec 30 06:35:03.686725201 (591h6m3.557808246s) [noise=true , address=145.79.227.34:4907   , piece_id=IFCQP7SQ3R3QWNBHNQIFNXVQZHDI6HWCRYOKJ6SLB2M64W2SZ46A, seg_pos={0 0}, upload=518200]: Long tail cancellation due to optimal threshold
Dec 30 06:35:03.687389175 (591h6m3.55847222s) [noise=true , address=45.91.116.9:4261     , piece_id=5CRNUHVNHHIPZ3R2WIINLHXCJLVPZB6XSYDVY4FURUB5JHJ5A3EQ, seg_pos={0 0}, upload=518200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: write tcp 188.166.225.170:34180->45.91.116.9:4261: use of closed network connection; write tcp 188.166.225.170:34180->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34180->45.91.116.9:4261: use of closed network connection
Dec 30 06:35:03.687400767 (591h6m3.558483812s) [noise=true , address=45.91.116.9:4261     , piece_id=5CRNUHVNHHIPZ3R2WIINLHXCJLVPZB6XSYDVY4FURUB5JHJ5A3EQ, seg_pos={0 0}, upload=518200]: Long tail cancellation due to optimal threshold
Dec 30 06:35:03.687543790 (591h6m3.558626835s) [noise=true , address=45.91.116.12:4227    , piece_id=3ZNXGVH5KZ5YHILFICJPB75GUEVUQG2GCSET5SGGEOBRB6TVNDPA, seg_pos={0 0}, upload=518200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH): protocol: write tcp 188.166.225.170:42160->45.91.116.12:4227: use of closed network connection; write tcp 188.166.225.170:42160->45.91.116.12:4227: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42160->45.91.116.12:4227: use of closed network connection
Dec 30 06:35:03.687554680 (591h6m3.558637725s) [noise=true , address=45.91.116.12:4227    , piece_id=3ZNXGVH5KZ5YHILFICJPB75GUEVUQG2GCSET5SGGEOBRB6TVNDPA, seg_pos={0 0}, upload=518200]: Long tail cancellation due to optimal threshold
Dec 30 06:35:03.687579117 (591h6m3.558662162s) [seg_pos={0 0}, upload=518200]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 30 06:35:03.687670551 (591h6m3.558753596s) [upload=518200]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:35:03.687676532 (591h6m3.558759577s) [upload=518200]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:35:03.973108018 (591h6m3.844191063s) [upload=518200]: Done uploading segments...
Dec 30 06:35:03.973143596 (591h6m3.844226641s) [upload=518200]: Upload finished. err: <nil>
Duration: 6.96183686s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
7 out of 60 is failed (threshold=6) [.................X...........X..............XX...X......X..X]
duration: 
5.001030802s
trace: 
https://jaeger.dev.storj.io/trace/30c47f8e5a5f412a
FAIL (2025-12-30 06:35:34 UTC) 
orbiter warning: operation error S3: DeleteObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.001053794s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
15 out of 60 is failed (threshold=3) [..X..X..XX.......X..X......X....X...X..X.X.X.....X.......X.X]
duration: 
30.002940017s
trace: 
https://jaeger.dev.storj.io/trace/883b4f2341882c2
FAIL (2025-12-30 06:35:30 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 167JkPLSCrURmtr6PmVHr4i6huBvTzVXXxhLjkB1RkfC6aqox6, Piece ID: WQVIB3ZIRZRQRJLCQL7JEL57ZFL47TA6VVK2W7S4MK46JXXNWIVQ) context deadline exceeded; piecestore: (Node ID: 1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, Piece ID: OMXR3BZFHSIYM6W4ZXMDZI3TYYMI7RTA22DTCBJ5QGUAT3K44IBA) context deadline exceeded; piecestore: (Node ID: 12rwZa7GFRR5bJTazST3crJMAuEVFwmVNLm2SnrcoZtYiHsW3FX, Piece ID: QE5WGSHM4NIFVPUC4WKM7NJFF42UJN7NLLE64SR4PLO3FM2L2P6Q) context deadline exceeded
======LOGS======
starting upload
Dec 30 06:35:00.700709664 (591h6m0.571792699s) [upload=518200]: Uploading segments...
Dec 30 06:35:00.700855001 (591h6m0.571938046s) [upload=518200]: Got next segment. Inline: false
Dec 30 06:35:00.700902551 (591h6m0.571985596s) [upload=518200]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 30 06:35:00.700907551 (591h6m0.571990586s) [upload=518200]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 30 06:35:00.945523006 (591h6m0.816606071s) [seg_pos={0 0}, upload=518200]: Begin upload segment...
Dec 30 06:35:00.945576387 (591h6m0.816659422s) [seg_pos={0 0}, upload=518200]: Done begin upload segment.
Dec 30 06:35:00.945623758 (591h6m0.816706803s) [noise=true , address=45.91.116.6:4973     , piece_id=TDJRK4WOVALL2ZRJ2MN3PSLLFDSUNIM65QZJKOKHHD4J7NUXHANA, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.945672631 (591h6m0.816755666s) [noise=true , address=145.79.227.45:4230   , piece_id=R4DIRT4O52SPMXRZJWDJX5I3N4RUAYUDPEJ2JKWFRTMVX4DT2GSQ, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.946423301 (591h6m0.817506346s) [noise=true , address=145.79.227.13:4804   , piece_id=YSM2HXZW6UUOW7QEOVEADHUUDJUZEDYTDHQAMFLBIW4SQUXDE5DQ, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.946941848 (591h6m0.818024893s) [noise=true , address=77.90.31.18:4808     , piece_id=AOFA43TQ4XIOZGUBLM5S4MCMWDLY3EDMA7TADNTMP3XYLZTFGCWA, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.947322032 (591h6m0.818405097s) [noise=true , address=145.79.227.34:4907   , piece_id=IFCQP7SQ3R3QWNBHNQIFNXVQZHDI6HWCRYOKJ6SLB2M64W2SZ46A, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.947811344 (591h6m0.818894389s) [noise=true , address=77.90.31.21:4877     , piece_id=PWB3DUUKENER2JLQ2THQB3SEU6IMLVAK2NFZMWLYBQJM2F65V72A, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.948024500 (591h6m0.819107535s) [noise=true , address=45.91.116.11:4117    , piece_id=WQVIB3ZIRZRQRJLCQL7JEL57ZFL47TA6VVK2W7S4MK46JXXNWIVQ, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.948488453 (591h6m0.819571498s) [noise=true , address=77.90.31.12:4590     , piece_id=OMXR3BZFHSIYM6W4ZXMDZI3TYYMI7RTA22DTCBJ5QGUAT3K44IBA, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.948539040 (591h6m0.819622085s) [noise=true , address=145.79.227.15:4875   , piece_id=LM7OQEBQZB352WGKRHJLDIJXYCGL5Q2LHQYETJFCVV4YRLJRGQAQ, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.948975420 (591h6m0.820058455s) [noise=true , address=77.90.31.10:4519     , piece_id=QE5WGSHM4NIFVPUC4WKM7NJFF42UJN7NLLE64SR4PLO3FM2L2P6Q, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.949027039 (591h6m0.820110084s) [noise=true , address=145.79.227.16:4909   , piece_id=QII6PXHXIVCKG473VVHSZC7BFAIERMARS2XE7BMPZVTD75CBN52A, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.949523544 (591h6m0.820606589s) [noise=true , address=45.91.116.9:4261     , piece_id=5CRNUHVNHHIPZ3R2WIINLHXCJLVPZB6XSYDVY4FURUB5JHJ5A3EQ, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.949539183 (591h6m0.820622218s) [noise=true , address=145.79.227.47:4267   , piece_id=OANW6JUI52D2R6PY6LJ474EREQFX66KB2I6Z75AHRQVJKVOSUDXQ, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.950071608 (591h6m0.821154653s) [noise=true , address=145.79.227.49:4339   , piece_id=ELCOJSDBE2KQ7ZG4STQT26CXHYQJECVOLJVVF63CJ6INZPFNXTFQ, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.950097677 (591h6m0.821180712s) [noise=true , address=145.79.227.46:4601   , piece_id=YRDRSSYAZGII36AL4LALOG73YTWAXPXVH4C2T4YGUIA6CMPVQTVQ, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:00.950788372 (591h6m0.821871417s) [noise=true , address=45.91.116.12:4227    , piece_id=3ZNXGVH5KZ5YHILFICJPB75GUEVUQG2GCSET5SGGEOBRB6TVNDPA, seg_pos={0 0}, upload=518200]: Uploading piece...
Dec 30 06:35:02.579512986 (591h6m2.450596031s) [upload=518200]: Next returned nil segment
Dec 30 06:35:02.579528937 (591h6m2.450611982s) [upload=518200]: Waiting for error group managing segments...
Dec 30 06:35:02.981880046 (591h6m2.852963091s) [noise=true , address=145.79.227.45:4230   , piece_id=R4DIRT4O52SPMXRZJWDJX5I3N4RUAYUDPEJ2JKWFRTMVX4DT2GSQ, seg_pos={0 0}, upload=518200]: Done uploading piece. err: <nil>
Dec 30 06:35:02.992028110 (591h6m2.863111165s) [noise=true , address=145.79.227.15:4875   , piece_id=LM7OQEBQZB352WGKRHJLDIJXYCGL5Q2LHQYETJFCVV4YRLJRGQAQ, seg_pos={0 0}, upload=518200]: Done uploading piece. err: <nil>
Dec 30 06:35:02.992318953 (591h6m2.863402018s) [noise=true , address=145.79.227.46:4601   , piece_id=YRDRSSYAZGII36AL4LALOG73YTWAXPXVH4C2T4YGUIA6CMPVQTVQ, seg_pos={0 0}, upload=518200]: Done uploading piece. err: <nil>
Dec 30 06:35:02.995375083 (591h6m2.866458128s) [noise=true , address=145.79.227.49:4339   , piece_id=ELCOJSDBE2KQ7ZG4STQT26CXHYQJECVOLJVVF63CJ6INZPFNXTFQ, seg_pos={0 0}, upload=518200]: Done uploading piece. err: <nil>
Dec 30 06:35:03.005058321 (591h6m2.876141366s) [noise=true , address=145.79.227.13:4804   , piece_id=YSM2HXZW6UUOW7QEOVEADHUUDJUZEDYTDHQAMFLBIW4SQUXDE5DQ, seg_pos={0 0}, upload=518200]: Done uploading piece. err: <nil>
Dec 30 06:35:03.060242390 (591h6m2.931325435s) [noise=true , address=145.79.227.16:4909   , piece_id=QII6PXHXIVCKG473VVHSZC7BFAIERMARS2XE7BMPZVTD75CBN52A, seg_pos={0 0}, upload=518200]: Done uploading piece. err: <nil>
Dec 30 06:35:03.064706310 (591h6m2.935789355s) [noise=true , address=145.79.227.47:4267   , piece_id=OANW6JUI52D2R6PY6LJ474EREQFX66KB2I6Z75AHRQVJKVOSUDXQ, seg_pos={0 0}, upload=518200]: Done uploading piece. err: <nil>
Dec 30 06:35:03.265292297 (591h6m3.136375342s) [noise=true , address=77.90.31.18:4808     , piece_id=AOFA43TQ4XIOZGUBLM5S4MCMWDLY3EDMA7TADNTMP3XYLZTFGCWA, seg_pos={0 0}, upload=518200]: Done uploading piece. err: <nil>
Dec 30 06:35:03.290314984 (591h6m3.161398059s) [noise=true , address=77.90.31.21:4877     , piece_id=PWB3DUUKENER2JLQ2THQB3SEU6IMLVAK2NFZMWLYBQJM2F65V72A, seg_pos={0 0}, upload=518200]: Done uploading piece. err: <nil>
Dec 30 06:35:03.479217344 (591h6m3.350300389s) [noise=true , address=45.91.116.11:4117    , piece_id=WQVIB3ZIRZRQRJLCQL7JEL57ZFL47TA6VVK2W7S4MK46JXXNWIVQ, seg_pos={0 0}, upload=518200]: Done uploading piece. err: <nil>
Dec 30 06:35:03.496983904 (591h6m3.368066949s) [noise=true , address=77.90.31.10:4519     , piece_id=QE5WGSHM4NIFVPUC4WKM7NJFF42UJN7NLLE64SR4PLO3FM2L2P6Q, seg_pos={0 0}, upload=518200]: Done uploading piece. err: <nil>
Dec 30 06:35:03.645769244 (591h6m3.516852299s) [noise=true , address=77.90.31.12:4590     , piece_id=OMXR3BZFHSIYM6W4ZXMDZI3TYYMI7RTA22DTCBJ5QGUAT3K44IBA, seg_pos={0 0}, upload=518200]: Done uploading piece. err: <nil>
Dec 30 06:35:03.686416803 (591h6m3.557499848s) [noise=true , address=45.91.116.6:4973     , piece_id=TDJRK4WOVALL2ZRJ2MN3PSLLFDSUNIM65QZJKOKHHD4J7NUXHANA, seg_pos={0 0}, upload=518200]: Done uploading piece. err: <nil>
Dec 30 06:35:03.686440759 (591h6m3.557523804s) [seg_pos={0 0}, upload=518200]: Segment reached optimal threshold of 13 pieces.
Dec 30 06:35:03.686716374 (591h6m3.557799419s) [noise=true , address=145.79.227.34:4907   , piece_id=IFCQP7SQ3R3QWNBHNQIFNXVQZHDI6HWCRYOKJ6SLB2M64W2SZ46A, seg_pos={0 0}, upload=518200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12URx18Ckh7VaAKJ1hdQQucMRu5qiDrAraqaycjYqxETgwZ4uWS): protocol: expected piece hash; context canceled; EOF
Dec 30 06:35:03.686725201 (591h6m3.557808246s) [noise=true , address=145.79.227.34:4907   , piece_id=IFCQP7SQ3R3QWNBHNQIFNXVQZHDI6HWCRYOKJ6SLB2M64W2SZ46A, seg_pos={0 0}, upload=518200]: Long tail cancellation due to optimal threshold
Dec 30 06:35:03.687389175 (591h6m3.55847222s) [noise=true , address=45.91.116.9:4261     , piece_id=5CRNUHVNHHIPZ3R2WIINLHXCJLVPZB6XSYDVY4FURUB5JHJ5A3EQ, seg_pos={0 0}, upload=518200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eg62VsecY4ALCTk2z2TrpPFMVnfNLhNkGyUJfBfPzQrq4X8mi): protocol: write tcp 188.166.225.170:34180->45.91.116.9:4261: use of closed network connection; write tcp 188.166.225.170:34180->45.91.116.9:4261: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34180->45.91.116.9:4261: use of closed network connection
Dec 30 06:35:03.687400767 (591h6m3.558483812s) [noise=true , address=45.91.116.9:4261     , piece_id=5CRNUHVNHHIPZ3R2WIINLHXCJLVPZB6XSYDVY4FURUB5JHJ5A3EQ, seg_pos={0 0}, upload=518200]: Long tail cancellation due to optimal threshold
Dec 30 06:35:03.687543790 (591h6m3.558626835s) [noise=true , address=45.91.116.12:4227    , piece_id=3ZNXGVH5KZ5YHILFICJPB75GUEVUQG2GCSET5SGGEOBRB6TVNDPA, seg_pos={0 0}, upload=518200]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ETZh5HbRYk386nSYJSd4DvQ2XbMw5XBnyyPMfsxwHJaSHaQEH): protocol: write tcp 188.166.225.170:42160->45.91.116.12:4227: use of closed network connection; write tcp 188.166.225.170:42160->45.91.116.12:4227: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42160->45.91.116.12:4227: use of closed network connection
Dec 30 06:35:03.687554680 (591h6m3.558637725s) [noise=true , address=45.91.116.12:4227    , piece_id=3ZNXGVH5KZ5YHILFICJPB75GUEVUQG2GCSET5SGGEOBRB6TVNDPA, seg_pos={0 0}, upload=518200]: Long tail cancellation due to optimal threshold
Dec 30 06:35:03.687579117 (591h6m3.558662162s) [seg_pos={0 0}, upload=518200]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 30 06:35:03.687670551 (591h6m3.558753596s) [upload=518200]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:35:03.687676532 (591h6m3.558759577s) [upload=518200]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:35:03.973108018 (591h6m3.844191063s) [upload=518200]: Done uploading segments...
Dec 30 06:35:03.973143596 (591h6m3.844226641s) [upload=518200]: Upload finished. err: <nil>
Duration: 30.002965336s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [..................................X.........................]
duration: 
9.875784158s
trace: 
https://jaeger.dev.storj.io/trace/deb96436003dee
FAIL (2025-12-30 06:35:19 UTC) 
orbiter warning: read tcp 188.166.225.170:52458->45.38.24.2:443: read: connection reset by peer
Duration: 9.875807473s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [...................X...X......X............X................]
duration: 
42.056354399s
trace: 
https://jaeger.dev.storj.io/trace/45b769fc71e13448
FAIL (2025-12-30 06:34:58 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
.577697683 (590h53m11.448780728s) [noise=true , address=193.149.164.143:4704 , piece_id=4T2IJIA6WHI5LMIUP5BLJLCD3GRY3A6PXR6G5OWJWUSYZT5ELGHQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578173528 (590h53m11.449256573s) [noise=true , address=64.49.13.27:4965     , piece_id=CO4O5F2IBZAAKBZBV3HWNNOXZOGLNNDPALWMQZ3DEM3MREASVFEA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578542992 (590h53m11.449626027s) [noise=true , address=77.90.31.15:4729     , piece_id=NVMXFEILHGT622IIPYYT4FFHC2WZLHMCZM4VT5WUPHRAPH3DX6TA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578846911 (590h53m11.449929946s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579458044 (590h53m11.450541089s) [noise=true , address=45.91.116.11:4150    , piece_id=E66IDHTJDLYLYJIOWMOIKOOWLXCUNCMBIQ7SQBAD3VTJF6VX5JLQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579891209 (590h53m11.450974245s) [noise=true , address=145.79.227.29:4945   , piece_id=SHL73IDEI54GRCWYNWHRUSJZZ4UUXREAX54DFJLTG5QPZCF5QKIQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579915535 (590h53m11.45099858s) [noise=true , address=145.79.227.30:4772   , piece_id=PVMD5DWRRPVARTSZ6O7HN6MUVTZUYWLYSNQR5GDMNKUJZGXMYPFQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580325466 (590h53m11.451408511s) [noise=true , address=77.90.31.12:4603     , piece_id=2I4L7F2WEGK5OSLODJSJ4672URBA7DUGXWZKTYB6ZNA2TQIGVXWA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580379599 (590h53m11.451462644s) [noise=true , address=77.90.31.14:4671     , piece_id=263TRISJ5ADFTX43ULSSGBAF2KMOXAPISJ56LLE53D74XOEMQ5EA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580692044 (590h53m11.451775089s) [noise=true , address=145.79.227.3:4175    , piece_id=UCV5WQNVWEAMEDBWDNXEVSQEGXPJE7KD6YSWC5A4WXYUKUCK4NLA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580857859 (590h53m11.451940894s) [noise=true , address=77.90.31.19:4860     , piece_id=U2MNFOAD7FHCDBE4FUYOROIP3P33ROJ7K75SF5Z747EFKFTF7RGA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581089210 (590h53m11.452172255s) [noise=true , address=145.79.227.44:4203   , piece_id=WHCKQ2FRLYAZE7Q6HYZNTS4EISVHZNAPDDKH34WN33ALK4MVK2EA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581351320 (590h53m11.452434355s) [noise=true , address=64.49.13.154:4928    , piece_id=SEVBZBMNGURP5TRUEBA4PHRSA6MNANVJUKINALJUWPQWBGKVYNTA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581457091 (590h53m11.452540126s) [noise=true , address=145.79.227.34:4909   , piece_id=3QSWTNR5LGUUAY3N5HJKSPL3TRQ6WO5F5OD4VTXKWHWUXUF7PVVQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581863144 (590h53m11.452946179s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.584010443 (590h53m11.455093478s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.585122791 (590h53m11.456205826s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:12.983305402 (590h53m12.854388447s) [upload=517998]: Next returned nil segment
Dec 30 06:22:12.983321313 (590h53m12.854404348s) [upload=517998]: Waiting for error group managing segments...
Dec 30 06:22:13.379703053 (590h53m13.250786088s) [noise=true , address=64.49.13.27:4965     , piece_id=CO4O5F2IBZAAKBZBV3HWNNOXZOGLNNDPALWMQZ3DEM3MREASVFEA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.418055622 (590h53m13.289138657s) [noise=true , address=145.79.227.3:4175    , piece_id=UCV5WQNVWEAMEDBWDNXEVSQEGXPJE7KD6YSWC5A4WXYUKUCK4NLA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.509034160 (590h53m13.380117205s) [noise=true , address=64.49.13.154:4928    , piece_id=SEVBZBMNGURP5TRUEBA4PHRSA6MNANVJUKINALJUWPQWBGKVYNTA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.642886154 (590h53m13.513969199s) [noise=true , address=77.90.31.14:4671     , piece_id=263TRISJ5ADFTX43ULSSGBAF2KMOXAPISJ56LLE53D74XOEMQ5EA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.788145520 (590h53m13.659228555s) [noise=true , address=77.90.31.12:4603     , piece_id=2I4L7F2WEGK5OSLODJSJ4672URBA7DUGXWZKTYB6ZNA2TQIGVXWA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.858878757 (590h53m13.729961792s) [noise=true , address=145.79.227.49:4369   , piece_id=XUEXGNJJIJ4DUBDNUV7CKF6J5JYHSLZAEPVGEDGBUBY42BIP4XEQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.879550569 (590h53m13.750633614s) [noise=true , address=145.79.227.34:4909   , piece_id=3QSWTNR5LGUUAY3N5HJKSPL3TRQ6WO5F5OD4VTXKWHWUXUF7PVVQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.940897723 (590h53m13.811980769s) [noise=true , address=77.90.31.19:4860     , piece_id=U2MNFOAD7FHCDBE4FUYOROIP3P33ROJ7K75SF5Z747EFKFTF7RGA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.989791936 (590h53m13.860874981s) [noise=true , address=45.91.116.11:4150    , piece_id=E66IDHTJDLYLYJIOWMOIKOOWLXCUNCMBIQ7SQBAD3VTJF6VX5JLQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.289516718 (590h53m14.160599753s) [noise=true , address=145.79.227.44:4203   , piece_id=WHCKQ2FRLYAZE7Q6HYZNTS4EISVHZNAPDDKH34WN33ALK4MVK2EA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.338651537 (590h53m14.209734582s) [noise=true , address=77.90.31.15:4729     , piece_id=NVMXFEILHGT622IIPYYT4FFHC2WZLHMCZM4VT5WUPHRAPH3DX6TA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.344145168 (590h53m14.215228213s) [noise=true , address=145.79.227.30:4772   , piece_id=PVMD5DWRRPVARTSZ6O7HN6MUVTZUYWLYSNQR5GDMNKUJZGXMYPFQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.667232847 (590h53m14.538315892s) [noise=true , address=193.149.164.143:4704 , piece_id=4T2IJIA6WHI5LMIUP5BLJLCD3GRY3A6PXR6G5OWJWUSYZT5ELGHQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.671388990 (590h53m14.542472025s) [noise=true , address=145.79.227.29:4945   , piece_id=SHL73IDEI54GRCWYNWHRUSJZZ4UUXREAX54DFJLTG5QPZCF5QKIQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.671415190 (590h53m14.542498226s) [seg_pos={0 0}, upload=517998]: Segment reached optimal threshold of 14 pieces.
Dec 30 06:22:14.671803600 (590h53m14.542886655s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hU1LwL2gX7rVnrNgzaBCYB37ziqf7s7aUgtF2Uc3antReQ6me): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.671814470 (590h53m14.542897525s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672014932 (590h53m14.543097977s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bhN3cR22QuAYihnnB3x3R97UZRWJ8sFPP8fjQcXZ7qhNZphZG): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672022637 (590h53m14.543105672s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672088933 (590h53m14.543171988s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672127677 (590h53m14.543210742s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672312739 (590h53m14.543395774s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSXWFiq27Dd2vBDD9vVnhDHVG59UmDKn3hVAhf3oyo5goVNaE): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672319953 (590h53m14.543402988s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672337847 (590h53m14.543420882s) [seg_pos={0 0}, upload=517998]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 30 06:22:14.672452947 (590h53m14.543535982s) [upload=517998]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:22:14.672458507 (590h53m14.543541542s) [upload=517998]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:22:14.981437069 (590h53m14.852520114s) [upload=517998]: Done uploading segments...
Dec 30 06:22:14.981456546 (590h53m14.852539581s) [upload=517998]: Upload finished. err: <nil>
Duration: 42.056372153s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
15 out of 60 is failed (threshold=3) [X..X..X..XX.......X..X......X....X...X..X.X.X.....X.......X.]
duration: 
6.254490126s
trace: 
https://jaeger.dev.storj.io/trace/503c9a2d8002fe81
FAIL (2025-12-30 06:34:42 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
591h4m45.645724096s) [upload=518178]: Uploading segments...
Dec 30 06:33:45.774794463 (591h4m45.645877498s) [upload=518178]: Got next segment. Inline: false
Dec 30 06:33:45.774839228 (591h4m45.645922263s) [upload=518178]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 30 06:33:45.774843977 (591h4m45.645927013s) [upload=518178]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 30 06:33:46.018508112 (591h4m45.889591177s) [seg_pos={0 0}, upload=518178]: Begin upload segment...
Dec 30 06:33:46.018555122 (591h4m45.889638167s) [seg_pos={0 0}, upload=518178]: Done begin upload segment.
Dec 30 06:33:46.018585259 (591h4m45.889668304s) [noise=true , address=145.79.227.31:4798   , piece_id=PRWLUUKQOAXDKY6MZWWE4PUNRWZCZLKPSA6TTL5ANTZAU3T66YMQ, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.018600257 (591h4m45.889683292s) [noise=true , address=145.79.227.14:4837   , piece_id=AD4T3VJNIONSHGWRCEU4JHQDZ5S4WRO4X5DGH6Y6BRPMXPGP3XTA, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.018769209 (591h4m45.889852254s) [noise=true , address=145.79.227.11:4730   , piece_id=R2OZFIRJFTWVRKCMUEBLI3YMY2FJQQ5X76SGRWZBU7RVADROX55A, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.019113825 (591h4m45.89019686s) [noise=true , address=145.79.227.6:4259    , piece_id=Y4R7Y2JISFXLJLS4JSZ46DVBLNEZPPL3PUUSDUOIA5APPCJ5VHZA, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.019526612 (591h4m45.890609657s) [noise=true , address=77.90.31.16:4736     , piece_id=T2J2MXHJ2Q47MDTOR67LKVQMGYJMCJNJ5WOKDRAU63VQ3WWDJYGA, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.019940860 (591h4m45.891023895s) [noise=true , address=145.79.227.15:4873   , piece_id=4CQAUIEEJVRXRWR3NIAVOVQTLSBF6SXRU2SD4CRINYYESDCNA53Q, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.022137934 (591h4m45.893220979s) [noise=true , address=77.90.31.18:4805     , piece_id=HL6D5PCKCGBYDIZY37LLYYISPSGLSLVVBDPFQTYYIT6B7HYGKSLA, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.025109061 (591h4m45.896192106s) [noise=true , address=45.91.116.13:4154    , piece_id=74LMQG6AL7XKL55LOC6DNBU4NHMWFWEVDHM264XNRXVWILN27N4Q, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.026946580 (591h4m45.898029625s) [noise=true , address=145.79.227.9:4366    , piece_id=7HVXPRELB72NAIAMO7RZGEPE5TNXS2YU7TFGELEREHYUDAWGSI6A, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.027233997 (591h4m45.898317042s) [noise=true , address=77.90.31.15:4697     , piece_id=DF76BCMKRNDMVO44MBPXVTFQMTFVBC55TP5M7LZC7YM636CO5SYA, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.028554913 (591h4m45.899637948s) [noise=true , address=145.79.227.47:4266   , piece_id=45XGNTN5LJWAGG6NCTXO3Y5ZMG3X6FWWVYSLD2SWDRZPDRYYF4AQ, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.029466017 (591h4m45.900549052s) [noise=true , address=45.91.116.4:4937     , piece_id=AVRO6CMJVS4Q5YF6BJD4KVLK3AZNK7NWRFGCQNI5BK2JBNAN2HPA, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.029945951 (591h4m45.901028986s) [noise=true , address=145.79.227.51:4409   , piece_id=Y4REGGBEQ2PXDU6INBM5PI3KK6F7Z3Z4D5IY55YKADTDJCDE7AYQ, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.031216642 (591h4m45.902299687s) [noise=true , address=145.79.227.36:4519   , piece_id=3RF3RXFKXSHCXRVOYGRKPG6HATUIJOWPINMJ7CSOHX6LHC2SHBSA, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.031529728 (591h4m45.902612763s) [noise=true , address=45.91.116.5:4298     , piece_id=KNNJ6FSVFTDRA5AVQUWXTYBU2HPULCFIDDWE4S45S3CE4Y4YNNCA, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.031726732 (591h4m45.902809777s) [noise=true , address=145.79.227.21:4473   , piece_id=4T5A7ODCUWWZOGOAJ5DBT6YP5PGUMCYYKUR5773PPP5SEPJDAP5A, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:47.626922914 (591h4m47.498005949s) [upload=518178]: Next returned nil segment
Dec 30 06:33:47.626936740 (591h4m47.498019775s) [upload=518178]: Waiting for error group managing segments...
Dec 30 06:33:48.012796297 (591h4m47.883879342s) [noise=true , address=145.79.227.14:4837   , piece_id=AD4T3VJNIONSHGWRCEU4JHQDZ5S4WRO4X5DGH6Y6BRPMXPGP3XTA, seg_pos={0 0}, upload=518178]: Done uploading piece. err: <nil>
Dec 30 06:33:48.013252165 (591h4m47.88433521s) [noise=true , address=145.79.227.9:4366    , piece_id=7HVXPRELB72NAIAMO7RZGEPE5TNXS2YU7TFGELEREHYUDAWGSI6A, seg_pos={0 0}, upload=518178]: Done uploading piece. err: <nil>
Dec 30 06:33:48.016575023 (591h4m47.887658068s) [noise=true , address=145.79.227.21:4473   , piece_id=4T5A7ODCUWWZOGOAJ5DBT6YP5PGUMCYYKUR5773PPP5SEPJDAP5A, seg_pos={0 0}, upload=518178]: Done uploading piece. err: <nil>
Dec 30 06:33:48.027689947 (591h4m47.898772992s) [noise=true , address=145.79.227.6:4259    , piece_id=Y4R7Y2JISFXLJLS4JSZ46DVBLNEZPPL3PUUSDUOIA5APPCJ5VHZA, seg_pos={0 0}, upload=518178]: Done uploading piece. err: <nil>
Dec 30 06:33:48.028820149 (591h4m47.899903194s) [noise=true , address=145.79.227.31:4798   , piece_id=PRWLUUKQOAXDKY6MZWWE4PUNRWZCZLKPSA6TTL5ANTZAU3T66YMQ, seg_pos={0 0}, upload=518178]: Done uploading piece. err: <nil>
Dec 30 06:33:48.046543677 (591h4m47.917626722s) [noise=true , address=145.79.227.51:4409   , piece_id=Y4REGGBEQ2PXDU6INBM5PI3KK6F7Z3Z4D5IY55YKADTDJCDE7AYQ, seg_pos={0 0}, upload=518178]: Done uploading piece. err: <nil>
Dec 30 06:33:48.091123805 (591h4m47.96220685s) [noise=true , address=145.79.227.15:4873   , piece_id=4CQAUIEEJVRXRWR3NIAVOVQTLSBF6SXRU2SD4CRINYYESDCNA53Q, seg_pos={0 0}, upload=518178]: Done uploading piece. err: <nil>
Dec 30 06:33:48.097407389 (591h4m47.968490425s) [noise=true , address=145.79.227.11:4730   , piece_id=R2OZFIRJFTWVRKCMUEBLI3YMY2FJQQ5X76SGRWZBU7RVADROX55A, seg_pos={0 0}, upload=518178]: Done uploading piece. err: <nil>
Dec 30 06:33:48.100992456 (591h4m47.972075501s) [noise=true , address=145.79.227.36:4519   , piece_id=3RF3RXFKXSHCXRVOYGRKPG6HATUIJOWPINMJ7CSOHX6LHC2SHBSA, seg_pos={0 0}, upload=518178]: Done uploading piece. err: <nil>
Dec 30 06:33:48.110681677 (591h4m47.981764722s) [noise=true , address=145.79.227.47:4266   , piece_id=45XGNTN5LJWAGG6NCTXO3Y5ZMG3X6FWWVYSLD2SWDRZPDRYYF4AQ, seg_pos={0 0}, upload=518178]: Done uploading piece. err: <nil>
Dec 30 06:33:48.184503174 (591h4m48.055586209s) [noise=true , address=77.90.31.15:4697     , piece_id=DF76BCMKRNDMVO44MBPXVTFQMTFVBC55TP5M7LZC7YM636CO5SYA, seg_pos={0 0}, upload=518178]: Done uploading piece. err: <nil>
Dec 30 06:33:48.278594147 (591h4m48.149677183s) [noise=true , address=77.90.31.16:4736     , piece_id=T2J2MXHJ2Q47MDTOR67LKVQMGYJMCJNJ5WOKDRAU63VQ3WWDJYGA, seg_pos={0 0}, upload=518178]: Done uploading piece. err: <nil>
Dec 30 06:33:48.365522151 (591h4m48.236605186s) [noise=true , address=45.91.116.13:4154    , piece_id=74LMQG6AL7XKL55LOC6DNBU4NHMWFWEVDHM264XNRXVWILN27N4Q, seg_pos={0 0}, upload=518178]: Done uploading piece. err: <nil>
Dec 30 06:33:48.365540567 (591h4m48.236623602s) [seg_pos={0 0}, upload=518178]: Segment reached optimal threshold of 13 pieces.
Dec 30 06:33:48.365711863 (591h4m48.236794898s) [noise=true , address=45.91.116.5:4298     , piece_id=KNNJ6FSVFTDRA5AVQUWXTYBU2HPULCFIDDWE4S45S3CE4Y4YNNCA, seg_pos={0 0}, upload=518178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: write tcp 188.166.225.170:50618->45.91.116.5:4298: use of closed network connection; write tcp 188.166.225.170:50618->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50618->45.91.116.5:4298: use of closed network connection
Dec 30 06:33:48.365718105 (591h4m48.23680114s) [noise=true , address=45.91.116.5:4298     , piece_id=KNNJ6FSVFTDRA5AVQUWXTYBU2HPULCFIDDWE4S45S3CE4Y4YNNCA, seg_pos={0 0}, upload=518178]: Long tail cancellation due to optimal threshold
Dec 30 06:33:48.366085294 (591h4m48.237168339s) [noise=true , address=77.90.31.18:4805     , piece_id=HL6D5PCKCGBYDIZY37LLYYISPSGLSLVVBDPFQTYYIT6B7HYGKSLA, seg_pos={0 0}, upload=518178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Dec 30 06:33:48.366103949 (591h4m48.237186994s) [noise=true , address=77.90.31.18:4805     , piece_id=HL6D5PCKCGBYDIZY37LLYYISPSGLSLVVBDPFQTYYIT6B7HYGKSLA, seg_pos={0 0}, upload=518178]: Long tail cancellation due to optimal threshold
Dec 30 06:33:48.366360227 (591h4m48.237443272s) [noise=true , address=45.91.116.4:4937     , piece_id=AVRO6CMJVS4Q5YF6BJD4KVLK3AZNK7NWRFGCQNI5BK2JBNAN2HPA, seg_pos={0 0}, upload=518178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: write tcp 188.166.225.170:56666->45.91.116.4:4937: use of closed network connection; write tcp 188.166.225.170:56666->45.91.116.4:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56666->45.91.116.4:4937: use of closed network connection
Dec 30 06:33:48.366374324 (591h4m48.237457359s) [noise=true , address=45.91.116.4:4937     , piece_id=AVRO6CMJVS4Q5YF6BJD4KVLK3AZNK7NWRFGCQNI5BK2JBNAN2HPA, seg_pos={0 0}, upload=518178]: Long tail cancellation due to optimal threshold
Dec 30 06:33:48.366395674 (591h4m48.23747871s) [seg_pos={0 0}, upload=518178]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 30 06:33:48.366476780 (591h4m48.237559815s) [upload=518178]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:33:48.366481639 (591h4m48.237564674s) [upload=518178]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:33:48.658629304 (591h4m48.529712349s) [upload=518178]: Done uploading segments...
Dec 30 06:33:48.658651926 (591h4m48.529734991s) [upload=518178]: Upload finished. err: <nil>
Duration: 6.254522698s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
6 out of 60 is failed (threshold=6) [..................X...........X..............XX...X......X..]
duration: 
4.815930402s
trace: 
https://jaeger.dev.storj.io/trace/76018c27d0241e10
FAIL (2025-12-30 06:34:38 UTC) 
orbiter warning: context deadline exceeded
Duration: 4.815957564s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [...................................X........................]
duration: 
8.108884712s
trace: 
https://jaeger.dev.storj.io/trace/deb96436003dee
FAIL (2025-12-30 06:34:36 UTC) 
orbiter warning: read tcp 188.166.225.170:52458->45.38.24.2:443: read: connection reset by peer
Duration: 8.108911855s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [....................X...X......X............X...............]
duration: 
48.870953158s
trace: 
https://jaeger.dev.storj.io/trace/45b769fc71e13448
FAIL (2025-12-30 06:34:16 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
.577697683 (590h53m11.448780728s) [noise=true , address=193.149.164.143:4704 , piece_id=4T2IJIA6WHI5LMIUP5BLJLCD3GRY3A6PXR6G5OWJWUSYZT5ELGHQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578173528 (590h53m11.449256573s) [noise=true , address=64.49.13.27:4965     , piece_id=CO4O5F2IBZAAKBZBV3HWNNOXZOGLNNDPALWMQZ3DEM3MREASVFEA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578542992 (590h53m11.449626027s) [noise=true , address=77.90.31.15:4729     , piece_id=NVMXFEILHGT622IIPYYT4FFHC2WZLHMCZM4VT5WUPHRAPH3DX6TA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578846911 (590h53m11.449929946s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579458044 (590h53m11.450541089s) [noise=true , address=45.91.116.11:4150    , piece_id=E66IDHTJDLYLYJIOWMOIKOOWLXCUNCMBIQ7SQBAD3VTJF6VX5JLQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579891209 (590h53m11.450974245s) [noise=true , address=145.79.227.29:4945   , piece_id=SHL73IDEI54GRCWYNWHRUSJZZ4UUXREAX54DFJLTG5QPZCF5QKIQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579915535 (590h53m11.45099858s) [noise=true , address=145.79.227.30:4772   , piece_id=PVMD5DWRRPVARTSZ6O7HN6MUVTZUYWLYSNQR5GDMNKUJZGXMYPFQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580325466 (590h53m11.451408511s) [noise=true , address=77.90.31.12:4603     , piece_id=2I4L7F2WEGK5OSLODJSJ4672URBA7DUGXWZKTYB6ZNA2TQIGVXWA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580379599 (590h53m11.451462644s) [noise=true , address=77.90.31.14:4671     , piece_id=263TRISJ5ADFTX43ULSSGBAF2KMOXAPISJ56LLE53D74XOEMQ5EA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580692044 (590h53m11.451775089s) [noise=true , address=145.79.227.3:4175    , piece_id=UCV5WQNVWEAMEDBWDNXEVSQEGXPJE7KD6YSWC5A4WXYUKUCK4NLA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580857859 (590h53m11.451940894s) [noise=true , address=77.90.31.19:4860     , piece_id=U2MNFOAD7FHCDBE4FUYOROIP3P33ROJ7K75SF5Z747EFKFTF7RGA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581089210 (590h53m11.452172255s) [noise=true , address=145.79.227.44:4203   , piece_id=WHCKQ2FRLYAZE7Q6HYZNTS4EISVHZNAPDDKH34WN33ALK4MVK2EA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581351320 (590h53m11.452434355s) [noise=true , address=64.49.13.154:4928    , piece_id=SEVBZBMNGURP5TRUEBA4PHRSA6MNANVJUKINALJUWPQWBGKVYNTA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581457091 (590h53m11.452540126s) [noise=true , address=145.79.227.34:4909   , piece_id=3QSWTNR5LGUUAY3N5HJKSPL3TRQ6WO5F5OD4VTXKWHWUXUF7PVVQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581863144 (590h53m11.452946179s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.584010443 (590h53m11.455093478s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.585122791 (590h53m11.456205826s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:12.983305402 (590h53m12.854388447s) [upload=517998]: Next returned nil segment
Dec 30 06:22:12.983321313 (590h53m12.854404348s) [upload=517998]: Waiting for error group managing segments...
Dec 30 06:22:13.379703053 (590h53m13.250786088s) [noise=true , address=64.49.13.27:4965     , piece_id=CO4O5F2IBZAAKBZBV3HWNNOXZOGLNNDPALWMQZ3DEM3MREASVFEA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.418055622 (590h53m13.289138657s) [noise=true , address=145.79.227.3:4175    , piece_id=UCV5WQNVWEAMEDBWDNXEVSQEGXPJE7KD6YSWC5A4WXYUKUCK4NLA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.509034160 (590h53m13.380117205s) [noise=true , address=64.49.13.154:4928    , piece_id=SEVBZBMNGURP5TRUEBA4PHRSA6MNANVJUKINALJUWPQWBGKVYNTA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.642886154 (590h53m13.513969199s) [noise=true , address=77.90.31.14:4671     , piece_id=263TRISJ5ADFTX43ULSSGBAF2KMOXAPISJ56LLE53D74XOEMQ5EA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.788145520 (590h53m13.659228555s) [noise=true , address=77.90.31.12:4603     , piece_id=2I4L7F2WEGK5OSLODJSJ4672URBA7DUGXWZKTYB6ZNA2TQIGVXWA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.858878757 (590h53m13.729961792s) [noise=true , address=145.79.227.49:4369   , piece_id=XUEXGNJJIJ4DUBDNUV7CKF6J5JYHSLZAEPVGEDGBUBY42BIP4XEQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.879550569 (590h53m13.750633614s) [noise=true , address=145.79.227.34:4909   , piece_id=3QSWTNR5LGUUAY3N5HJKSPL3TRQ6WO5F5OD4VTXKWHWUXUF7PVVQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.940897723 (590h53m13.811980769s) [noise=true , address=77.90.31.19:4860     , piece_id=U2MNFOAD7FHCDBE4FUYOROIP3P33ROJ7K75SF5Z747EFKFTF7RGA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.989791936 (590h53m13.860874981s) [noise=true , address=45.91.116.11:4150    , piece_id=E66IDHTJDLYLYJIOWMOIKOOWLXCUNCMBIQ7SQBAD3VTJF6VX5JLQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.289516718 (590h53m14.160599753s) [noise=true , address=145.79.227.44:4203   , piece_id=WHCKQ2FRLYAZE7Q6HYZNTS4EISVHZNAPDDKH34WN33ALK4MVK2EA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.338651537 (590h53m14.209734582s) [noise=true , address=77.90.31.15:4729     , piece_id=NVMXFEILHGT622IIPYYT4FFHC2WZLHMCZM4VT5WUPHRAPH3DX6TA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.344145168 (590h53m14.215228213s) [noise=true , address=145.79.227.30:4772   , piece_id=PVMD5DWRRPVARTSZ6O7HN6MUVTZUYWLYSNQR5GDMNKUJZGXMYPFQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.667232847 (590h53m14.538315892s) [noise=true , address=193.149.164.143:4704 , piece_id=4T2IJIA6WHI5LMIUP5BLJLCD3GRY3A6PXR6G5OWJWUSYZT5ELGHQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.671388990 (590h53m14.542472025s) [noise=true , address=145.79.227.29:4945   , piece_id=SHL73IDEI54GRCWYNWHRUSJZZ4UUXREAX54DFJLTG5QPZCF5QKIQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.671415190 (590h53m14.542498226s) [seg_pos={0 0}, upload=517998]: Segment reached optimal threshold of 14 pieces.
Dec 30 06:22:14.671803600 (590h53m14.542886655s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hU1LwL2gX7rVnrNgzaBCYB37ziqf7s7aUgtF2Uc3antReQ6me): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.671814470 (590h53m14.542897525s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672014932 (590h53m14.543097977s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bhN3cR22QuAYihnnB3x3R97UZRWJ8sFPP8fjQcXZ7qhNZphZG): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672022637 (590h53m14.543105672s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672088933 (590h53m14.543171988s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672127677 (590h53m14.543210742s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672312739 (590h53m14.543395774s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSXWFiq27Dd2vBDD9vVnhDHVG59UmDKn3hVAhf3oyo5goVNaE): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672319953 (590h53m14.543402988s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672337847 (590h53m14.543420882s) [seg_pos={0 0}, upload=517998]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 30 06:22:14.672452947 (590h53m14.543535982s) [upload=517998]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:22:14.672458507 (590h53m14.543541542s) [upload=517998]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:22:14.981437069 (590h53m14.852520114s) [upload=517998]: Done uploading segments...
Dec 30 06:22:14.981456546 (590h53m14.852539581s) [upload=517998]: Upload finished. err: <nil>
Duration: 48.870983014s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
15 out of 60 is failed (threshold=3) [.X..X..X..XX.......X..X......X....X...X..X.X.X.....X.......X]
duration: 
30.003531391s
trace: 
https://jaeger.dev.storj.io/trace/503c9a2d8002fe81
FAIL (2025-12-30 06:34:15 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: metaclient: context deadline exceeded
======LOGS======
591h4m45.645724096s) [upload=518178]: Uploading segments...
Dec 30 06:33:45.774794463 (591h4m45.645877498s) [upload=518178]: Got next segment. Inline: false
Dec 30 06:33:45.774839228 (591h4m45.645922263s) [upload=518178]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 30 06:33:45.774843977 (591h4m45.645927013s) [upload=518178]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 30 06:33:46.018508112 (591h4m45.889591177s) [seg_pos={0 0}, upload=518178]: Begin upload segment...
Dec 30 06:33:46.018555122 (591h4m45.889638167s) [seg_pos={0 0}, upload=518178]: Done begin upload segment.
Dec 30 06:33:46.018585259 (591h4m45.889668304s) [noise=true , address=145.79.227.31:4798   , piece_id=PRWLUUKQOAXDKY6MZWWE4PUNRWZCZLKPSA6TTL5ANTZAU3T66YMQ, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.018600257 (591h4m45.889683292s) [noise=true , address=145.79.227.14:4837   , piece_id=AD4T3VJNIONSHGWRCEU4JHQDZ5S4WRO4X5DGH6Y6BRPMXPGP3XTA, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.018769209 (591h4m45.889852254s) [noise=true , address=145.79.227.11:4730   , piece_id=R2OZFIRJFTWVRKCMUEBLI3YMY2FJQQ5X76SGRWZBU7RVADROX55A, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.019113825 (591h4m45.89019686s) [noise=true , address=145.79.227.6:4259    , piece_id=Y4R7Y2JISFXLJLS4JSZ46DVBLNEZPPL3PUUSDUOIA5APPCJ5VHZA, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.019526612 (591h4m45.890609657s) [noise=true , address=77.90.31.16:4736     , piece_id=T2J2MXHJ2Q47MDTOR67LKVQMGYJMCJNJ5WOKDRAU63VQ3WWDJYGA, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.019940860 (591h4m45.891023895s) [noise=true , address=145.79.227.15:4873   , piece_id=4CQAUIEEJVRXRWR3NIAVOVQTLSBF6SXRU2SD4CRINYYESDCNA53Q, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.022137934 (591h4m45.893220979s) [noise=true , address=77.90.31.18:4805     , piece_id=HL6D5PCKCGBYDIZY37LLYYISPSGLSLVVBDPFQTYYIT6B7HYGKSLA, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.025109061 (591h4m45.896192106s) [noise=true , address=45.91.116.13:4154    , piece_id=74LMQG6AL7XKL55LOC6DNBU4NHMWFWEVDHM264XNRXVWILN27N4Q, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.026946580 (591h4m45.898029625s) [noise=true , address=145.79.227.9:4366    , piece_id=7HVXPRELB72NAIAMO7RZGEPE5TNXS2YU7TFGELEREHYUDAWGSI6A, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.027233997 (591h4m45.898317042s) [noise=true , address=77.90.31.15:4697     , piece_id=DF76BCMKRNDMVO44MBPXVTFQMTFVBC55TP5M7LZC7YM636CO5SYA, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.028554913 (591h4m45.899637948s) [noise=true , address=145.79.227.47:4266   , piece_id=45XGNTN5LJWAGG6NCTXO3Y5ZMG3X6FWWVYSLD2SWDRZPDRYYF4AQ, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.029466017 (591h4m45.900549052s) [noise=true , address=45.91.116.4:4937     , piece_id=AVRO6CMJVS4Q5YF6BJD4KVLK3AZNK7NWRFGCQNI5BK2JBNAN2HPA, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.029945951 (591h4m45.901028986s) [noise=true , address=145.79.227.51:4409   , piece_id=Y4REGGBEQ2PXDU6INBM5PI3KK6F7Z3Z4D5IY55YKADTDJCDE7AYQ, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.031216642 (591h4m45.902299687s) [noise=true , address=145.79.227.36:4519   , piece_id=3RF3RXFKXSHCXRVOYGRKPG6HATUIJOWPINMJ7CSOHX6LHC2SHBSA, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.031529728 (591h4m45.902612763s) [noise=true , address=45.91.116.5:4298     , piece_id=KNNJ6FSVFTDRA5AVQUWXTYBU2HPULCFIDDWE4S45S3CE4Y4YNNCA, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:46.031726732 (591h4m45.902809777s) [noise=true , address=145.79.227.21:4473   , piece_id=4T5A7ODCUWWZOGOAJ5DBT6YP5PGUMCYYKUR5773PPP5SEPJDAP5A, seg_pos={0 0}, upload=518178]: Uploading piece...
Dec 30 06:33:47.626922914 (591h4m47.498005949s) [upload=518178]: Next returned nil segment
Dec 30 06:33:47.626936740 (591h4m47.498019775s) [upload=518178]: Waiting for error group managing segments...
Dec 30 06:33:48.012796297 (591h4m47.883879342s) [noise=true , address=145.79.227.14:4837   , piece_id=AD4T3VJNIONSHGWRCEU4JHQDZ5S4WRO4X5DGH6Y6BRPMXPGP3XTA, seg_pos={0 0}, upload=518178]: Done uploading piece. err: <nil>
Dec 30 06:33:48.013252165 (591h4m47.88433521s) [noise=true , address=145.79.227.9:4366    , piece_id=7HVXPRELB72NAIAMO7RZGEPE5TNXS2YU7TFGELEREHYUDAWGSI6A, seg_pos={0 0}, upload=518178]: Done uploading piece. err: <nil>
Dec 30 06:33:48.016575023 (591h4m47.887658068s) [noise=true , address=145.79.227.21:4473   , piece_id=4T5A7ODCUWWZOGOAJ5DBT6YP5PGUMCYYKUR5773PPP5SEPJDAP5A, seg_pos={0 0}, upload=518178]: Done uploading piece. err: <nil>
Dec 30 06:33:48.027689947 (591h4m47.898772992s) [noise=true , address=145.79.227.6:4259    , piece_id=Y4R7Y2JISFXLJLS4JSZ46DVBLNEZPPL3PUUSDUOIA5APPCJ5VHZA, seg_pos={0 0}, upload=518178]: Done uploading piece. err: <nil>
Dec 30 06:33:48.028820149 (591h4m47.899903194s) [noise=true , address=145.79.227.31:4798   , piece_id=PRWLUUKQOAXDKY6MZWWE4PUNRWZCZLKPSA6TTL5ANTZAU3T66YMQ, seg_pos={0 0}, upload=518178]: Done uploading piece. err: <nil>
Dec 30 06:33:48.046543677 (591h4m47.917626722s) [noise=true , address=145.79.227.51:4409   , piece_id=Y4REGGBEQ2PXDU6INBM5PI3KK6F7Z3Z4D5IY55YKADTDJCDE7AYQ, seg_pos={0 0}, upload=518178]: Done uploading piece. err: <nil>
Dec 30 06:33:48.091123805 (591h4m47.96220685s) [noise=true , address=145.79.227.15:4873   , piece_id=4CQAUIEEJVRXRWR3NIAVOVQTLSBF6SXRU2SD4CRINYYESDCNA53Q, seg_pos={0 0}, upload=518178]: Done uploading piece. err: <nil>
Dec 30 06:33:48.097407389 (591h4m47.968490425s) [noise=true , address=145.79.227.11:4730   , piece_id=R2OZFIRJFTWVRKCMUEBLI3YMY2FJQQ5X76SGRWZBU7RVADROX55A, seg_pos={0 0}, upload=518178]: Done uploading piece. err: <nil>
Dec 30 06:33:48.100992456 (591h4m47.972075501s) [noise=true , address=145.79.227.36:4519   , piece_id=3RF3RXFKXSHCXRVOYGRKPG6HATUIJOWPINMJ7CSOHX6LHC2SHBSA, seg_pos={0 0}, upload=518178]: Done uploading piece. err: <nil>
Dec 30 06:33:48.110681677 (591h4m47.981764722s) [noise=true , address=145.79.227.47:4266   , piece_id=45XGNTN5LJWAGG6NCTXO3Y5ZMG3X6FWWVYSLD2SWDRZPDRYYF4AQ, seg_pos={0 0}, upload=518178]: Done uploading piece. err: <nil>
Dec 30 06:33:48.184503174 (591h4m48.055586209s) [noise=true , address=77.90.31.15:4697     , piece_id=DF76BCMKRNDMVO44MBPXVTFQMTFVBC55TP5M7LZC7YM636CO5SYA, seg_pos={0 0}, upload=518178]: Done uploading piece. err: <nil>
Dec 30 06:33:48.278594147 (591h4m48.149677183s) [noise=true , address=77.90.31.16:4736     , piece_id=T2J2MXHJ2Q47MDTOR67LKVQMGYJMCJNJ5WOKDRAU63VQ3WWDJYGA, seg_pos={0 0}, upload=518178]: Done uploading piece. err: <nil>
Dec 30 06:33:48.365522151 (591h4m48.236605186s) [noise=true , address=45.91.116.13:4154    , piece_id=74LMQG6AL7XKL55LOC6DNBU4NHMWFWEVDHM264XNRXVWILN27N4Q, seg_pos={0 0}, upload=518178]: Done uploading piece. err: <nil>
Dec 30 06:33:48.365540567 (591h4m48.236623602s) [seg_pos={0 0}, upload=518178]: Segment reached optimal threshold of 13 pieces.
Dec 30 06:33:48.365711863 (591h4m48.236794898s) [noise=true , address=45.91.116.5:4298     , piece_id=KNNJ6FSVFTDRA5AVQUWXTYBU2HPULCFIDDWE4S45S3CE4Y4YNNCA, seg_pos={0 0}, upload=518178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: write tcp 188.166.225.170:50618->45.91.116.5:4298: use of closed network connection; write tcp 188.166.225.170:50618->45.91.116.5:4298: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50618->45.91.116.5:4298: use of closed network connection
Dec 30 06:33:48.365718105 (591h4m48.23680114s) [noise=true , address=45.91.116.5:4298     , piece_id=KNNJ6FSVFTDRA5AVQUWXTYBU2HPULCFIDDWE4S45S3CE4Y4YNNCA, seg_pos={0 0}, upload=518178]: Long tail cancellation due to optimal threshold
Dec 30 06:33:48.366085294 (591h4m48.237168339s) [noise=true , address=77.90.31.18:4805     , piece_id=HL6D5PCKCGBYDIZY37LLYYISPSGLSLVVBDPFQTYYIT6B7HYGKSLA, seg_pos={0 0}, upload=518178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT): protocol: expected piece hash; context canceled; EOF
Dec 30 06:33:48.366103949 (591h4m48.237186994s) [noise=true , address=77.90.31.18:4805     , piece_id=HL6D5PCKCGBYDIZY37LLYYISPSGLSLVVBDPFQTYYIT6B7HYGKSLA, seg_pos={0 0}, upload=518178]: Long tail cancellation due to optimal threshold
Dec 30 06:33:48.366360227 (591h4m48.237443272s) [noise=true , address=45.91.116.4:4937     , piece_id=AVRO6CMJVS4Q5YF6BJD4KVLK3AZNK7NWRFGCQNI5BK2JBNAN2HPA, seg_pos={0 0}, upload=518178]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ry1jh9FXr14g7WU4bfgJH4qw71kmTugE5qbqEUZmf7oVZYRkq): protocol: write tcp 188.166.225.170:56666->45.91.116.4:4937: use of closed network connection; write tcp 188.166.225.170:56666->45.91.116.4:4937: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56666->45.91.116.4:4937: use of closed network connection
Dec 30 06:33:48.366374324 (591h4m48.237457359s) [noise=true , address=45.91.116.4:4937     , piece_id=AVRO6CMJVS4Q5YF6BJD4KVLK3AZNK7NWRFGCQNI5BK2JBNAN2HPA, seg_pos={0 0}, upload=518178]: Long tail cancellation due to optimal threshold
Dec 30 06:33:48.366395674 (591h4m48.23747871s) [seg_pos={0 0}, upload=518178]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 30 06:33:48.366476780 (591h4m48.237559815s) [upload=518178]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:33:48.366481639 (591h4m48.237564674s) [upload=518178]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:33:48.658629304 (591h4m48.529712349s) [upload=518178]: Done uploading segments...
Dec 30 06:33:48.658651926 (591h4m48.529734991s) [upload=518178]: Upload finished. err: <nil>
Duration: 30.003557291s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [....................................X.......................]
duration: 
6.129915069s
trace: 
https://jaeger.dev.storj.io/trace/deb96436003dee
FAIL (2025-12-30 06:33:43 UTC) 
orbiter warning: read tcp 188.166.225.170:52458->45.38.24.2:443: read: connection reset by peer
Duration: 6.12998375s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
6 out of 60 is failed (threshold=6) [...................X...........X..............XX...X......X.]
duration: 
3.567738748s
trace: 
https://jaeger.dev.storj.io/trace/76018c27d0241e10
FAIL (2025-12-30 06:33:39 UTC) 
orbiter warning: context deadline exceeded
Duration: 3.567770187s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
6 out of 60 is failed (threshold=6) [....................X...........X..............XX...X......X]
duration: 
5.000613864s
trace: 
https://jaeger.dev.storj.io/trace/76018c27d0241e10
FAIL (2025-12-30 06:33:21 UTC) 
orbiter warning: context deadline exceeded
Duration: 5.000636787s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
14 out of 60 is failed (threshold=3) [..X..X..X..XX.......X..X......X....X...X..X.X.X.....X.......]
duration: 
6.524747755s
trace: 
https://jaeger.dev.storj.io/trace/32a160c1d95b9ce1
FAIL (2025-12-30 06:33:16 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, Piece ID: KCDCBQ3JCAYUP26TFIRYKWXRQ5S7Q7JLWHY4XDB3FXU263DMGJRA) context deadline exceeded; piecestore: (Node ID: 1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, Piece ID: FCPRQ6RUSDVTSZIK6QFECZXB3T6FE6SWYH7DNEPICJW7QWFQK3EQ) context deadline exceeded
======LOGS======
Dec 30 06:27:31.479172017 (590h58m31.350255062s) [upload=518086]: Starting upload
Dec 30 06:27:31.479271175 (590h58m31.35035421s) [upload=518086]: Done starting upload
Dec 30 06:27:31.479402385 (590h58m31.35048542s) [upload=518086]: Uploading segments...
Dec 30 06:27:31.480006245 (590h58m31.35108929s) [upload=518086]: Got next segment. Inline: false
Dec 30 06:27:31.480174686 (590h58m31.351257721s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 30 06:27:31.480182702 (590h58m31.351265737s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 30 06:27:31.727629458 (590h58m31.598712493s) [seg_pos={0 0}, upload=518086]: Begin upload segment...
Dec 30 06:27:31.727685714 (590h58m31.598768759s) [seg_pos={0 0}, upload=518086]: Done begin upload segment.
Dec 30 06:27:31.727714169 (590h58m31.598797214s) [noise=true , address=77.90.31.21:4880     , piece_id=KCDCBQ3JCAYUP26TFIRYKWXRQ5S7Q7JLWHY4XDB3FXU263DMGJRA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.727728035 (590h58m31.59881108s) [noise=true , address=145.79.227.17:4972   , piece_id=3Q2WOCLVLN4546C4TTIHVDTEI2A3NXCAKTUD337OUDAN6KSW7AOQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.727802376 (590h58m31.598885421s) [noise=true , address=145.79.227.13:4804   , piece_id=FCZ4CYT6QT3IHOUC6R3H57NOOOMPDM3Z6FQ3TPOH4MR5QNZR7STQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.729155453 (590h58m31.600238488s) [noise=true , address=145.79.227.31:4799   , piece_id=SAIJ2QPHM5AGSRV62E7TD2A4YBETORXUCK5YUK4EZQUKN3TUF64Q, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.729401191 (590h58m31.600484236s) [noise=true , address=145.79.227.22:4509   , piece_id=7U75JX2T56P7KP3CJIOI24XXY3ED4VAEIMQNJSPHKS5W7YF3FXCA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.729850997 (590h58m31.600934032s) [noise=true , address=77.90.31.17:4773     , piece_id=NGPVC3N4UPXTO42JJIHGCQMMZU4MS3C36A3KZIYSGOF6B3PX4EJQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.730681368 (590h58m31.601764404s) [noise=true , address=145.79.227.45:4230   , piece_id=G64X3YOMTVLAIWQY5RIFY6K5EHDSUIZWCN2RDWK6LRVN3XUZBLKA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.731315676 (590h58m31.602398721s) [noise=true , address=145.79.227.27:4689   , piece_id=C2RDOQOUDRFIHSAPQIJNYFHZJFQUQWPLOKJUWLPNFMKCBA5H4XLA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.732192586 (590h58m31.603275631s) [noise=true , address=77.90.31.12:4590     , piece_id=FCPRQ6RUSDVTSZIK6QFECZXB3T6FE6SWYH7DNEPICJW7QWFQK3EQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.732619839 (590h58m31.603702884s) [noise=true , address=45.91.116.5:4298     , piece_id=XSQHRQH6UQGLUDFGDHXPNVJSTTRBSBDIEELEH4JC5GEEQ2M4KQ5A, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.733515114 (590h58m31.604598159s) [noise=true , address=77.90.31.13:4626     , piece_id=FWF4DQ4MPPWF2SKBBZLNGV7KWQ23BEA7UIS6FHDKINPB6YRAZARQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.734041075 (590h58m31.60512412s) [noise=true , address=145.79.227.20:4438   , piece_id=A623O6EK2ZQB6P37KJG6L7JYZICD5UY6JOYVKZ2BN2SMBUOMGMEA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.734770875 (590h58m31.60585392s) [noise=true , address=145.79.227.15:4873   , piece_id=33B56NW26Q23FA3A4AZ74ZZJYAAZ5M4ZSBDX5JE3M2BX4RVUI2YQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.735257321 (590h58m31.606340366s) [noise=true , address=145.79.227.52:4445   , piece_id=Z4HTRQZLIIBDE34RDPNDZR5BGASGJRJI4Q6DCEW4T3CHMI2PREBA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.736066582 (590h58m31.607149617s) [noise=true , address=145.79.227.7:4293    , piece_id=2WGGEODE53DFZXSKPINQLR7G6AMBEH7C3IEHX44WCRHWOTXWQT5A, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.737627635 (590h58m31.60871067s) [noise=true , address=145.79.227.49:4339   , piece_id=2FQP72I6EC5DPC5B6B6NFRMPQT7QYWVZFOZFWZFQFMVRFO4GCT2A, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:33.442981428 (590h58m33.314064473s) [upload=518086]: Next returned nil segment
Dec 30 06:27:33.443000564 (590h58m33.3140836s) [upload=518086]: Waiting for error group managing segments...
Dec 30 06:27:33.726010138 (590h58m33.597093173s) [noise=true , address=145.79.227.27:4689   , piece_id=C2RDOQOUDRFIHSAPQIJNYFHZJFQUQWPLOKJUWLPNFMKCBA5H4XLA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.726365194 (590h58m33.597448229s) [noise=true , address=145.79.227.45:4230   , piece_id=G64X3YOMTVLAIWQY5RIFY6K5EHDSUIZWCN2RDWK6LRVN3XUZBLKA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.731331761 (590h58m33.602414806s) [noise=true , address=145.79.227.52:4445   , piece_id=Z4HTRQZLIIBDE34RDPNDZR5BGASGJRJI4Q6DCEW4T3CHMI2PREBA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.732488724 (590h58m33.603571759s) [noise=true , address=145.79.227.13:4804   , piece_id=FCZ4CYT6QT3IHOUC6R3H57NOOOMPDM3Z6FQ3TPOH4MR5QNZR7STQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.742934164 (590h58m33.614017199s) [noise=true , address=145.79.227.15:4873   , piece_id=33B56NW26Q23FA3A4AZ74ZZJYAAZ5M4ZSBDX5JE3M2BX4RVUI2YQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.746966712 (590h58m33.618049747s) [noise=true , address=145.79.227.31:4799   , piece_id=SAIJ2QPHM5AGSRV62E7TD2A4YBETORXUCK5YUK4EZQUKN3TUF64Q, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.781208554 (590h58m33.652291599s) [noise=true , address=145.79.227.7:4293    , piece_id=2WGGEODE53DFZXSKPINQLR7G6AMBEH7C3IEHX44WCRHWOTXWQT5A, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.807290017 (590h58m33.678373052s) [noise=true , address=145.79.227.20:4438   , piece_id=A623O6EK2ZQB6P37KJG6L7JYZICD5UY6JOYVKZ2BN2SMBUOMGMEA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.809530753 (590h58m33.680613798s) [noise=true , address=145.79.227.22:4509   , piece_id=7U75JX2T56P7KP3CJIOI24XXY3ED4VAEIMQNJSPHKS5W7YF3FXCA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.812826569 (590h58m33.683909604s) [noise=true , address=145.79.227.17:4972   , piece_id=3Q2WOCLVLN4546C4TTIHVDTEI2A3NXCAKTUD337OUDAN6KSW7AOQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.900372450 (590h58m33.771455495s) [noise=true , address=77.90.31.13:4626     , piece_id=FWF4DQ4MPPWF2SKBBZLNGV7KWQ23BEA7UIS6FHDKINPB6YRAZARQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.916464471 (590h58m33.787547506s) [noise=true , address=77.90.31.21:4880     , piece_id=KCDCBQ3JCAYUP26TFIRYKWXRQ5S7Q7JLWHY4XDB3FXU263DMGJRA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:34.018888070 (590h58m33.889971115s) [noise=true , address=77.90.31.12:4590     , piece_id=FCPRQ6RUSDVTSZIK6QFECZXB3T6FE6SWYH7DNEPICJW7QWFQK3EQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:34.018913669 (590h58m33.889996714s) [seg_pos={0 0}, upload=518086]: Segment reached optimal threshold of 13 pieces.
Dec 30 06:27:34.019155831 (590h58m33.890238876s) [noise=true , address=77.90.31.17:4773     , piece_id=NGPVC3N4UPXTO42JJIHGCQMMZU4MS3C36A3KZIYSGOF6B3PX4EJQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ): protocol: expected piece hash; context canceled; EOF
Dec 30 06:27:34.019166861 (590h58m33.890249906s) [noise=true , address=77.90.31.17:4773     , piece_id=NGPVC3N4UPXTO42JJIHGCQMMZU4MS3C36A3KZIYSGOF6B3PX4EJQ, seg_pos={0 0}, upload=518086]: Long tail cancellation due to optimal threshold
Dec 30 06:27:34.019372272 (590h58m33.890455318s) [noise=true , address=45.91.116.5:4298     , piece_id=XSQHRQH6UQGLUDFGDHXPNVJSTTRBSBDIEELEH4JC5GEEQ2M4KQ5A, seg_pos={0 0}, upload=518086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Dec 30 06:27:34.019400827 (590h58m33.890483862s) [noise=true , address=45.91.116.5:4298     , piece_id=XSQHRQH6UQGLUDFGDHXPNVJSTTRBSBDIEELEH4JC5GEEQ2M4KQ5A, seg_pos={0 0}, upload=518086]: Long tail cancellation due to optimal threshold
Dec 30 06:27:34.019477783 (590h58m33.890560838s) [noise=true , address=145.79.227.49:4339   , piece_id=2FQP72I6EC5DPC5B6B6NFRMPQT7QYWVZFOZFWZFQFMVRFO4GCT2A, seg_pos={0 0}, upload=518086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF
Dec 30 06:27:34.019487012 (590h58m33.890570057s) [noise=true , address=145.79.227.49:4339   , piece_id=2FQP72I6EC5DPC5B6B6NFRMPQT7QYWVZFOZFWZFQFMVRFO4GCT2A, seg_pos={0 0}, upload=518086]: Long tail cancellation due to optimal threshold
Dec 30 06:27:34.019511157 (590h58m33.890594192s) [seg_pos={0 0}, upload=518086]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 30 06:27:34.019579547 (590h58m33.890662582s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:27:34.019584216 (590h58m33.890667251s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:27:34.313480950 (590h58m34.184563985s) [upload=518086]: Done uploading segments...
Dec 30 06:27:34.313532458 (590h58m34.184615493s) [upload=518086]: Upload finished. err: <nil>
Duration: 6.524776379s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.....................................X......................]
duration: 
5.893567858s
trace: 
https://jaeger.dev.storj.io/trace/deb96436003dee
FAIL (2025-12-30 06:33:10 UTC) 
orbiter warning: read tcp 188.166.225.170:52458->45.38.24.2:443: read: connection reset by peer
Duration: 5.893625347s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [.....................X...X......X............X..............]
duration: 
36.189300168s
trace: 
https://jaeger.dev.storj.io/trace/45b769fc71e13448
FAIL (2025-12-30 06:33:00 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
.577697683 (590h53m11.448780728s) [noise=true , address=193.149.164.143:4704 , piece_id=4T2IJIA6WHI5LMIUP5BLJLCD3GRY3A6PXR6G5OWJWUSYZT5ELGHQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578173528 (590h53m11.449256573s) [noise=true , address=64.49.13.27:4965     , piece_id=CO4O5F2IBZAAKBZBV3HWNNOXZOGLNNDPALWMQZ3DEM3MREASVFEA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578542992 (590h53m11.449626027s) [noise=true , address=77.90.31.15:4729     , piece_id=NVMXFEILHGT622IIPYYT4FFHC2WZLHMCZM4VT5WUPHRAPH3DX6TA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578846911 (590h53m11.449929946s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579458044 (590h53m11.450541089s) [noise=true , address=45.91.116.11:4150    , piece_id=E66IDHTJDLYLYJIOWMOIKOOWLXCUNCMBIQ7SQBAD3VTJF6VX5JLQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579891209 (590h53m11.450974245s) [noise=true , address=145.79.227.29:4945   , piece_id=SHL73IDEI54GRCWYNWHRUSJZZ4UUXREAX54DFJLTG5QPZCF5QKIQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579915535 (590h53m11.45099858s) [noise=true , address=145.79.227.30:4772   , piece_id=PVMD5DWRRPVARTSZ6O7HN6MUVTZUYWLYSNQR5GDMNKUJZGXMYPFQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580325466 (590h53m11.451408511s) [noise=true , address=77.90.31.12:4603     , piece_id=2I4L7F2WEGK5OSLODJSJ4672URBA7DUGXWZKTYB6ZNA2TQIGVXWA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580379599 (590h53m11.451462644s) [noise=true , address=77.90.31.14:4671     , piece_id=263TRISJ5ADFTX43ULSSGBAF2KMOXAPISJ56LLE53D74XOEMQ5EA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580692044 (590h53m11.451775089s) [noise=true , address=145.79.227.3:4175    , piece_id=UCV5WQNVWEAMEDBWDNXEVSQEGXPJE7KD6YSWC5A4WXYUKUCK4NLA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580857859 (590h53m11.451940894s) [noise=true , address=77.90.31.19:4860     , piece_id=U2MNFOAD7FHCDBE4FUYOROIP3P33ROJ7K75SF5Z747EFKFTF7RGA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581089210 (590h53m11.452172255s) [noise=true , address=145.79.227.44:4203   , piece_id=WHCKQ2FRLYAZE7Q6HYZNTS4EISVHZNAPDDKH34WN33ALK4MVK2EA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581351320 (590h53m11.452434355s) [noise=true , address=64.49.13.154:4928    , piece_id=SEVBZBMNGURP5TRUEBA4PHRSA6MNANVJUKINALJUWPQWBGKVYNTA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581457091 (590h53m11.452540126s) [noise=true , address=145.79.227.34:4909   , piece_id=3QSWTNR5LGUUAY3N5HJKSPL3TRQ6WO5F5OD4VTXKWHWUXUF7PVVQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581863144 (590h53m11.452946179s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.584010443 (590h53m11.455093478s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.585122791 (590h53m11.456205826s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:12.983305402 (590h53m12.854388447s) [upload=517998]: Next returned nil segment
Dec 30 06:22:12.983321313 (590h53m12.854404348s) [upload=517998]: Waiting for error group managing segments...
Dec 30 06:22:13.379703053 (590h53m13.250786088s) [noise=true , address=64.49.13.27:4965     , piece_id=CO4O5F2IBZAAKBZBV3HWNNOXZOGLNNDPALWMQZ3DEM3MREASVFEA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.418055622 (590h53m13.289138657s) [noise=true , address=145.79.227.3:4175    , piece_id=UCV5WQNVWEAMEDBWDNXEVSQEGXPJE7KD6YSWC5A4WXYUKUCK4NLA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.509034160 (590h53m13.380117205s) [noise=true , address=64.49.13.154:4928    , piece_id=SEVBZBMNGURP5TRUEBA4PHRSA6MNANVJUKINALJUWPQWBGKVYNTA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.642886154 (590h53m13.513969199s) [noise=true , address=77.90.31.14:4671     , piece_id=263TRISJ5ADFTX43ULSSGBAF2KMOXAPISJ56LLE53D74XOEMQ5EA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.788145520 (590h53m13.659228555s) [noise=true , address=77.90.31.12:4603     , piece_id=2I4L7F2WEGK5OSLODJSJ4672URBA7DUGXWZKTYB6ZNA2TQIGVXWA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.858878757 (590h53m13.729961792s) [noise=true , address=145.79.227.49:4369   , piece_id=XUEXGNJJIJ4DUBDNUV7CKF6J5JYHSLZAEPVGEDGBUBY42BIP4XEQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.879550569 (590h53m13.750633614s) [noise=true , address=145.79.227.34:4909   , piece_id=3QSWTNR5LGUUAY3N5HJKSPL3TRQ6WO5F5OD4VTXKWHWUXUF7PVVQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.940897723 (590h53m13.811980769s) [noise=true , address=77.90.31.19:4860     , piece_id=U2MNFOAD7FHCDBE4FUYOROIP3P33ROJ7K75SF5Z747EFKFTF7RGA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.989791936 (590h53m13.860874981s) [noise=true , address=45.91.116.11:4150    , piece_id=E66IDHTJDLYLYJIOWMOIKOOWLXCUNCMBIQ7SQBAD3VTJF6VX5JLQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.289516718 (590h53m14.160599753s) [noise=true , address=145.79.227.44:4203   , piece_id=WHCKQ2FRLYAZE7Q6HYZNTS4EISVHZNAPDDKH34WN33ALK4MVK2EA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.338651537 (590h53m14.209734582s) [noise=true , address=77.90.31.15:4729     , piece_id=NVMXFEILHGT622IIPYYT4FFHC2WZLHMCZM4VT5WUPHRAPH3DX6TA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.344145168 (590h53m14.215228213s) [noise=true , address=145.79.227.30:4772   , piece_id=PVMD5DWRRPVARTSZ6O7HN6MUVTZUYWLYSNQR5GDMNKUJZGXMYPFQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.667232847 (590h53m14.538315892s) [noise=true , address=193.149.164.143:4704 , piece_id=4T2IJIA6WHI5LMIUP5BLJLCD3GRY3A6PXR6G5OWJWUSYZT5ELGHQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.671388990 (590h53m14.542472025s) [noise=true , address=145.79.227.29:4945   , piece_id=SHL73IDEI54GRCWYNWHRUSJZZ4UUXREAX54DFJLTG5QPZCF5QKIQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.671415190 (590h53m14.542498226s) [seg_pos={0 0}, upload=517998]: Segment reached optimal threshold of 14 pieces.
Dec 30 06:22:14.671803600 (590h53m14.542886655s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hU1LwL2gX7rVnrNgzaBCYB37ziqf7s7aUgtF2Uc3antReQ6me): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.671814470 (590h53m14.542897525s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672014932 (590h53m14.543097977s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bhN3cR22QuAYihnnB3x3R97UZRWJ8sFPP8fjQcXZ7qhNZphZG): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672022637 (590h53m14.543105672s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672088933 (590h53m14.543171988s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672127677 (590h53m14.543210742s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672312739 (590h53m14.543395774s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSXWFiq27Dd2vBDD9vVnhDHVG59UmDKn3hVAhf3oyo5goVNaE): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672319953 (590h53m14.543402988s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672337847 (590h53m14.543420882s) [seg_pos={0 0}, upload=517998]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 30 06:22:14.672452947 (590h53m14.543535982s) [upload=517998]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:22:14.672458507 (590h53m14.543541542s) [upload=517998]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:22:14.981437069 (590h53m14.852520114s) [upload=517998]: Done uploading segments...
Dec 30 06:22:14.981456546 (590h53m14.852539581s) [upload=517998]: Upload finished. err: <nil>
Duration: 36.189330517s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [......................X...X......X............X.............]
duration: 
15.300911638s
trace: 
https://jaeger.dev.storj.io/trace/45b769fc71e13448
FAIL (2025-12-30 06:32:21 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
.577697683 (590h53m11.448780728s) [noise=true , address=193.149.164.143:4704 , piece_id=4T2IJIA6WHI5LMIUP5BLJLCD3GRY3A6PXR6G5OWJWUSYZT5ELGHQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578173528 (590h53m11.449256573s) [noise=true , address=64.49.13.27:4965     , piece_id=CO4O5F2IBZAAKBZBV3HWNNOXZOGLNNDPALWMQZ3DEM3MREASVFEA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578542992 (590h53m11.449626027s) [noise=true , address=77.90.31.15:4729     , piece_id=NVMXFEILHGT622IIPYYT4FFHC2WZLHMCZM4VT5WUPHRAPH3DX6TA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578846911 (590h53m11.449929946s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579458044 (590h53m11.450541089s) [noise=true , address=45.91.116.11:4150    , piece_id=E66IDHTJDLYLYJIOWMOIKOOWLXCUNCMBIQ7SQBAD3VTJF6VX5JLQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579891209 (590h53m11.450974245s) [noise=true , address=145.79.227.29:4945   , piece_id=SHL73IDEI54GRCWYNWHRUSJZZ4UUXREAX54DFJLTG5QPZCF5QKIQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579915535 (590h53m11.45099858s) [noise=true , address=145.79.227.30:4772   , piece_id=PVMD5DWRRPVARTSZ6O7HN6MUVTZUYWLYSNQR5GDMNKUJZGXMYPFQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580325466 (590h53m11.451408511s) [noise=true , address=77.90.31.12:4603     , piece_id=2I4L7F2WEGK5OSLODJSJ4672URBA7DUGXWZKTYB6ZNA2TQIGVXWA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580379599 (590h53m11.451462644s) [noise=true , address=77.90.31.14:4671     , piece_id=263TRISJ5ADFTX43ULSSGBAF2KMOXAPISJ56LLE53D74XOEMQ5EA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580692044 (590h53m11.451775089s) [noise=true , address=145.79.227.3:4175    , piece_id=UCV5WQNVWEAMEDBWDNXEVSQEGXPJE7KD6YSWC5A4WXYUKUCK4NLA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580857859 (590h53m11.451940894s) [noise=true , address=77.90.31.19:4860     , piece_id=U2MNFOAD7FHCDBE4FUYOROIP3P33ROJ7K75SF5Z747EFKFTF7RGA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581089210 (590h53m11.452172255s) [noise=true , address=145.79.227.44:4203   , piece_id=WHCKQ2FRLYAZE7Q6HYZNTS4EISVHZNAPDDKH34WN33ALK4MVK2EA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581351320 (590h53m11.452434355s) [noise=true , address=64.49.13.154:4928    , piece_id=SEVBZBMNGURP5TRUEBA4PHRSA6MNANVJUKINALJUWPQWBGKVYNTA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581457091 (590h53m11.452540126s) [noise=true , address=145.79.227.34:4909   , piece_id=3QSWTNR5LGUUAY3N5HJKSPL3TRQ6WO5F5OD4VTXKWHWUXUF7PVVQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581863144 (590h53m11.452946179s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.584010443 (590h53m11.455093478s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.585122791 (590h53m11.456205826s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:12.983305402 (590h53m12.854388447s) [upload=517998]: Next returned nil segment
Dec 30 06:22:12.983321313 (590h53m12.854404348s) [upload=517998]: Waiting for error group managing segments...
Dec 30 06:22:13.379703053 (590h53m13.250786088s) [noise=true , address=64.49.13.27:4965     , piece_id=CO4O5F2IBZAAKBZBV3HWNNOXZOGLNNDPALWMQZ3DEM3MREASVFEA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.418055622 (590h53m13.289138657s) [noise=true , address=145.79.227.3:4175    , piece_id=UCV5WQNVWEAMEDBWDNXEVSQEGXPJE7KD6YSWC5A4WXYUKUCK4NLA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.509034160 (590h53m13.380117205s) [noise=true , address=64.49.13.154:4928    , piece_id=SEVBZBMNGURP5TRUEBA4PHRSA6MNANVJUKINALJUWPQWBGKVYNTA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.642886154 (590h53m13.513969199s) [noise=true , address=77.90.31.14:4671     , piece_id=263TRISJ5ADFTX43ULSSGBAF2KMOXAPISJ56LLE53D74XOEMQ5EA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.788145520 (590h53m13.659228555s) [noise=true , address=77.90.31.12:4603     , piece_id=2I4L7F2WEGK5OSLODJSJ4672URBA7DUGXWZKTYB6ZNA2TQIGVXWA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.858878757 (590h53m13.729961792s) [noise=true , address=145.79.227.49:4369   , piece_id=XUEXGNJJIJ4DUBDNUV7CKF6J5JYHSLZAEPVGEDGBUBY42BIP4XEQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.879550569 (590h53m13.750633614s) [noise=true , address=145.79.227.34:4909   , piece_id=3QSWTNR5LGUUAY3N5HJKSPL3TRQ6WO5F5OD4VTXKWHWUXUF7PVVQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.940897723 (590h53m13.811980769s) [noise=true , address=77.90.31.19:4860     , piece_id=U2MNFOAD7FHCDBE4FUYOROIP3P33ROJ7K75SF5Z747EFKFTF7RGA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.989791936 (590h53m13.860874981s) [noise=true , address=45.91.116.11:4150    , piece_id=E66IDHTJDLYLYJIOWMOIKOOWLXCUNCMBIQ7SQBAD3VTJF6VX5JLQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.289516718 (590h53m14.160599753s) [noise=true , address=145.79.227.44:4203   , piece_id=WHCKQ2FRLYAZE7Q6HYZNTS4EISVHZNAPDDKH34WN33ALK4MVK2EA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.338651537 (590h53m14.209734582s) [noise=true , address=77.90.31.15:4729     , piece_id=NVMXFEILHGT622IIPYYT4FFHC2WZLHMCZM4VT5WUPHRAPH3DX6TA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.344145168 (590h53m14.215228213s) [noise=true , address=145.79.227.30:4772   , piece_id=PVMD5DWRRPVARTSZ6O7HN6MUVTZUYWLYSNQR5GDMNKUJZGXMYPFQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.667232847 (590h53m14.538315892s) [noise=true , address=193.149.164.143:4704 , piece_id=4T2IJIA6WHI5LMIUP5BLJLCD3GRY3A6PXR6G5OWJWUSYZT5ELGHQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.671388990 (590h53m14.542472025s) [noise=true , address=145.79.227.29:4945   , piece_id=SHL73IDEI54GRCWYNWHRUSJZZ4UUXREAX54DFJLTG5QPZCF5QKIQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.671415190 (590h53m14.542498226s) [seg_pos={0 0}, upload=517998]: Segment reached optimal threshold of 14 pieces.
Dec 30 06:22:14.671803600 (590h53m14.542886655s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hU1LwL2gX7rVnrNgzaBCYB37ziqf7s7aUgtF2Uc3antReQ6me): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.671814470 (590h53m14.542897525s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672014932 (590h53m14.543097977s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bhN3cR22QuAYihnnB3x3R97UZRWJ8sFPP8fjQcXZ7qhNZphZG): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672022637 (590h53m14.543105672s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672088933 (590h53m14.543171988s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672127677 (590h53m14.543210742s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672312739 (590h53m14.543395774s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSXWFiq27Dd2vBDD9vVnhDHVG59UmDKn3hVAhf3oyo5goVNaE): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672319953 (590h53m14.543402988s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672337847 (590h53m14.543420882s) [seg_pos={0 0}, upload=517998]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 30 06:22:14.672452947 (590h53m14.543535982s) [upload=517998]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:22:14.672458507 (590h53m14.543541542s) [upload=517998]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:22:14.981437069 (590h53m14.852520114s) [upload=517998]: Done uploading segments...
Dec 30 06:22:14.981456546 (590h53m14.852539581s) [upload=517998]: Upload finished. err: <nil>
Duration: 15.300940383s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
5 out of 60 is failed (threshold=6) [.....................X...........X..............XX...X......]
duration: 
4.067813849s
trace: 
https://jaeger.dev.storj.io/trace/5d54da3b342a05d9
FAIL (2025-12-30 06:32:14 UTC) 
orbiter warning: context deadline exceeded
Duration: 4.067833926s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [......................................X.....................]
duration: 
6.362943974s
trace: 
https://jaeger.dev.storj.io/trace/deb96436003dee
FAIL (2025-12-30 06:32:12 UTC) 
orbiter warning: read tcp 188.166.225.170:52458->45.38.24.2:443: read: connection reset by peer
Duration: 6.362973539s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
15 out of 60 is failed (threshold=3) [X..X..X..X..XX.......X..X......X....X...X..X.X.X.....X......]
duration: 
6.130581196s
trace: 
https://jaeger.dev.storj.io/trace/32a160c1d95b9ce1
FAIL (2025-12-30 06:32:08 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, Piece ID: KCDCBQ3JCAYUP26TFIRYKWXRQ5S7Q7JLWHY4XDB3FXU263DMGJRA) context deadline exceeded; piecestore: (Node ID: 1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, Piece ID: FCPRQ6RUSDVTSZIK6QFECZXB3T6FE6SWYH7DNEPICJW7QWFQK3EQ) context deadline exceeded
======LOGS======
Dec 30 06:27:31.479172017 (590h58m31.350255062s) [upload=518086]: Starting upload
Dec 30 06:27:31.479271175 (590h58m31.35035421s) [upload=518086]: Done starting upload
Dec 30 06:27:31.479402385 (590h58m31.35048542s) [upload=518086]: Uploading segments...
Dec 30 06:27:31.480006245 (590h58m31.35108929s) [upload=518086]: Got next segment. Inline: false
Dec 30 06:27:31.480174686 (590h58m31.351257721s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 30 06:27:31.480182702 (590h58m31.351265737s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 30 06:27:31.727629458 (590h58m31.598712493s) [seg_pos={0 0}, upload=518086]: Begin upload segment...
Dec 30 06:27:31.727685714 (590h58m31.598768759s) [seg_pos={0 0}, upload=518086]: Done begin upload segment.
Dec 30 06:27:31.727714169 (590h58m31.598797214s) [noise=true , address=77.90.31.21:4880     , piece_id=KCDCBQ3JCAYUP26TFIRYKWXRQ5S7Q7JLWHY4XDB3FXU263DMGJRA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.727728035 (590h58m31.59881108s) [noise=true , address=145.79.227.17:4972   , piece_id=3Q2WOCLVLN4546C4TTIHVDTEI2A3NXCAKTUD337OUDAN6KSW7AOQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.727802376 (590h58m31.598885421s) [noise=true , address=145.79.227.13:4804   , piece_id=FCZ4CYT6QT3IHOUC6R3H57NOOOMPDM3Z6FQ3TPOH4MR5QNZR7STQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.729155453 (590h58m31.600238488s) [noise=true , address=145.79.227.31:4799   , piece_id=SAIJ2QPHM5AGSRV62E7TD2A4YBETORXUCK5YUK4EZQUKN3TUF64Q, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.729401191 (590h58m31.600484236s) [noise=true , address=145.79.227.22:4509   , piece_id=7U75JX2T56P7KP3CJIOI24XXY3ED4VAEIMQNJSPHKS5W7YF3FXCA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.729850997 (590h58m31.600934032s) [noise=true , address=77.90.31.17:4773     , piece_id=NGPVC3N4UPXTO42JJIHGCQMMZU4MS3C36A3KZIYSGOF6B3PX4EJQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.730681368 (590h58m31.601764404s) [noise=true , address=145.79.227.45:4230   , piece_id=G64X3YOMTVLAIWQY5RIFY6K5EHDSUIZWCN2RDWK6LRVN3XUZBLKA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.731315676 (590h58m31.602398721s) [noise=true , address=145.79.227.27:4689   , piece_id=C2RDOQOUDRFIHSAPQIJNYFHZJFQUQWPLOKJUWLPNFMKCBA5H4XLA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.732192586 (590h58m31.603275631s) [noise=true , address=77.90.31.12:4590     , piece_id=FCPRQ6RUSDVTSZIK6QFECZXB3T6FE6SWYH7DNEPICJW7QWFQK3EQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.732619839 (590h58m31.603702884s) [noise=true , address=45.91.116.5:4298     , piece_id=XSQHRQH6UQGLUDFGDHXPNVJSTTRBSBDIEELEH4JC5GEEQ2M4KQ5A, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.733515114 (590h58m31.604598159s) [noise=true , address=77.90.31.13:4626     , piece_id=FWF4DQ4MPPWF2SKBBZLNGV7KWQ23BEA7UIS6FHDKINPB6YRAZARQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.734041075 (590h58m31.60512412s) [noise=true , address=145.79.227.20:4438   , piece_id=A623O6EK2ZQB6P37KJG6L7JYZICD5UY6JOYVKZ2BN2SMBUOMGMEA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.734770875 (590h58m31.60585392s) [noise=true , address=145.79.227.15:4873   , piece_id=33B56NW26Q23FA3A4AZ74ZZJYAAZ5M4ZSBDX5JE3M2BX4RVUI2YQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.735257321 (590h58m31.606340366s) [noise=true , address=145.79.227.52:4445   , piece_id=Z4HTRQZLIIBDE34RDPNDZR5BGASGJRJI4Q6DCEW4T3CHMI2PREBA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.736066582 (590h58m31.607149617s) [noise=true , address=145.79.227.7:4293    , piece_id=2WGGEODE53DFZXSKPINQLR7G6AMBEH7C3IEHX44WCRHWOTXWQT5A, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.737627635 (590h58m31.60871067s) [noise=true , address=145.79.227.49:4339   , piece_id=2FQP72I6EC5DPC5B6B6NFRMPQT7QYWVZFOZFWZFQFMVRFO4GCT2A, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:33.442981428 (590h58m33.314064473s) [upload=518086]: Next returned nil segment
Dec 30 06:27:33.443000564 (590h58m33.3140836s) [upload=518086]: Waiting for error group managing segments...
Dec 30 06:27:33.726010138 (590h58m33.597093173s) [noise=true , address=145.79.227.27:4689   , piece_id=C2RDOQOUDRFIHSAPQIJNYFHZJFQUQWPLOKJUWLPNFMKCBA5H4XLA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.726365194 (590h58m33.597448229s) [noise=true , address=145.79.227.45:4230   , piece_id=G64X3YOMTVLAIWQY5RIFY6K5EHDSUIZWCN2RDWK6LRVN3XUZBLKA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.731331761 (590h58m33.602414806s) [noise=true , address=145.79.227.52:4445   , piece_id=Z4HTRQZLIIBDE34RDPNDZR5BGASGJRJI4Q6DCEW4T3CHMI2PREBA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.732488724 (590h58m33.603571759s) [noise=true , address=145.79.227.13:4804   , piece_id=FCZ4CYT6QT3IHOUC6R3H57NOOOMPDM3Z6FQ3TPOH4MR5QNZR7STQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.742934164 (590h58m33.614017199s) [noise=true , address=145.79.227.15:4873   , piece_id=33B56NW26Q23FA3A4AZ74ZZJYAAZ5M4ZSBDX5JE3M2BX4RVUI2YQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.746966712 (590h58m33.618049747s) [noise=true , address=145.79.227.31:4799   , piece_id=SAIJ2QPHM5AGSRV62E7TD2A4YBETORXUCK5YUK4EZQUKN3TUF64Q, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.781208554 (590h58m33.652291599s) [noise=true , address=145.79.227.7:4293    , piece_id=2WGGEODE53DFZXSKPINQLR7G6AMBEH7C3IEHX44WCRHWOTXWQT5A, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.807290017 (590h58m33.678373052s) [noise=true , address=145.79.227.20:4438   , piece_id=A623O6EK2ZQB6P37KJG6L7JYZICD5UY6JOYVKZ2BN2SMBUOMGMEA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.809530753 (590h58m33.680613798s) [noise=true , address=145.79.227.22:4509   , piece_id=7U75JX2T56P7KP3CJIOI24XXY3ED4VAEIMQNJSPHKS5W7YF3FXCA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.812826569 (590h58m33.683909604s) [noise=true , address=145.79.227.17:4972   , piece_id=3Q2WOCLVLN4546C4TTIHVDTEI2A3NXCAKTUD337OUDAN6KSW7AOQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.900372450 (590h58m33.771455495s) [noise=true , address=77.90.31.13:4626     , piece_id=FWF4DQ4MPPWF2SKBBZLNGV7KWQ23BEA7UIS6FHDKINPB6YRAZARQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.916464471 (590h58m33.787547506s) [noise=true , address=77.90.31.21:4880     , piece_id=KCDCBQ3JCAYUP26TFIRYKWXRQ5S7Q7JLWHY4XDB3FXU263DMGJRA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:34.018888070 (590h58m33.889971115s) [noise=true , address=77.90.31.12:4590     , piece_id=FCPRQ6RUSDVTSZIK6QFECZXB3T6FE6SWYH7DNEPICJW7QWFQK3EQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:34.018913669 (590h58m33.889996714s) [seg_pos={0 0}, upload=518086]: Segment reached optimal threshold of 13 pieces.
Dec 30 06:27:34.019155831 (590h58m33.890238876s) [noise=true , address=77.90.31.17:4773     , piece_id=NGPVC3N4UPXTO42JJIHGCQMMZU4MS3C36A3KZIYSGOF6B3PX4EJQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ): protocol: expected piece hash; context canceled; EOF
Dec 30 06:27:34.019166861 (590h58m33.890249906s) [noise=true , address=77.90.31.17:4773     , piece_id=NGPVC3N4UPXTO42JJIHGCQMMZU4MS3C36A3KZIYSGOF6B3PX4EJQ, seg_pos={0 0}, upload=518086]: Long tail cancellation due to optimal threshold
Dec 30 06:27:34.019372272 (590h58m33.890455318s) [noise=true , address=45.91.116.5:4298     , piece_id=XSQHRQH6UQGLUDFGDHXPNVJSTTRBSBDIEELEH4JC5GEEQ2M4KQ5A, seg_pos={0 0}, upload=518086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Dec 30 06:27:34.019400827 (590h58m33.890483862s) [noise=true , address=45.91.116.5:4298     , piece_id=XSQHRQH6UQGLUDFGDHXPNVJSTTRBSBDIEELEH4JC5GEEQ2M4KQ5A, seg_pos={0 0}, upload=518086]: Long tail cancellation due to optimal threshold
Dec 30 06:27:34.019477783 (590h58m33.890560838s) [noise=true , address=145.79.227.49:4339   , piece_id=2FQP72I6EC5DPC5B6B6NFRMPQT7QYWVZFOZFWZFQFMVRFO4GCT2A, seg_pos={0 0}, upload=518086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF
Dec 30 06:27:34.019487012 (590h58m33.890570057s) [noise=true , address=145.79.227.49:4339   , piece_id=2FQP72I6EC5DPC5B6B6NFRMPQT7QYWVZFOZFWZFQFMVRFO4GCT2A, seg_pos={0 0}, upload=518086]: Long tail cancellation due to optimal threshold
Dec 30 06:27:34.019511157 (590h58m33.890594192s) [seg_pos={0 0}, upload=518086]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 30 06:27:34.019579547 (590h58m33.890662582s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:27:34.019584216 (590h58m33.890667251s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:27:34.313480950 (590h58m34.184563985s) [upload=518086]: Done uploading segments...
Dec 30 06:27:34.313532458 (590h58m34.184615493s) [upload=518086]: Upload finished. err: <nil>
Duration: 6.130609861s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [.......................X...X......X............X............]
duration: 
50.314584234s
trace: 
https://jaeger.dev.storj.io/trace/45b769fc71e13448
FAIL (2025-12-30 06:31:53 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
.577697683 (590h53m11.448780728s) [noise=true , address=193.149.164.143:4704 , piece_id=4T2IJIA6WHI5LMIUP5BLJLCD3GRY3A6PXR6G5OWJWUSYZT5ELGHQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578173528 (590h53m11.449256573s) [noise=true , address=64.49.13.27:4965     , piece_id=CO4O5F2IBZAAKBZBV3HWNNOXZOGLNNDPALWMQZ3DEM3MREASVFEA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578542992 (590h53m11.449626027s) [noise=true , address=77.90.31.15:4729     , piece_id=NVMXFEILHGT622IIPYYT4FFHC2WZLHMCZM4VT5WUPHRAPH3DX6TA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578846911 (590h53m11.449929946s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579458044 (590h53m11.450541089s) [noise=true , address=45.91.116.11:4150    , piece_id=E66IDHTJDLYLYJIOWMOIKOOWLXCUNCMBIQ7SQBAD3VTJF6VX5JLQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579891209 (590h53m11.450974245s) [noise=true , address=145.79.227.29:4945   , piece_id=SHL73IDEI54GRCWYNWHRUSJZZ4UUXREAX54DFJLTG5QPZCF5QKIQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579915535 (590h53m11.45099858s) [noise=true , address=145.79.227.30:4772   , piece_id=PVMD5DWRRPVARTSZ6O7HN6MUVTZUYWLYSNQR5GDMNKUJZGXMYPFQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580325466 (590h53m11.451408511s) [noise=true , address=77.90.31.12:4603     , piece_id=2I4L7F2WEGK5OSLODJSJ4672URBA7DUGXWZKTYB6ZNA2TQIGVXWA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580379599 (590h53m11.451462644s) [noise=true , address=77.90.31.14:4671     , piece_id=263TRISJ5ADFTX43ULSSGBAF2KMOXAPISJ56LLE53D74XOEMQ5EA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580692044 (590h53m11.451775089s) [noise=true , address=145.79.227.3:4175    , piece_id=UCV5WQNVWEAMEDBWDNXEVSQEGXPJE7KD6YSWC5A4WXYUKUCK4NLA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580857859 (590h53m11.451940894s) [noise=true , address=77.90.31.19:4860     , piece_id=U2MNFOAD7FHCDBE4FUYOROIP3P33ROJ7K75SF5Z747EFKFTF7RGA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581089210 (590h53m11.452172255s) [noise=true , address=145.79.227.44:4203   , piece_id=WHCKQ2FRLYAZE7Q6HYZNTS4EISVHZNAPDDKH34WN33ALK4MVK2EA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581351320 (590h53m11.452434355s) [noise=true , address=64.49.13.154:4928    , piece_id=SEVBZBMNGURP5TRUEBA4PHRSA6MNANVJUKINALJUWPQWBGKVYNTA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581457091 (590h53m11.452540126s) [noise=true , address=145.79.227.34:4909   , piece_id=3QSWTNR5LGUUAY3N5HJKSPL3TRQ6WO5F5OD4VTXKWHWUXUF7PVVQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581863144 (590h53m11.452946179s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.584010443 (590h53m11.455093478s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.585122791 (590h53m11.456205826s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:12.983305402 (590h53m12.854388447s) [upload=517998]: Next returned nil segment
Dec 30 06:22:12.983321313 (590h53m12.854404348s) [upload=517998]: Waiting for error group managing segments...
Dec 30 06:22:13.379703053 (590h53m13.250786088s) [noise=true , address=64.49.13.27:4965     , piece_id=CO4O5F2IBZAAKBZBV3HWNNOXZOGLNNDPALWMQZ3DEM3MREASVFEA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.418055622 (590h53m13.289138657s) [noise=true , address=145.79.227.3:4175    , piece_id=UCV5WQNVWEAMEDBWDNXEVSQEGXPJE7KD6YSWC5A4WXYUKUCK4NLA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.509034160 (590h53m13.380117205s) [noise=true , address=64.49.13.154:4928    , piece_id=SEVBZBMNGURP5TRUEBA4PHRSA6MNANVJUKINALJUWPQWBGKVYNTA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.642886154 (590h53m13.513969199s) [noise=true , address=77.90.31.14:4671     , piece_id=263TRISJ5ADFTX43ULSSGBAF2KMOXAPISJ56LLE53D74XOEMQ5EA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.788145520 (590h53m13.659228555s) [noise=true , address=77.90.31.12:4603     , piece_id=2I4L7F2WEGK5OSLODJSJ4672URBA7DUGXWZKTYB6ZNA2TQIGVXWA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.858878757 (590h53m13.729961792s) [noise=true , address=145.79.227.49:4369   , piece_id=XUEXGNJJIJ4DUBDNUV7CKF6J5JYHSLZAEPVGEDGBUBY42BIP4XEQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.879550569 (590h53m13.750633614s) [noise=true , address=145.79.227.34:4909   , piece_id=3QSWTNR5LGUUAY3N5HJKSPL3TRQ6WO5F5OD4VTXKWHWUXUF7PVVQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.940897723 (590h53m13.811980769s) [noise=true , address=77.90.31.19:4860     , piece_id=U2MNFOAD7FHCDBE4FUYOROIP3P33ROJ7K75SF5Z747EFKFTF7RGA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.989791936 (590h53m13.860874981s) [noise=true , address=45.91.116.11:4150    , piece_id=E66IDHTJDLYLYJIOWMOIKOOWLXCUNCMBIQ7SQBAD3VTJF6VX5JLQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.289516718 (590h53m14.160599753s) [noise=true , address=145.79.227.44:4203   , piece_id=WHCKQ2FRLYAZE7Q6HYZNTS4EISVHZNAPDDKH34WN33ALK4MVK2EA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.338651537 (590h53m14.209734582s) [noise=true , address=77.90.31.15:4729     , piece_id=NVMXFEILHGT622IIPYYT4FFHC2WZLHMCZM4VT5WUPHRAPH3DX6TA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.344145168 (590h53m14.215228213s) [noise=true , address=145.79.227.30:4772   , piece_id=PVMD5DWRRPVARTSZ6O7HN6MUVTZUYWLYSNQR5GDMNKUJZGXMYPFQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.667232847 (590h53m14.538315892s) [noise=true , address=193.149.164.143:4704 , piece_id=4T2IJIA6WHI5LMIUP5BLJLCD3GRY3A6PXR6G5OWJWUSYZT5ELGHQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.671388990 (590h53m14.542472025s) [noise=true , address=145.79.227.29:4945   , piece_id=SHL73IDEI54GRCWYNWHRUSJZZ4UUXREAX54DFJLTG5QPZCF5QKIQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.671415190 (590h53m14.542498226s) [seg_pos={0 0}, upload=517998]: Segment reached optimal threshold of 14 pieces.
Dec 30 06:22:14.671803600 (590h53m14.542886655s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hU1LwL2gX7rVnrNgzaBCYB37ziqf7s7aUgtF2Uc3antReQ6me): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.671814470 (590h53m14.542897525s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672014932 (590h53m14.543097977s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bhN3cR22QuAYihnnB3x3R97UZRWJ8sFPP8fjQcXZ7qhNZphZG): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672022637 (590h53m14.543105672s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672088933 (590h53m14.543171988s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672127677 (590h53m14.543210742s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672312739 (590h53m14.543395774s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSXWFiq27Dd2vBDD9vVnhDHVG59UmDKn3hVAhf3oyo5goVNaE): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672319953 (590h53m14.543402988s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672337847 (590h53m14.543420882s) [seg_pos={0 0}, upload=517998]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 30 06:22:14.672452947 (590h53m14.543535982s) [upload=517998]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:22:14.672458507 (590h53m14.543541542s) [upload=517998]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:22:14.981437069 (590h53m14.852520114s) [upload=517998]: Done uploading segments...
Dec 30 06:22:14.981456546 (590h53m14.852539581s) [upload=517998]: Upload finished. err: <nil>
Duration: 50.314615093s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.......................................X....................]
duration: 
15.502213659s
trace: 
https://jaeger.dev.storj.io/trace/deb96436003dee
FAIL (2025-12-30 06:31:46 UTC) 
orbiter warning: read tcp 188.166.225.170:52458->45.38.24.2:443: read: connection reset by peer
Duration: 15.502239238s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
15 out of 60 is failed (threshold=3) [.X..X..X..X..XX.......X..X......X....X...X..X.X.X.....X.....]
duration: 
6.05120195s
trace: 
https://jaeger.dev.storj.io/trace/32a160c1d95b9ce1
FAIL (2025-12-30 06:31:40 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, Piece ID: KCDCBQ3JCAYUP26TFIRYKWXRQ5S7Q7JLWHY4XDB3FXU263DMGJRA) context deadline exceeded; piecestore: (Node ID: 1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, Piece ID: FCPRQ6RUSDVTSZIK6QFECZXB3T6FE6SWYH7DNEPICJW7QWFQK3EQ) context deadline exceeded
======LOGS======
Dec 30 06:27:31.479172017 (590h58m31.350255062s) [upload=518086]: Starting upload
Dec 30 06:27:31.479271175 (590h58m31.35035421s) [upload=518086]: Done starting upload
Dec 30 06:27:31.479402385 (590h58m31.35048542s) [upload=518086]: Uploading segments...
Dec 30 06:27:31.480006245 (590h58m31.35108929s) [upload=518086]: Got next segment. Inline: false
Dec 30 06:27:31.480174686 (590h58m31.351257721s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 30 06:27:31.480182702 (590h58m31.351265737s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 30 06:27:31.727629458 (590h58m31.598712493s) [seg_pos={0 0}, upload=518086]: Begin upload segment...
Dec 30 06:27:31.727685714 (590h58m31.598768759s) [seg_pos={0 0}, upload=518086]: Done begin upload segment.
Dec 30 06:27:31.727714169 (590h58m31.598797214s) [noise=true , address=77.90.31.21:4880     , piece_id=KCDCBQ3JCAYUP26TFIRYKWXRQ5S7Q7JLWHY4XDB3FXU263DMGJRA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.727728035 (590h58m31.59881108s) [noise=true , address=145.79.227.17:4972   , piece_id=3Q2WOCLVLN4546C4TTIHVDTEI2A3NXCAKTUD337OUDAN6KSW7AOQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.727802376 (590h58m31.598885421s) [noise=true , address=145.79.227.13:4804   , piece_id=FCZ4CYT6QT3IHOUC6R3H57NOOOMPDM3Z6FQ3TPOH4MR5QNZR7STQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.729155453 (590h58m31.600238488s) [noise=true , address=145.79.227.31:4799   , piece_id=SAIJ2QPHM5AGSRV62E7TD2A4YBETORXUCK5YUK4EZQUKN3TUF64Q, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.729401191 (590h58m31.600484236s) [noise=true , address=145.79.227.22:4509   , piece_id=7U75JX2T56P7KP3CJIOI24XXY3ED4VAEIMQNJSPHKS5W7YF3FXCA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.729850997 (590h58m31.600934032s) [noise=true , address=77.90.31.17:4773     , piece_id=NGPVC3N4UPXTO42JJIHGCQMMZU4MS3C36A3KZIYSGOF6B3PX4EJQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.730681368 (590h58m31.601764404s) [noise=true , address=145.79.227.45:4230   , piece_id=G64X3YOMTVLAIWQY5RIFY6K5EHDSUIZWCN2RDWK6LRVN3XUZBLKA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.731315676 (590h58m31.602398721s) [noise=true , address=145.79.227.27:4689   , piece_id=C2RDOQOUDRFIHSAPQIJNYFHZJFQUQWPLOKJUWLPNFMKCBA5H4XLA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.732192586 (590h58m31.603275631s) [noise=true , address=77.90.31.12:4590     , piece_id=FCPRQ6RUSDVTSZIK6QFECZXB3T6FE6SWYH7DNEPICJW7QWFQK3EQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.732619839 (590h58m31.603702884s) [noise=true , address=45.91.116.5:4298     , piece_id=XSQHRQH6UQGLUDFGDHXPNVJSTTRBSBDIEELEH4JC5GEEQ2M4KQ5A, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.733515114 (590h58m31.604598159s) [noise=true , address=77.90.31.13:4626     , piece_id=FWF4DQ4MPPWF2SKBBZLNGV7KWQ23BEA7UIS6FHDKINPB6YRAZARQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.734041075 (590h58m31.60512412s) [noise=true , address=145.79.227.20:4438   , piece_id=A623O6EK2ZQB6P37KJG6L7JYZICD5UY6JOYVKZ2BN2SMBUOMGMEA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.734770875 (590h58m31.60585392s) [noise=true , address=145.79.227.15:4873   , piece_id=33B56NW26Q23FA3A4AZ74ZZJYAAZ5M4ZSBDX5JE3M2BX4RVUI2YQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.735257321 (590h58m31.606340366s) [noise=true , address=145.79.227.52:4445   , piece_id=Z4HTRQZLIIBDE34RDPNDZR5BGASGJRJI4Q6DCEW4T3CHMI2PREBA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.736066582 (590h58m31.607149617s) [noise=true , address=145.79.227.7:4293    , piece_id=2WGGEODE53DFZXSKPINQLR7G6AMBEH7C3IEHX44WCRHWOTXWQT5A, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.737627635 (590h58m31.60871067s) [noise=true , address=145.79.227.49:4339   , piece_id=2FQP72I6EC5DPC5B6B6NFRMPQT7QYWVZFOZFWZFQFMVRFO4GCT2A, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:33.442981428 (590h58m33.314064473s) [upload=518086]: Next returned nil segment
Dec 30 06:27:33.443000564 (590h58m33.3140836s) [upload=518086]: Waiting for error group managing segments...
Dec 30 06:27:33.726010138 (590h58m33.597093173s) [noise=true , address=145.79.227.27:4689   , piece_id=C2RDOQOUDRFIHSAPQIJNYFHZJFQUQWPLOKJUWLPNFMKCBA5H4XLA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.726365194 (590h58m33.597448229s) [noise=true , address=145.79.227.45:4230   , piece_id=G64X3YOMTVLAIWQY5RIFY6K5EHDSUIZWCN2RDWK6LRVN3XUZBLKA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.731331761 (590h58m33.602414806s) [noise=true , address=145.79.227.52:4445   , piece_id=Z4HTRQZLIIBDE34RDPNDZR5BGASGJRJI4Q6DCEW4T3CHMI2PREBA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.732488724 (590h58m33.603571759s) [noise=true , address=145.79.227.13:4804   , piece_id=FCZ4CYT6QT3IHOUC6R3H57NOOOMPDM3Z6FQ3TPOH4MR5QNZR7STQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.742934164 (590h58m33.614017199s) [noise=true , address=145.79.227.15:4873   , piece_id=33B56NW26Q23FA3A4AZ74ZZJYAAZ5M4ZSBDX5JE3M2BX4RVUI2YQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.746966712 (590h58m33.618049747s) [noise=true , address=145.79.227.31:4799   , piece_id=SAIJ2QPHM5AGSRV62E7TD2A4YBETORXUCK5YUK4EZQUKN3TUF64Q, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.781208554 (590h58m33.652291599s) [noise=true , address=145.79.227.7:4293    , piece_id=2WGGEODE53DFZXSKPINQLR7G6AMBEH7C3IEHX44WCRHWOTXWQT5A, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.807290017 (590h58m33.678373052s) [noise=true , address=145.79.227.20:4438   , piece_id=A623O6EK2ZQB6P37KJG6L7JYZICD5UY6JOYVKZ2BN2SMBUOMGMEA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.809530753 (590h58m33.680613798s) [noise=true , address=145.79.227.22:4509   , piece_id=7U75JX2T56P7KP3CJIOI24XXY3ED4VAEIMQNJSPHKS5W7YF3FXCA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.812826569 (590h58m33.683909604s) [noise=true , address=145.79.227.17:4972   , piece_id=3Q2WOCLVLN4546C4TTIHVDTEI2A3NXCAKTUD337OUDAN6KSW7AOQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.900372450 (590h58m33.771455495s) [noise=true , address=77.90.31.13:4626     , piece_id=FWF4DQ4MPPWF2SKBBZLNGV7KWQ23BEA7UIS6FHDKINPB6YRAZARQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.916464471 (590h58m33.787547506s) [noise=true , address=77.90.31.21:4880     , piece_id=KCDCBQ3JCAYUP26TFIRYKWXRQ5S7Q7JLWHY4XDB3FXU263DMGJRA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:34.018888070 (590h58m33.889971115s) [noise=true , address=77.90.31.12:4590     , piece_id=FCPRQ6RUSDVTSZIK6QFECZXB3T6FE6SWYH7DNEPICJW7QWFQK3EQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:34.018913669 (590h58m33.889996714s) [seg_pos={0 0}, upload=518086]: Segment reached optimal threshold of 13 pieces.
Dec 30 06:27:34.019155831 (590h58m33.890238876s) [noise=true , address=77.90.31.17:4773     , piece_id=NGPVC3N4UPXTO42JJIHGCQMMZU4MS3C36A3KZIYSGOF6B3PX4EJQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ): protocol: expected piece hash; context canceled; EOF
Dec 30 06:27:34.019166861 (590h58m33.890249906s) [noise=true , address=77.90.31.17:4773     , piece_id=NGPVC3N4UPXTO42JJIHGCQMMZU4MS3C36A3KZIYSGOF6B3PX4EJQ, seg_pos={0 0}, upload=518086]: Long tail cancellation due to optimal threshold
Dec 30 06:27:34.019372272 (590h58m33.890455318s) [noise=true , address=45.91.116.5:4298     , piece_id=XSQHRQH6UQGLUDFGDHXPNVJSTTRBSBDIEELEH4JC5GEEQ2M4KQ5A, seg_pos={0 0}, upload=518086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Dec 30 06:27:34.019400827 (590h58m33.890483862s) [noise=true , address=45.91.116.5:4298     , piece_id=XSQHRQH6UQGLUDFGDHXPNVJSTTRBSBDIEELEH4JC5GEEQ2M4KQ5A, seg_pos={0 0}, upload=518086]: Long tail cancellation due to optimal threshold
Dec 30 06:27:34.019477783 (590h58m33.890560838s) [noise=true , address=145.79.227.49:4339   , piece_id=2FQP72I6EC5DPC5B6B6NFRMPQT7QYWVZFOZFWZFQFMVRFO4GCT2A, seg_pos={0 0}, upload=518086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF
Dec 30 06:27:34.019487012 (590h58m33.890570057s) [noise=true , address=145.79.227.49:4339   , piece_id=2FQP72I6EC5DPC5B6B6NFRMPQT7QYWVZFOZFWZFQFMVRFO4GCT2A, seg_pos={0 0}, upload=518086]: Long tail cancellation due to optimal threshold
Dec 30 06:27:34.019511157 (590h58m33.890594192s) [seg_pos={0 0}, upload=518086]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 30 06:27:34.019579547 (590h58m33.890662582s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:27:34.019584216 (590h58m33.890667251s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:27:34.313480950 (590h58m34.184563985s) [upload=518086]: Done uploading segments...
Dec 30 06:27:34.313532458 (590h58m34.184615493s) [upload=518086]: Upload finished. err: <nil>
Duration: 6.051230884s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
5 out of 60 is failed (threshold=6) [......................X...........X..............XX...X.....]
duration: 
3.821111667s
trace: 
https://jaeger.dev.storj.io/trace/5d54da3b342a05d9
FAIL (2025-12-30 06:31:12 UTC) 
orbiter warning: context deadline exceeded
Duration: 3.821226545s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [........................X...X......X............X...........]
duration: 
39.337633301s
trace: 
https://jaeger.dev.storj.io/trace/45b769fc71e13448
FAIL (2025-12-30 06:31:01 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
.577697683 (590h53m11.448780728s) [noise=true , address=193.149.164.143:4704 , piece_id=4T2IJIA6WHI5LMIUP5BLJLCD3GRY3A6PXR6G5OWJWUSYZT5ELGHQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578173528 (590h53m11.449256573s) [noise=true , address=64.49.13.27:4965     , piece_id=CO4O5F2IBZAAKBZBV3HWNNOXZOGLNNDPALWMQZ3DEM3MREASVFEA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578542992 (590h53m11.449626027s) [noise=true , address=77.90.31.15:4729     , piece_id=NVMXFEILHGT622IIPYYT4FFHC2WZLHMCZM4VT5WUPHRAPH3DX6TA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578846911 (590h53m11.449929946s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579458044 (590h53m11.450541089s) [noise=true , address=45.91.116.11:4150    , piece_id=E66IDHTJDLYLYJIOWMOIKOOWLXCUNCMBIQ7SQBAD3VTJF6VX5JLQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579891209 (590h53m11.450974245s) [noise=true , address=145.79.227.29:4945   , piece_id=SHL73IDEI54GRCWYNWHRUSJZZ4UUXREAX54DFJLTG5QPZCF5QKIQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579915535 (590h53m11.45099858s) [noise=true , address=145.79.227.30:4772   , piece_id=PVMD5DWRRPVARTSZ6O7HN6MUVTZUYWLYSNQR5GDMNKUJZGXMYPFQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580325466 (590h53m11.451408511s) [noise=true , address=77.90.31.12:4603     , piece_id=2I4L7F2WEGK5OSLODJSJ4672URBA7DUGXWZKTYB6ZNA2TQIGVXWA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580379599 (590h53m11.451462644s) [noise=true , address=77.90.31.14:4671     , piece_id=263TRISJ5ADFTX43ULSSGBAF2KMOXAPISJ56LLE53D74XOEMQ5EA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580692044 (590h53m11.451775089s) [noise=true , address=145.79.227.3:4175    , piece_id=UCV5WQNVWEAMEDBWDNXEVSQEGXPJE7KD6YSWC5A4WXYUKUCK4NLA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580857859 (590h53m11.451940894s) [noise=true , address=77.90.31.19:4860     , piece_id=U2MNFOAD7FHCDBE4FUYOROIP3P33ROJ7K75SF5Z747EFKFTF7RGA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581089210 (590h53m11.452172255s) [noise=true , address=145.79.227.44:4203   , piece_id=WHCKQ2FRLYAZE7Q6HYZNTS4EISVHZNAPDDKH34WN33ALK4MVK2EA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581351320 (590h53m11.452434355s) [noise=true , address=64.49.13.154:4928    , piece_id=SEVBZBMNGURP5TRUEBA4PHRSA6MNANVJUKINALJUWPQWBGKVYNTA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581457091 (590h53m11.452540126s) [noise=true , address=145.79.227.34:4909   , piece_id=3QSWTNR5LGUUAY3N5HJKSPL3TRQ6WO5F5OD4VTXKWHWUXUF7PVVQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581863144 (590h53m11.452946179s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.584010443 (590h53m11.455093478s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.585122791 (590h53m11.456205826s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:12.983305402 (590h53m12.854388447s) [upload=517998]: Next returned nil segment
Dec 30 06:22:12.983321313 (590h53m12.854404348s) [upload=517998]: Waiting for error group managing segments...
Dec 30 06:22:13.379703053 (590h53m13.250786088s) [noise=true , address=64.49.13.27:4965     , piece_id=CO4O5F2IBZAAKBZBV3HWNNOXZOGLNNDPALWMQZ3DEM3MREASVFEA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.418055622 (590h53m13.289138657s) [noise=true , address=145.79.227.3:4175    , piece_id=UCV5WQNVWEAMEDBWDNXEVSQEGXPJE7KD6YSWC5A4WXYUKUCK4NLA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.509034160 (590h53m13.380117205s) [noise=true , address=64.49.13.154:4928    , piece_id=SEVBZBMNGURP5TRUEBA4PHRSA6MNANVJUKINALJUWPQWBGKVYNTA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.642886154 (590h53m13.513969199s) [noise=true , address=77.90.31.14:4671     , piece_id=263TRISJ5ADFTX43ULSSGBAF2KMOXAPISJ56LLE53D74XOEMQ5EA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.788145520 (590h53m13.659228555s) [noise=true , address=77.90.31.12:4603     , piece_id=2I4L7F2WEGK5OSLODJSJ4672URBA7DUGXWZKTYB6ZNA2TQIGVXWA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.858878757 (590h53m13.729961792s) [noise=true , address=145.79.227.49:4369   , piece_id=XUEXGNJJIJ4DUBDNUV7CKF6J5JYHSLZAEPVGEDGBUBY42BIP4XEQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.879550569 (590h53m13.750633614s) [noise=true , address=145.79.227.34:4909   , piece_id=3QSWTNR5LGUUAY3N5HJKSPL3TRQ6WO5F5OD4VTXKWHWUXUF7PVVQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.940897723 (590h53m13.811980769s) [noise=true , address=77.90.31.19:4860     , piece_id=U2MNFOAD7FHCDBE4FUYOROIP3P33ROJ7K75SF5Z747EFKFTF7RGA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.989791936 (590h53m13.860874981s) [noise=true , address=45.91.116.11:4150    , piece_id=E66IDHTJDLYLYJIOWMOIKOOWLXCUNCMBIQ7SQBAD3VTJF6VX5JLQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.289516718 (590h53m14.160599753s) [noise=true , address=145.79.227.44:4203   , piece_id=WHCKQ2FRLYAZE7Q6HYZNTS4EISVHZNAPDDKH34WN33ALK4MVK2EA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.338651537 (590h53m14.209734582s) [noise=true , address=77.90.31.15:4729     , piece_id=NVMXFEILHGT622IIPYYT4FFHC2WZLHMCZM4VT5WUPHRAPH3DX6TA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.344145168 (590h53m14.215228213s) [noise=true , address=145.79.227.30:4772   , piece_id=PVMD5DWRRPVARTSZ6O7HN6MUVTZUYWLYSNQR5GDMNKUJZGXMYPFQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.667232847 (590h53m14.538315892s) [noise=true , address=193.149.164.143:4704 , piece_id=4T2IJIA6WHI5LMIUP5BLJLCD3GRY3A6PXR6G5OWJWUSYZT5ELGHQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.671388990 (590h53m14.542472025s) [noise=true , address=145.79.227.29:4945   , piece_id=SHL73IDEI54GRCWYNWHRUSJZZ4UUXREAX54DFJLTG5QPZCF5QKIQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.671415190 (590h53m14.542498226s) [seg_pos={0 0}, upload=517998]: Segment reached optimal threshold of 14 pieces.
Dec 30 06:22:14.671803600 (590h53m14.542886655s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hU1LwL2gX7rVnrNgzaBCYB37ziqf7s7aUgtF2Uc3antReQ6me): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.671814470 (590h53m14.542897525s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672014932 (590h53m14.543097977s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bhN3cR22QuAYihnnB3x3R97UZRWJ8sFPP8fjQcXZ7qhNZphZG): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672022637 (590h53m14.543105672s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672088933 (590h53m14.543171988s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672127677 (590h53m14.543210742s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672312739 (590h53m14.543395774s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSXWFiq27Dd2vBDD9vVnhDHVG59UmDKn3hVAhf3oyo5goVNaE): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672319953 (590h53m14.543402988s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672337847 (590h53m14.543420882s) [seg_pos={0 0}, upload=517998]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 30 06:22:14.672452947 (590h53m14.543535982s) [upload=517998]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:22:14.672458507 (590h53m14.543541542s) [upload=517998]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:22:14.981437069 (590h53m14.852520114s) [upload=517998]: Done uploading segments...
Dec 30 06:22:14.981456546 (590h53m14.852539581s) [upload=517998]: Upload finished. err: <nil>
Duration: 39.337665682s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
5 out of 60 is failed (threshold=6) [.......................X...........X..............XX...X....]
duration: 
3.583123491s
trace: 
https://jaeger.dev.storj.io/trace/5d54da3b342a05d9
FAIL (2025-12-30 06:30:56 UTC) 
orbiter warning: context deadline exceeded
Duration: 3.583150862s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [........................................X...................]
duration: 
15.174898823s
trace: 
https://jaeger.dev.storj.io/trace/deb96436003dee
FAIL (2025-12-30 06:30:49 UTC) 
orbiter warning: read tcp 188.166.225.170:52458->45.38.24.2:443: read: connection reset by peer
Duration: 15.174937106s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
16 out of 60 is failed (threshold=3) [X.X..X..X..X..XX.......X..X......X....X...X..X.X.X.....X....]
duration: 
5.763326359s
trace: 
https://jaeger.dev.storj.io/trace/32a160c1d95b9ce1
FAIL (2025-12-30 06:30:28 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, Piece ID: KCDCBQ3JCAYUP26TFIRYKWXRQ5S7Q7JLWHY4XDB3FXU263DMGJRA) context deadline exceeded; piecestore: (Node ID: 1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, Piece ID: FCPRQ6RUSDVTSZIK6QFECZXB3T6FE6SWYH7DNEPICJW7QWFQK3EQ) context deadline exceeded
======LOGS======
Dec 30 06:27:31.479172017 (590h58m31.350255062s) [upload=518086]: Starting upload
Dec 30 06:27:31.479271175 (590h58m31.35035421s) [upload=518086]: Done starting upload
Dec 30 06:27:31.479402385 (590h58m31.35048542s) [upload=518086]: Uploading segments...
Dec 30 06:27:31.480006245 (590h58m31.35108929s) [upload=518086]: Got next segment. Inline: false
Dec 30 06:27:31.480174686 (590h58m31.351257721s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 30 06:27:31.480182702 (590h58m31.351265737s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 30 06:27:31.727629458 (590h58m31.598712493s) [seg_pos={0 0}, upload=518086]: Begin upload segment...
Dec 30 06:27:31.727685714 (590h58m31.598768759s) [seg_pos={0 0}, upload=518086]: Done begin upload segment.
Dec 30 06:27:31.727714169 (590h58m31.598797214s) [noise=true , address=77.90.31.21:4880     , piece_id=KCDCBQ3JCAYUP26TFIRYKWXRQ5S7Q7JLWHY4XDB3FXU263DMGJRA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.727728035 (590h58m31.59881108s) [noise=true , address=145.79.227.17:4972   , piece_id=3Q2WOCLVLN4546C4TTIHVDTEI2A3NXCAKTUD337OUDAN6KSW7AOQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.727802376 (590h58m31.598885421s) [noise=true , address=145.79.227.13:4804   , piece_id=FCZ4CYT6QT3IHOUC6R3H57NOOOMPDM3Z6FQ3TPOH4MR5QNZR7STQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.729155453 (590h58m31.600238488s) [noise=true , address=145.79.227.31:4799   , piece_id=SAIJ2QPHM5AGSRV62E7TD2A4YBETORXUCK5YUK4EZQUKN3TUF64Q, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.729401191 (590h58m31.600484236s) [noise=true , address=145.79.227.22:4509   , piece_id=7U75JX2T56P7KP3CJIOI24XXY3ED4VAEIMQNJSPHKS5W7YF3FXCA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.729850997 (590h58m31.600934032s) [noise=true , address=77.90.31.17:4773     , piece_id=NGPVC3N4UPXTO42JJIHGCQMMZU4MS3C36A3KZIYSGOF6B3PX4EJQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.730681368 (590h58m31.601764404s) [noise=true , address=145.79.227.45:4230   , piece_id=G64X3YOMTVLAIWQY5RIFY6K5EHDSUIZWCN2RDWK6LRVN3XUZBLKA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.731315676 (590h58m31.602398721s) [noise=true , address=145.79.227.27:4689   , piece_id=C2RDOQOUDRFIHSAPQIJNYFHZJFQUQWPLOKJUWLPNFMKCBA5H4XLA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.732192586 (590h58m31.603275631s) [noise=true , address=77.90.31.12:4590     , piece_id=FCPRQ6RUSDVTSZIK6QFECZXB3T6FE6SWYH7DNEPICJW7QWFQK3EQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.732619839 (590h58m31.603702884s) [noise=true , address=45.91.116.5:4298     , piece_id=XSQHRQH6UQGLUDFGDHXPNVJSTTRBSBDIEELEH4JC5GEEQ2M4KQ5A, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.733515114 (590h58m31.604598159s) [noise=true , address=77.90.31.13:4626     , piece_id=FWF4DQ4MPPWF2SKBBZLNGV7KWQ23BEA7UIS6FHDKINPB6YRAZARQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.734041075 (590h58m31.60512412s) [noise=true , address=145.79.227.20:4438   , piece_id=A623O6EK2ZQB6P37KJG6L7JYZICD5UY6JOYVKZ2BN2SMBUOMGMEA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.734770875 (590h58m31.60585392s) [noise=true , address=145.79.227.15:4873   , piece_id=33B56NW26Q23FA3A4AZ74ZZJYAAZ5M4ZSBDX5JE3M2BX4RVUI2YQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.735257321 (590h58m31.606340366s) [noise=true , address=145.79.227.52:4445   , piece_id=Z4HTRQZLIIBDE34RDPNDZR5BGASGJRJI4Q6DCEW4T3CHMI2PREBA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.736066582 (590h58m31.607149617s) [noise=true , address=145.79.227.7:4293    , piece_id=2WGGEODE53DFZXSKPINQLR7G6AMBEH7C3IEHX44WCRHWOTXWQT5A, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.737627635 (590h58m31.60871067s) [noise=true , address=145.79.227.49:4339   , piece_id=2FQP72I6EC5DPC5B6B6NFRMPQT7QYWVZFOZFWZFQFMVRFO4GCT2A, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:33.442981428 (590h58m33.314064473s) [upload=518086]: Next returned nil segment
Dec 30 06:27:33.443000564 (590h58m33.3140836s) [upload=518086]: Waiting for error group managing segments...
Dec 30 06:27:33.726010138 (590h58m33.597093173s) [noise=true , address=145.79.227.27:4689   , piece_id=C2RDOQOUDRFIHSAPQIJNYFHZJFQUQWPLOKJUWLPNFMKCBA5H4XLA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.726365194 (590h58m33.597448229s) [noise=true , address=145.79.227.45:4230   , piece_id=G64X3YOMTVLAIWQY5RIFY6K5EHDSUIZWCN2RDWK6LRVN3XUZBLKA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.731331761 (590h58m33.602414806s) [noise=true , address=145.79.227.52:4445   , piece_id=Z4HTRQZLIIBDE34RDPNDZR5BGASGJRJI4Q6DCEW4T3CHMI2PREBA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.732488724 (590h58m33.603571759s) [noise=true , address=145.79.227.13:4804   , piece_id=FCZ4CYT6QT3IHOUC6R3H57NOOOMPDM3Z6FQ3TPOH4MR5QNZR7STQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.742934164 (590h58m33.614017199s) [noise=true , address=145.79.227.15:4873   , piece_id=33B56NW26Q23FA3A4AZ74ZZJYAAZ5M4ZSBDX5JE3M2BX4RVUI2YQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.746966712 (590h58m33.618049747s) [noise=true , address=145.79.227.31:4799   , piece_id=SAIJ2QPHM5AGSRV62E7TD2A4YBETORXUCK5YUK4EZQUKN3TUF64Q, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.781208554 (590h58m33.652291599s) [noise=true , address=145.79.227.7:4293    , piece_id=2WGGEODE53DFZXSKPINQLR7G6AMBEH7C3IEHX44WCRHWOTXWQT5A, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.807290017 (590h58m33.678373052s) [noise=true , address=145.79.227.20:4438   , piece_id=A623O6EK2ZQB6P37KJG6L7JYZICD5UY6JOYVKZ2BN2SMBUOMGMEA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.809530753 (590h58m33.680613798s) [noise=true , address=145.79.227.22:4509   , piece_id=7U75JX2T56P7KP3CJIOI24XXY3ED4VAEIMQNJSPHKS5W7YF3FXCA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.812826569 (590h58m33.683909604s) [noise=true , address=145.79.227.17:4972   , piece_id=3Q2WOCLVLN4546C4TTIHVDTEI2A3NXCAKTUD337OUDAN6KSW7AOQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.900372450 (590h58m33.771455495s) [noise=true , address=77.90.31.13:4626     , piece_id=FWF4DQ4MPPWF2SKBBZLNGV7KWQ23BEA7UIS6FHDKINPB6YRAZARQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.916464471 (590h58m33.787547506s) [noise=true , address=77.90.31.21:4880     , piece_id=KCDCBQ3JCAYUP26TFIRYKWXRQ5S7Q7JLWHY4XDB3FXU263DMGJRA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:34.018888070 (590h58m33.889971115s) [noise=true , address=77.90.31.12:4590     , piece_id=FCPRQ6RUSDVTSZIK6QFECZXB3T6FE6SWYH7DNEPICJW7QWFQK3EQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:34.018913669 (590h58m33.889996714s) [seg_pos={0 0}, upload=518086]: Segment reached optimal threshold of 13 pieces.
Dec 30 06:27:34.019155831 (590h58m33.890238876s) [noise=true , address=77.90.31.17:4773     , piece_id=NGPVC3N4UPXTO42JJIHGCQMMZU4MS3C36A3KZIYSGOF6B3PX4EJQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ): protocol: expected piece hash; context canceled; EOF
Dec 30 06:27:34.019166861 (590h58m33.890249906s) [noise=true , address=77.90.31.17:4773     , piece_id=NGPVC3N4UPXTO42JJIHGCQMMZU4MS3C36A3KZIYSGOF6B3PX4EJQ, seg_pos={0 0}, upload=518086]: Long tail cancellation due to optimal threshold
Dec 30 06:27:34.019372272 (590h58m33.890455318s) [noise=true , address=45.91.116.5:4298     , piece_id=XSQHRQH6UQGLUDFGDHXPNVJSTTRBSBDIEELEH4JC5GEEQ2M4KQ5A, seg_pos={0 0}, upload=518086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Dec 30 06:27:34.019400827 (590h58m33.890483862s) [noise=true , address=45.91.116.5:4298     , piece_id=XSQHRQH6UQGLUDFGDHXPNVJSTTRBSBDIEELEH4JC5GEEQ2M4KQ5A, seg_pos={0 0}, upload=518086]: Long tail cancellation due to optimal threshold
Dec 30 06:27:34.019477783 (590h58m33.890560838s) [noise=true , address=145.79.227.49:4339   , piece_id=2FQP72I6EC5DPC5B6B6NFRMPQT7QYWVZFOZFWZFQFMVRFO4GCT2A, seg_pos={0 0}, upload=518086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF
Dec 30 06:27:34.019487012 (590h58m33.890570057s) [noise=true , address=145.79.227.49:4339   , piece_id=2FQP72I6EC5DPC5B6B6NFRMPQT7QYWVZFOZFWZFQFMVRFO4GCT2A, seg_pos={0 0}, upload=518086]: Long tail cancellation due to optimal threshold
Dec 30 06:27:34.019511157 (590h58m33.890594192s) [seg_pos={0 0}, upload=518086]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 30 06:27:34.019579547 (590h58m33.890662582s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:27:34.019584216 (590h58m33.890667251s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:27:34.313480950 (590h58m34.184563985s) [upload=518086]: Done uploading segments...
Dec 30 06:27:34.313532458 (590h58m34.184615493s) [upload=518086]: Upload finished. err: <nil>
Duration: 5.763361155s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
5 out of 60 is failed (threshold=6) [........................X...........X..............XX...X...]
duration: 
4.158799447s
trace: 
https://jaeger.dev.storj.io/trace/5d54da3b342a05d9
FAIL (2025-12-30 06:30:23 UTC) 
orbiter warning: context deadline exceeded
Duration: 4.158826528s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [.........................X...X......X............X..........]
duration: 
41.497445634s
trace: 
https://jaeger.dev.storj.io/trace/45b769fc71e13448
FAIL (2025-12-30 06:30:21 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
.577697683 (590h53m11.448780728s) [noise=true , address=193.149.164.143:4704 , piece_id=4T2IJIA6WHI5LMIUP5BLJLCD3GRY3A6PXR6G5OWJWUSYZT5ELGHQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578173528 (590h53m11.449256573s) [noise=true , address=64.49.13.27:4965     , piece_id=CO4O5F2IBZAAKBZBV3HWNNOXZOGLNNDPALWMQZ3DEM3MREASVFEA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578542992 (590h53m11.449626027s) [noise=true , address=77.90.31.15:4729     , piece_id=NVMXFEILHGT622IIPYYT4FFHC2WZLHMCZM4VT5WUPHRAPH3DX6TA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578846911 (590h53m11.449929946s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579458044 (590h53m11.450541089s) [noise=true , address=45.91.116.11:4150    , piece_id=E66IDHTJDLYLYJIOWMOIKOOWLXCUNCMBIQ7SQBAD3VTJF6VX5JLQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579891209 (590h53m11.450974245s) [noise=true , address=145.79.227.29:4945   , piece_id=SHL73IDEI54GRCWYNWHRUSJZZ4UUXREAX54DFJLTG5QPZCF5QKIQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579915535 (590h53m11.45099858s) [noise=true , address=145.79.227.30:4772   , piece_id=PVMD5DWRRPVARTSZ6O7HN6MUVTZUYWLYSNQR5GDMNKUJZGXMYPFQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580325466 (590h53m11.451408511s) [noise=true , address=77.90.31.12:4603     , piece_id=2I4L7F2WEGK5OSLODJSJ4672URBA7DUGXWZKTYB6ZNA2TQIGVXWA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580379599 (590h53m11.451462644s) [noise=true , address=77.90.31.14:4671     , piece_id=263TRISJ5ADFTX43ULSSGBAF2KMOXAPISJ56LLE53D74XOEMQ5EA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580692044 (590h53m11.451775089s) [noise=true , address=145.79.227.3:4175    , piece_id=UCV5WQNVWEAMEDBWDNXEVSQEGXPJE7KD6YSWC5A4WXYUKUCK4NLA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580857859 (590h53m11.451940894s) [noise=true , address=77.90.31.19:4860     , piece_id=U2MNFOAD7FHCDBE4FUYOROIP3P33ROJ7K75SF5Z747EFKFTF7RGA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581089210 (590h53m11.452172255s) [noise=true , address=145.79.227.44:4203   , piece_id=WHCKQ2FRLYAZE7Q6HYZNTS4EISVHZNAPDDKH34WN33ALK4MVK2EA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581351320 (590h53m11.452434355s) [noise=true , address=64.49.13.154:4928    , piece_id=SEVBZBMNGURP5TRUEBA4PHRSA6MNANVJUKINALJUWPQWBGKVYNTA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581457091 (590h53m11.452540126s) [noise=true , address=145.79.227.34:4909   , piece_id=3QSWTNR5LGUUAY3N5HJKSPL3TRQ6WO5F5OD4VTXKWHWUXUF7PVVQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581863144 (590h53m11.452946179s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.584010443 (590h53m11.455093478s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.585122791 (590h53m11.456205826s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:12.983305402 (590h53m12.854388447s) [upload=517998]: Next returned nil segment
Dec 30 06:22:12.983321313 (590h53m12.854404348s) [upload=517998]: Waiting for error group managing segments...
Dec 30 06:22:13.379703053 (590h53m13.250786088s) [noise=true , address=64.49.13.27:4965     , piece_id=CO4O5F2IBZAAKBZBV3HWNNOXZOGLNNDPALWMQZ3DEM3MREASVFEA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.418055622 (590h53m13.289138657s) [noise=true , address=145.79.227.3:4175    , piece_id=UCV5WQNVWEAMEDBWDNXEVSQEGXPJE7KD6YSWC5A4WXYUKUCK4NLA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.509034160 (590h53m13.380117205s) [noise=true , address=64.49.13.154:4928    , piece_id=SEVBZBMNGURP5TRUEBA4PHRSA6MNANVJUKINALJUWPQWBGKVYNTA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.642886154 (590h53m13.513969199s) [noise=true , address=77.90.31.14:4671     , piece_id=263TRISJ5ADFTX43ULSSGBAF2KMOXAPISJ56LLE53D74XOEMQ5EA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.788145520 (590h53m13.659228555s) [noise=true , address=77.90.31.12:4603     , piece_id=2I4L7F2WEGK5OSLODJSJ4672URBA7DUGXWZKTYB6ZNA2TQIGVXWA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.858878757 (590h53m13.729961792s) [noise=true , address=145.79.227.49:4369   , piece_id=XUEXGNJJIJ4DUBDNUV7CKF6J5JYHSLZAEPVGEDGBUBY42BIP4XEQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.879550569 (590h53m13.750633614s) [noise=true , address=145.79.227.34:4909   , piece_id=3QSWTNR5LGUUAY3N5HJKSPL3TRQ6WO5F5OD4VTXKWHWUXUF7PVVQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.940897723 (590h53m13.811980769s) [noise=true , address=77.90.31.19:4860     , piece_id=U2MNFOAD7FHCDBE4FUYOROIP3P33ROJ7K75SF5Z747EFKFTF7RGA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.989791936 (590h53m13.860874981s) [noise=true , address=45.91.116.11:4150    , piece_id=E66IDHTJDLYLYJIOWMOIKOOWLXCUNCMBIQ7SQBAD3VTJF6VX5JLQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.289516718 (590h53m14.160599753s) [noise=true , address=145.79.227.44:4203   , piece_id=WHCKQ2FRLYAZE7Q6HYZNTS4EISVHZNAPDDKH34WN33ALK4MVK2EA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.338651537 (590h53m14.209734582s) [noise=true , address=77.90.31.15:4729     , piece_id=NVMXFEILHGT622IIPYYT4FFHC2WZLHMCZM4VT5WUPHRAPH3DX6TA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.344145168 (590h53m14.215228213s) [noise=true , address=145.79.227.30:4772   , piece_id=PVMD5DWRRPVARTSZ6O7HN6MUVTZUYWLYSNQR5GDMNKUJZGXMYPFQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.667232847 (590h53m14.538315892s) [noise=true , address=193.149.164.143:4704 , piece_id=4T2IJIA6WHI5LMIUP5BLJLCD3GRY3A6PXR6G5OWJWUSYZT5ELGHQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.671388990 (590h53m14.542472025s) [noise=true , address=145.79.227.29:4945   , piece_id=SHL73IDEI54GRCWYNWHRUSJZZ4UUXREAX54DFJLTG5QPZCF5QKIQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.671415190 (590h53m14.542498226s) [seg_pos={0 0}, upload=517998]: Segment reached optimal threshold of 14 pieces.
Dec 30 06:22:14.671803600 (590h53m14.542886655s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hU1LwL2gX7rVnrNgzaBCYB37ziqf7s7aUgtF2Uc3antReQ6me): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.671814470 (590h53m14.542897525s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672014932 (590h53m14.543097977s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bhN3cR22QuAYihnnB3x3R97UZRWJ8sFPP8fjQcXZ7qhNZphZG): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672022637 (590h53m14.543105672s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672088933 (590h53m14.543171988s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672127677 (590h53m14.543210742s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672312739 (590h53m14.543395774s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSXWFiq27Dd2vBDD9vVnhDHVG59UmDKn3hVAhf3oyo5goVNaE): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672319953 (590h53m14.543402988s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672337847 (590h53m14.543420882s) [seg_pos={0 0}, upload=517998]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 30 06:22:14.672452947 (590h53m14.543535982s) [upload=517998]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:22:14.672458507 (590h53m14.543541542s) [upload=517998]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:22:14.981437069 (590h53m14.852520114s) [upload=517998]: Done uploading segments...
Dec 30 06:22:14.981456546 (590h53m14.852539581s) [upload=517998]: Upload finished. err: <nil>
Duration: 41.497471723s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
17 out of 60 is failed (threshold=3) [XX.X..X..X..X..XX.......X..X......X....X...X..X.X.X.....X...]
duration: 
5.975186724s
trace: 
https://jaeger.dev.storj.io/trace/32a160c1d95b9ce1
FAIL (2025-12-30 06:30:01 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, Piece ID: KCDCBQ3JCAYUP26TFIRYKWXRQ5S7Q7JLWHY4XDB3FXU263DMGJRA) context deadline exceeded; piecestore: (Node ID: 1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, Piece ID: FCPRQ6RUSDVTSZIK6QFECZXB3T6FE6SWYH7DNEPICJW7QWFQK3EQ) context deadline exceeded
======LOGS======
Dec 30 06:27:31.479172017 (590h58m31.350255062s) [upload=518086]: Starting upload
Dec 30 06:27:31.479271175 (590h58m31.35035421s) [upload=518086]: Done starting upload
Dec 30 06:27:31.479402385 (590h58m31.35048542s) [upload=518086]: Uploading segments...
Dec 30 06:27:31.480006245 (590h58m31.35108929s) [upload=518086]: Got next segment. Inline: false
Dec 30 06:27:31.480174686 (590h58m31.351257721s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 30 06:27:31.480182702 (590h58m31.351265737s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 30 06:27:31.727629458 (590h58m31.598712493s) [seg_pos={0 0}, upload=518086]: Begin upload segment...
Dec 30 06:27:31.727685714 (590h58m31.598768759s) [seg_pos={0 0}, upload=518086]: Done begin upload segment.
Dec 30 06:27:31.727714169 (590h58m31.598797214s) [noise=true , address=77.90.31.21:4880     , piece_id=KCDCBQ3JCAYUP26TFIRYKWXRQ5S7Q7JLWHY4XDB3FXU263DMGJRA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.727728035 (590h58m31.59881108s) [noise=true , address=145.79.227.17:4972   , piece_id=3Q2WOCLVLN4546C4TTIHVDTEI2A3NXCAKTUD337OUDAN6KSW7AOQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.727802376 (590h58m31.598885421s) [noise=true , address=145.79.227.13:4804   , piece_id=FCZ4CYT6QT3IHOUC6R3H57NOOOMPDM3Z6FQ3TPOH4MR5QNZR7STQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.729155453 (590h58m31.600238488s) [noise=true , address=145.79.227.31:4799   , piece_id=SAIJ2QPHM5AGSRV62E7TD2A4YBETORXUCK5YUK4EZQUKN3TUF64Q, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.729401191 (590h58m31.600484236s) [noise=true , address=145.79.227.22:4509   , piece_id=7U75JX2T56P7KP3CJIOI24XXY3ED4VAEIMQNJSPHKS5W7YF3FXCA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.729850997 (590h58m31.600934032s) [noise=true , address=77.90.31.17:4773     , piece_id=NGPVC3N4UPXTO42JJIHGCQMMZU4MS3C36A3KZIYSGOF6B3PX4EJQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.730681368 (590h58m31.601764404s) [noise=true , address=145.79.227.45:4230   , piece_id=G64X3YOMTVLAIWQY5RIFY6K5EHDSUIZWCN2RDWK6LRVN3XUZBLKA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.731315676 (590h58m31.602398721s) [noise=true , address=145.79.227.27:4689   , piece_id=C2RDOQOUDRFIHSAPQIJNYFHZJFQUQWPLOKJUWLPNFMKCBA5H4XLA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.732192586 (590h58m31.603275631s) [noise=true , address=77.90.31.12:4590     , piece_id=FCPRQ6RUSDVTSZIK6QFECZXB3T6FE6SWYH7DNEPICJW7QWFQK3EQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.732619839 (590h58m31.603702884s) [noise=true , address=45.91.116.5:4298     , piece_id=XSQHRQH6UQGLUDFGDHXPNVJSTTRBSBDIEELEH4JC5GEEQ2M4KQ5A, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.733515114 (590h58m31.604598159s) [noise=true , address=77.90.31.13:4626     , piece_id=FWF4DQ4MPPWF2SKBBZLNGV7KWQ23BEA7UIS6FHDKINPB6YRAZARQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.734041075 (590h58m31.60512412s) [noise=true , address=145.79.227.20:4438   , piece_id=A623O6EK2ZQB6P37KJG6L7JYZICD5UY6JOYVKZ2BN2SMBUOMGMEA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.734770875 (590h58m31.60585392s) [noise=true , address=145.79.227.15:4873   , piece_id=33B56NW26Q23FA3A4AZ74ZZJYAAZ5M4ZSBDX5JE3M2BX4RVUI2YQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.735257321 (590h58m31.606340366s) [noise=true , address=145.79.227.52:4445   , piece_id=Z4HTRQZLIIBDE34RDPNDZR5BGASGJRJI4Q6DCEW4T3CHMI2PREBA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.736066582 (590h58m31.607149617s) [noise=true , address=145.79.227.7:4293    , piece_id=2WGGEODE53DFZXSKPINQLR7G6AMBEH7C3IEHX44WCRHWOTXWQT5A, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.737627635 (590h58m31.60871067s) [noise=true , address=145.79.227.49:4339   , piece_id=2FQP72I6EC5DPC5B6B6NFRMPQT7QYWVZFOZFWZFQFMVRFO4GCT2A, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:33.442981428 (590h58m33.314064473s) [upload=518086]: Next returned nil segment
Dec 30 06:27:33.443000564 (590h58m33.3140836s) [upload=518086]: Waiting for error group managing segments...
Dec 30 06:27:33.726010138 (590h58m33.597093173s) [noise=true , address=145.79.227.27:4689   , piece_id=C2RDOQOUDRFIHSAPQIJNYFHZJFQUQWPLOKJUWLPNFMKCBA5H4XLA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.726365194 (590h58m33.597448229s) [noise=true , address=145.79.227.45:4230   , piece_id=G64X3YOMTVLAIWQY5RIFY6K5EHDSUIZWCN2RDWK6LRVN3XUZBLKA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.731331761 (590h58m33.602414806s) [noise=true , address=145.79.227.52:4445   , piece_id=Z4HTRQZLIIBDE34RDPNDZR5BGASGJRJI4Q6DCEW4T3CHMI2PREBA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.732488724 (590h58m33.603571759s) [noise=true , address=145.79.227.13:4804   , piece_id=FCZ4CYT6QT3IHOUC6R3H57NOOOMPDM3Z6FQ3TPOH4MR5QNZR7STQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.742934164 (590h58m33.614017199s) [noise=true , address=145.79.227.15:4873   , piece_id=33B56NW26Q23FA3A4AZ74ZZJYAAZ5M4ZSBDX5JE3M2BX4RVUI2YQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.746966712 (590h58m33.618049747s) [noise=true , address=145.79.227.31:4799   , piece_id=SAIJ2QPHM5AGSRV62E7TD2A4YBETORXUCK5YUK4EZQUKN3TUF64Q, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.781208554 (590h58m33.652291599s) [noise=true , address=145.79.227.7:4293    , piece_id=2WGGEODE53DFZXSKPINQLR7G6AMBEH7C3IEHX44WCRHWOTXWQT5A, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.807290017 (590h58m33.678373052s) [noise=true , address=145.79.227.20:4438   , piece_id=A623O6EK2ZQB6P37KJG6L7JYZICD5UY6JOYVKZ2BN2SMBUOMGMEA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.809530753 (590h58m33.680613798s) [noise=true , address=145.79.227.22:4509   , piece_id=7U75JX2T56P7KP3CJIOI24XXY3ED4VAEIMQNJSPHKS5W7YF3FXCA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.812826569 (590h58m33.683909604s) [noise=true , address=145.79.227.17:4972   , piece_id=3Q2WOCLVLN4546C4TTIHVDTEI2A3NXCAKTUD337OUDAN6KSW7AOQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.900372450 (590h58m33.771455495s) [noise=true , address=77.90.31.13:4626     , piece_id=FWF4DQ4MPPWF2SKBBZLNGV7KWQ23BEA7UIS6FHDKINPB6YRAZARQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.916464471 (590h58m33.787547506s) [noise=true , address=77.90.31.21:4880     , piece_id=KCDCBQ3JCAYUP26TFIRYKWXRQ5S7Q7JLWHY4XDB3FXU263DMGJRA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:34.018888070 (590h58m33.889971115s) [noise=true , address=77.90.31.12:4590     , piece_id=FCPRQ6RUSDVTSZIK6QFECZXB3T6FE6SWYH7DNEPICJW7QWFQK3EQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:34.018913669 (590h58m33.889996714s) [seg_pos={0 0}, upload=518086]: Segment reached optimal threshold of 13 pieces.
Dec 30 06:27:34.019155831 (590h58m33.890238876s) [noise=true , address=77.90.31.17:4773     , piece_id=NGPVC3N4UPXTO42JJIHGCQMMZU4MS3C36A3KZIYSGOF6B3PX4EJQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ): protocol: expected piece hash; context canceled; EOF
Dec 30 06:27:34.019166861 (590h58m33.890249906s) [noise=true , address=77.90.31.17:4773     , piece_id=NGPVC3N4UPXTO42JJIHGCQMMZU4MS3C36A3KZIYSGOF6B3PX4EJQ, seg_pos={0 0}, upload=518086]: Long tail cancellation due to optimal threshold
Dec 30 06:27:34.019372272 (590h58m33.890455318s) [noise=true , address=45.91.116.5:4298     , piece_id=XSQHRQH6UQGLUDFGDHXPNVJSTTRBSBDIEELEH4JC5GEEQ2M4KQ5A, seg_pos={0 0}, upload=518086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Dec 30 06:27:34.019400827 (590h58m33.890483862s) [noise=true , address=45.91.116.5:4298     , piece_id=XSQHRQH6UQGLUDFGDHXPNVJSTTRBSBDIEELEH4JC5GEEQ2M4KQ5A, seg_pos={0 0}, upload=518086]: Long tail cancellation due to optimal threshold
Dec 30 06:27:34.019477783 (590h58m33.890560838s) [noise=true , address=145.79.227.49:4339   , piece_id=2FQP72I6EC5DPC5B6B6NFRMPQT7QYWVZFOZFWZFQFMVRFO4GCT2A, seg_pos={0 0}, upload=518086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF
Dec 30 06:27:34.019487012 (590h58m33.890570057s) [noise=true , address=145.79.227.49:4339   , piece_id=2FQP72I6EC5DPC5B6B6NFRMPQT7QYWVZFOZFWZFQFMVRFO4GCT2A, seg_pos={0 0}, upload=518086]: Long tail cancellation due to optimal threshold
Dec 30 06:27:34.019511157 (590h58m33.890594192s) [seg_pos={0 0}, upload=518086]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 30 06:27:34.019579547 (590h58m33.890662582s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:27:34.019584216 (590h58m33.890667251s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:27:34.313480950 (590h58m34.184563985s) [upload=518086]: Done uploading segments...
Dec 30 06:27:34.313532458 (590h58m34.184615493s) [upload=518086]: Upload finished. err: <nil>
Duration: 5.975217102s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.........................................X..................]
duration: 
8.667076962s
trace: 
https://jaeger.dev.storj.io/trace/deb96436003dee
FAIL (2025-12-30 06:29:54 UTC) 
orbiter warning: read tcp 188.166.225.170:52458->45.38.24.2:443: read: connection reset by peer
Duration: 8.667108783s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration: 
16.212288069s
trace: 
https://jaeger.dev.storj.io/trace/deb96436003dee
FAIL (2025-12-30 06:29:34 UTC) 
orbiter warning: read tcp 188.166.225.170:52458->45.38.24.2:443: read: connection reset by peer
Duration: 16.212317105s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
5 out of 60 is failed (threshold=6) [.........................X...........X..............XX...X..]
duration: 
3.47173039s
trace: 
https://jaeger.dev.storj.io/trace/5d54da3b342a05d9
FAIL (2025-12-30 06:29:34 UTC) 
orbiter warning: context deadline exceeded
Duration: 3.471765827s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [..........................X...X......X............X.........]
duration: 
31.461410262s
trace: 
https://jaeger.dev.storj.io/trace/45b769fc71e13448
FAIL (2025-12-30 06:29:26 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
.577697683 (590h53m11.448780728s) [noise=true , address=193.149.164.143:4704 , piece_id=4T2IJIA6WHI5LMIUP5BLJLCD3GRY3A6PXR6G5OWJWUSYZT5ELGHQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578173528 (590h53m11.449256573s) [noise=true , address=64.49.13.27:4965     , piece_id=CO4O5F2IBZAAKBZBV3HWNNOXZOGLNNDPALWMQZ3DEM3MREASVFEA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578542992 (590h53m11.449626027s) [noise=true , address=77.90.31.15:4729     , piece_id=NVMXFEILHGT622IIPYYT4FFHC2WZLHMCZM4VT5WUPHRAPH3DX6TA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578846911 (590h53m11.449929946s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579458044 (590h53m11.450541089s) [noise=true , address=45.91.116.11:4150    , piece_id=E66IDHTJDLYLYJIOWMOIKOOWLXCUNCMBIQ7SQBAD3VTJF6VX5JLQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579891209 (590h53m11.450974245s) [noise=true , address=145.79.227.29:4945   , piece_id=SHL73IDEI54GRCWYNWHRUSJZZ4UUXREAX54DFJLTG5QPZCF5QKIQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579915535 (590h53m11.45099858s) [noise=true , address=145.79.227.30:4772   , piece_id=PVMD5DWRRPVARTSZ6O7HN6MUVTZUYWLYSNQR5GDMNKUJZGXMYPFQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580325466 (590h53m11.451408511s) [noise=true , address=77.90.31.12:4603     , piece_id=2I4L7F2WEGK5OSLODJSJ4672URBA7DUGXWZKTYB6ZNA2TQIGVXWA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580379599 (590h53m11.451462644s) [noise=true , address=77.90.31.14:4671     , piece_id=263TRISJ5ADFTX43ULSSGBAF2KMOXAPISJ56LLE53D74XOEMQ5EA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580692044 (590h53m11.451775089s) [noise=true , address=145.79.227.3:4175    , piece_id=UCV5WQNVWEAMEDBWDNXEVSQEGXPJE7KD6YSWC5A4WXYUKUCK4NLA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580857859 (590h53m11.451940894s) [noise=true , address=77.90.31.19:4860     , piece_id=U2MNFOAD7FHCDBE4FUYOROIP3P33ROJ7K75SF5Z747EFKFTF7RGA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581089210 (590h53m11.452172255s) [noise=true , address=145.79.227.44:4203   , piece_id=WHCKQ2FRLYAZE7Q6HYZNTS4EISVHZNAPDDKH34WN33ALK4MVK2EA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581351320 (590h53m11.452434355s) [noise=true , address=64.49.13.154:4928    , piece_id=SEVBZBMNGURP5TRUEBA4PHRSA6MNANVJUKINALJUWPQWBGKVYNTA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581457091 (590h53m11.452540126s) [noise=true , address=145.79.227.34:4909   , piece_id=3QSWTNR5LGUUAY3N5HJKSPL3TRQ6WO5F5OD4VTXKWHWUXUF7PVVQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581863144 (590h53m11.452946179s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.584010443 (590h53m11.455093478s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.585122791 (590h53m11.456205826s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:12.983305402 (590h53m12.854388447s) [upload=517998]: Next returned nil segment
Dec 30 06:22:12.983321313 (590h53m12.854404348s) [upload=517998]: Waiting for error group managing segments...
Dec 30 06:22:13.379703053 (590h53m13.250786088s) [noise=true , address=64.49.13.27:4965     , piece_id=CO4O5F2IBZAAKBZBV3HWNNOXZOGLNNDPALWMQZ3DEM3MREASVFEA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.418055622 (590h53m13.289138657s) [noise=true , address=145.79.227.3:4175    , piece_id=UCV5WQNVWEAMEDBWDNXEVSQEGXPJE7KD6YSWC5A4WXYUKUCK4NLA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.509034160 (590h53m13.380117205s) [noise=true , address=64.49.13.154:4928    , piece_id=SEVBZBMNGURP5TRUEBA4PHRSA6MNANVJUKINALJUWPQWBGKVYNTA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.642886154 (590h53m13.513969199s) [noise=true , address=77.90.31.14:4671     , piece_id=263TRISJ5ADFTX43ULSSGBAF2KMOXAPISJ56LLE53D74XOEMQ5EA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.788145520 (590h53m13.659228555s) [noise=true , address=77.90.31.12:4603     , piece_id=2I4L7F2WEGK5OSLODJSJ4672URBA7DUGXWZKTYB6ZNA2TQIGVXWA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.858878757 (590h53m13.729961792s) [noise=true , address=145.79.227.49:4369   , piece_id=XUEXGNJJIJ4DUBDNUV7CKF6J5JYHSLZAEPVGEDGBUBY42BIP4XEQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.879550569 (590h53m13.750633614s) [noise=true , address=145.79.227.34:4909   , piece_id=3QSWTNR5LGUUAY3N5HJKSPL3TRQ6WO5F5OD4VTXKWHWUXUF7PVVQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.940897723 (590h53m13.811980769s) [noise=true , address=77.90.31.19:4860     , piece_id=U2MNFOAD7FHCDBE4FUYOROIP3P33ROJ7K75SF5Z747EFKFTF7RGA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.989791936 (590h53m13.860874981s) [noise=true , address=45.91.116.11:4150    , piece_id=E66IDHTJDLYLYJIOWMOIKOOWLXCUNCMBIQ7SQBAD3VTJF6VX5JLQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.289516718 (590h53m14.160599753s) [noise=true , address=145.79.227.44:4203   , piece_id=WHCKQ2FRLYAZE7Q6HYZNTS4EISVHZNAPDDKH34WN33ALK4MVK2EA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.338651537 (590h53m14.209734582s) [noise=true , address=77.90.31.15:4729     , piece_id=NVMXFEILHGT622IIPYYT4FFHC2WZLHMCZM4VT5WUPHRAPH3DX6TA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.344145168 (590h53m14.215228213s) [noise=true , address=145.79.227.30:4772   , piece_id=PVMD5DWRRPVARTSZ6O7HN6MUVTZUYWLYSNQR5GDMNKUJZGXMYPFQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.667232847 (590h53m14.538315892s) [noise=true , address=193.149.164.143:4704 , piece_id=4T2IJIA6WHI5LMIUP5BLJLCD3GRY3A6PXR6G5OWJWUSYZT5ELGHQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.671388990 (590h53m14.542472025s) [noise=true , address=145.79.227.29:4945   , piece_id=SHL73IDEI54GRCWYNWHRUSJZZ4UUXREAX54DFJLTG5QPZCF5QKIQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.671415190 (590h53m14.542498226s) [seg_pos={0 0}, upload=517998]: Segment reached optimal threshold of 14 pieces.
Dec 30 06:22:14.671803600 (590h53m14.542886655s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hU1LwL2gX7rVnrNgzaBCYB37ziqf7s7aUgtF2Uc3antReQ6me): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.671814470 (590h53m14.542897525s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672014932 (590h53m14.543097977s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bhN3cR22QuAYihnnB3x3R97UZRWJ8sFPP8fjQcXZ7qhNZphZG): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672022637 (590h53m14.543105672s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672088933 (590h53m14.543171988s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672127677 (590h53m14.543210742s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672312739 (590h53m14.543395774s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSXWFiq27Dd2vBDD9vVnhDHVG59UmDKn3hVAhf3oyo5goVNaE): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672319953 (590h53m14.543402988s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672337847 (590h53m14.543420882s) [seg_pos={0 0}, upload=517998]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 30 06:22:14.672452947 (590h53m14.543535982s) [upload=517998]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:22:14.672458507 (590h53m14.543541542s) [upload=517998]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:22:14.981437069 (590h53m14.852520114s) [upload=517998]: Done uploading segments...
Dec 30 06:22:14.981456546 (590h53m14.852539581s) [upload=517998]: Upload finished. err: <nil>
Duration: 31.461438497s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
17 out of 60 is failed (threshold=3) [.XX.X..X..X..X..XX.......X..X......X....X...X..X.X.X.....X..]
duration: 
5.752458373s
trace: 
https://jaeger.dev.storj.io/trace/32a160c1d95b9ce1
FAIL (2025-12-30 06:29:13 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, Piece ID: KCDCBQ3JCAYUP26TFIRYKWXRQ5S7Q7JLWHY4XDB3FXU263DMGJRA) context deadline exceeded; piecestore: (Node ID: 1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, Piece ID: FCPRQ6RUSDVTSZIK6QFECZXB3T6FE6SWYH7DNEPICJW7QWFQK3EQ) context deadline exceeded
======LOGS======
Dec 30 06:27:31.479172017 (590h58m31.350255062s) [upload=518086]: Starting upload
Dec 30 06:27:31.479271175 (590h58m31.35035421s) [upload=518086]: Done starting upload
Dec 30 06:27:31.479402385 (590h58m31.35048542s) [upload=518086]: Uploading segments...
Dec 30 06:27:31.480006245 (590h58m31.35108929s) [upload=518086]: Got next segment. Inline: false
Dec 30 06:27:31.480174686 (590h58m31.351257721s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 30 06:27:31.480182702 (590h58m31.351265737s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 30 06:27:31.727629458 (590h58m31.598712493s) [seg_pos={0 0}, upload=518086]: Begin upload segment...
Dec 30 06:27:31.727685714 (590h58m31.598768759s) [seg_pos={0 0}, upload=518086]: Done begin upload segment.
Dec 30 06:27:31.727714169 (590h58m31.598797214s) [noise=true , address=77.90.31.21:4880     , piece_id=KCDCBQ3JCAYUP26TFIRYKWXRQ5S7Q7JLWHY4XDB3FXU263DMGJRA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.727728035 (590h58m31.59881108s) [noise=true , address=145.79.227.17:4972   , piece_id=3Q2WOCLVLN4546C4TTIHVDTEI2A3NXCAKTUD337OUDAN6KSW7AOQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.727802376 (590h58m31.598885421s) [noise=true , address=145.79.227.13:4804   , piece_id=FCZ4CYT6QT3IHOUC6R3H57NOOOMPDM3Z6FQ3TPOH4MR5QNZR7STQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.729155453 (590h58m31.600238488s) [noise=true , address=145.79.227.31:4799   , piece_id=SAIJ2QPHM5AGSRV62E7TD2A4YBETORXUCK5YUK4EZQUKN3TUF64Q, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.729401191 (590h58m31.600484236s) [noise=true , address=145.79.227.22:4509   , piece_id=7U75JX2T56P7KP3CJIOI24XXY3ED4VAEIMQNJSPHKS5W7YF3FXCA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.729850997 (590h58m31.600934032s) [noise=true , address=77.90.31.17:4773     , piece_id=NGPVC3N4UPXTO42JJIHGCQMMZU4MS3C36A3KZIYSGOF6B3PX4EJQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.730681368 (590h58m31.601764404s) [noise=true , address=145.79.227.45:4230   , piece_id=G64X3YOMTVLAIWQY5RIFY6K5EHDSUIZWCN2RDWK6LRVN3XUZBLKA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.731315676 (590h58m31.602398721s) [noise=true , address=145.79.227.27:4689   , piece_id=C2RDOQOUDRFIHSAPQIJNYFHZJFQUQWPLOKJUWLPNFMKCBA5H4XLA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.732192586 (590h58m31.603275631s) [noise=true , address=77.90.31.12:4590     , piece_id=FCPRQ6RUSDVTSZIK6QFECZXB3T6FE6SWYH7DNEPICJW7QWFQK3EQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.732619839 (590h58m31.603702884s) [noise=true , address=45.91.116.5:4298     , piece_id=XSQHRQH6UQGLUDFGDHXPNVJSTTRBSBDIEELEH4JC5GEEQ2M4KQ5A, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.733515114 (590h58m31.604598159s) [noise=true , address=77.90.31.13:4626     , piece_id=FWF4DQ4MPPWF2SKBBZLNGV7KWQ23BEA7UIS6FHDKINPB6YRAZARQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.734041075 (590h58m31.60512412s) [noise=true , address=145.79.227.20:4438   , piece_id=A623O6EK2ZQB6P37KJG6L7JYZICD5UY6JOYVKZ2BN2SMBUOMGMEA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.734770875 (590h58m31.60585392s) [noise=true , address=145.79.227.15:4873   , piece_id=33B56NW26Q23FA3A4AZ74ZZJYAAZ5M4ZSBDX5JE3M2BX4RVUI2YQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.735257321 (590h58m31.606340366s) [noise=true , address=145.79.227.52:4445   , piece_id=Z4HTRQZLIIBDE34RDPNDZR5BGASGJRJI4Q6DCEW4T3CHMI2PREBA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.736066582 (590h58m31.607149617s) [noise=true , address=145.79.227.7:4293    , piece_id=2WGGEODE53DFZXSKPINQLR7G6AMBEH7C3IEHX44WCRHWOTXWQT5A, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.737627635 (590h58m31.60871067s) [noise=true , address=145.79.227.49:4339   , piece_id=2FQP72I6EC5DPC5B6B6NFRMPQT7QYWVZFOZFWZFQFMVRFO4GCT2A, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:33.442981428 (590h58m33.314064473s) [upload=518086]: Next returned nil segment
Dec 30 06:27:33.443000564 (590h58m33.3140836s) [upload=518086]: Waiting for error group managing segments...
Dec 30 06:27:33.726010138 (590h58m33.597093173s) [noise=true , address=145.79.227.27:4689   , piece_id=C2RDOQOUDRFIHSAPQIJNYFHZJFQUQWPLOKJUWLPNFMKCBA5H4XLA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.726365194 (590h58m33.597448229s) [noise=true , address=145.79.227.45:4230   , piece_id=G64X3YOMTVLAIWQY5RIFY6K5EHDSUIZWCN2RDWK6LRVN3XUZBLKA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.731331761 (590h58m33.602414806s) [noise=true , address=145.79.227.52:4445   , piece_id=Z4HTRQZLIIBDE34RDPNDZR5BGASGJRJI4Q6DCEW4T3CHMI2PREBA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.732488724 (590h58m33.603571759s) [noise=true , address=145.79.227.13:4804   , piece_id=FCZ4CYT6QT3IHOUC6R3H57NOOOMPDM3Z6FQ3TPOH4MR5QNZR7STQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.742934164 (590h58m33.614017199s) [noise=true , address=145.79.227.15:4873   , piece_id=33B56NW26Q23FA3A4AZ74ZZJYAAZ5M4ZSBDX5JE3M2BX4RVUI2YQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.746966712 (590h58m33.618049747s) [noise=true , address=145.79.227.31:4799   , piece_id=SAIJ2QPHM5AGSRV62E7TD2A4YBETORXUCK5YUK4EZQUKN3TUF64Q, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.781208554 (590h58m33.652291599s) [noise=true , address=145.79.227.7:4293    , piece_id=2WGGEODE53DFZXSKPINQLR7G6AMBEH7C3IEHX44WCRHWOTXWQT5A, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.807290017 (590h58m33.678373052s) [noise=true , address=145.79.227.20:4438   , piece_id=A623O6EK2ZQB6P37KJG6L7JYZICD5UY6JOYVKZ2BN2SMBUOMGMEA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.809530753 (590h58m33.680613798s) [noise=true , address=145.79.227.22:4509   , piece_id=7U75JX2T56P7KP3CJIOI24XXY3ED4VAEIMQNJSPHKS5W7YF3FXCA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.812826569 (590h58m33.683909604s) [noise=true , address=145.79.227.17:4972   , piece_id=3Q2WOCLVLN4546C4TTIHVDTEI2A3NXCAKTUD337OUDAN6KSW7AOQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.900372450 (590h58m33.771455495s) [noise=true , address=77.90.31.13:4626     , piece_id=FWF4DQ4MPPWF2SKBBZLNGV7KWQ23BEA7UIS6FHDKINPB6YRAZARQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.916464471 (590h58m33.787547506s) [noise=true , address=77.90.31.21:4880     , piece_id=KCDCBQ3JCAYUP26TFIRYKWXRQ5S7Q7JLWHY4XDB3FXU263DMGJRA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:34.018888070 (590h58m33.889971115s) [noise=true , address=77.90.31.12:4590     , piece_id=FCPRQ6RUSDVTSZIK6QFECZXB3T6FE6SWYH7DNEPICJW7QWFQK3EQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:34.018913669 (590h58m33.889996714s) [seg_pos={0 0}, upload=518086]: Segment reached optimal threshold of 13 pieces.
Dec 30 06:27:34.019155831 (590h58m33.890238876s) [noise=true , address=77.90.31.17:4773     , piece_id=NGPVC3N4UPXTO42JJIHGCQMMZU4MS3C36A3KZIYSGOF6B3PX4EJQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ): protocol: expected piece hash; context canceled; EOF
Dec 30 06:27:34.019166861 (590h58m33.890249906s) [noise=true , address=77.90.31.17:4773     , piece_id=NGPVC3N4UPXTO42JJIHGCQMMZU4MS3C36A3KZIYSGOF6B3PX4EJQ, seg_pos={0 0}, upload=518086]: Long tail cancellation due to optimal threshold
Dec 30 06:27:34.019372272 (590h58m33.890455318s) [noise=true , address=45.91.116.5:4298     , piece_id=XSQHRQH6UQGLUDFGDHXPNVJSTTRBSBDIEELEH4JC5GEEQ2M4KQ5A, seg_pos={0 0}, upload=518086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Dec 30 06:27:34.019400827 (590h58m33.890483862s) [noise=true , address=45.91.116.5:4298     , piece_id=XSQHRQH6UQGLUDFGDHXPNVJSTTRBSBDIEELEH4JC5GEEQ2M4KQ5A, seg_pos={0 0}, upload=518086]: Long tail cancellation due to optimal threshold
Dec 30 06:27:34.019477783 (590h58m33.890560838s) [noise=true , address=145.79.227.49:4339   , piece_id=2FQP72I6EC5DPC5B6B6NFRMPQT7QYWVZFOZFWZFQFMVRFO4GCT2A, seg_pos={0 0}, upload=518086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF
Dec 30 06:27:34.019487012 (590h58m33.890570057s) [noise=true , address=145.79.227.49:4339   , piece_id=2FQP72I6EC5DPC5B6B6NFRMPQT7QYWVZFOZFWZFQFMVRFO4GCT2A, seg_pos={0 0}, upload=518086]: Long tail cancellation due to optimal threshold
Dec 30 06:27:34.019511157 (590h58m33.890594192s) [seg_pos={0 0}, upload=518086]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 30 06:27:34.019579547 (590h58m33.890662582s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:27:34.019584216 (590h58m33.890667251s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:27:34.313480950 (590h58m34.184563985s) [upload=518086]: Done uploading segments...
Dec 30 06:27:34.313532458 (590h58m34.184615493s) [upload=518086]: Upload finished. err: <nil>
Duration: 5.752486749s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
5 out of 60 is failed (threshold=6) [..........................X...........X..............XX...X.]
duration: 
3.651357042s
trace: 
https://jaeger.dev.storj.io/trace/5d54da3b342a05d9
FAIL (2025-12-30 06:29:06 UTC) 
orbiter warning: context deadline exceeded
Duration: 3.65138742s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
18 out of 60 is failed (threshold=3) [X.XX.X..X..X..X..XX.......X..X......X....X...X..X.X.X.....X.]
duration: 
5.754500012s
trace: 
https://jaeger.dev.storj.io/trace/32a160c1d95b9ce1
FAIL (2025-12-30 06:28:48 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, Piece ID: KCDCBQ3JCAYUP26TFIRYKWXRQ5S7Q7JLWHY4XDB3FXU263DMGJRA) context deadline exceeded; piecestore: (Node ID: 1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, Piece ID: FCPRQ6RUSDVTSZIK6QFECZXB3T6FE6SWYH7DNEPICJW7QWFQK3EQ) context deadline exceeded
======LOGS======
Dec 30 06:27:31.479172017 (590h58m31.350255062s) [upload=518086]: Starting upload
Dec 30 06:27:31.479271175 (590h58m31.35035421s) [upload=518086]: Done starting upload
Dec 30 06:27:31.479402385 (590h58m31.35048542s) [upload=518086]: Uploading segments...
Dec 30 06:27:31.480006245 (590h58m31.35108929s) [upload=518086]: Got next segment. Inline: false
Dec 30 06:27:31.480174686 (590h58m31.351257721s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 30 06:27:31.480182702 (590h58m31.351265737s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 30 06:27:31.727629458 (590h58m31.598712493s) [seg_pos={0 0}, upload=518086]: Begin upload segment...
Dec 30 06:27:31.727685714 (590h58m31.598768759s) [seg_pos={0 0}, upload=518086]: Done begin upload segment.
Dec 30 06:27:31.727714169 (590h58m31.598797214s) [noise=true , address=77.90.31.21:4880     , piece_id=KCDCBQ3JCAYUP26TFIRYKWXRQ5S7Q7JLWHY4XDB3FXU263DMGJRA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.727728035 (590h58m31.59881108s) [noise=true , address=145.79.227.17:4972   , piece_id=3Q2WOCLVLN4546C4TTIHVDTEI2A3NXCAKTUD337OUDAN6KSW7AOQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.727802376 (590h58m31.598885421s) [noise=true , address=145.79.227.13:4804   , piece_id=FCZ4CYT6QT3IHOUC6R3H57NOOOMPDM3Z6FQ3TPOH4MR5QNZR7STQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.729155453 (590h58m31.600238488s) [noise=true , address=145.79.227.31:4799   , piece_id=SAIJ2QPHM5AGSRV62E7TD2A4YBETORXUCK5YUK4EZQUKN3TUF64Q, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.729401191 (590h58m31.600484236s) [noise=true , address=145.79.227.22:4509   , piece_id=7U75JX2T56P7KP3CJIOI24XXY3ED4VAEIMQNJSPHKS5W7YF3FXCA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.729850997 (590h58m31.600934032s) [noise=true , address=77.90.31.17:4773     , piece_id=NGPVC3N4UPXTO42JJIHGCQMMZU4MS3C36A3KZIYSGOF6B3PX4EJQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.730681368 (590h58m31.601764404s) [noise=true , address=145.79.227.45:4230   , piece_id=G64X3YOMTVLAIWQY5RIFY6K5EHDSUIZWCN2RDWK6LRVN3XUZBLKA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.731315676 (590h58m31.602398721s) [noise=true , address=145.79.227.27:4689   , piece_id=C2RDOQOUDRFIHSAPQIJNYFHZJFQUQWPLOKJUWLPNFMKCBA5H4XLA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.732192586 (590h58m31.603275631s) [noise=true , address=77.90.31.12:4590     , piece_id=FCPRQ6RUSDVTSZIK6QFECZXB3T6FE6SWYH7DNEPICJW7QWFQK3EQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.732619839 (590h58m31.603702884s) [noise=true , address=45.91.116.5:4298     , piece_id=XSQHRQH6UQGLUDFGDHXPNVJSTTRBSBDIEELEH4JC5GEEQ2M4KQ5A, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.733515114 (590h58m31.604598159s) [noise=true , address=77.90.31.13:4626     , piece_id=FWF4DQ4MPPWF2SKBBZLNGV7KWQ23BEA7UIS6FHDKINPB6YRAZARQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.734041075 (590h58m31.60512412s) [noise=true , address=145.79.227.20:4438   , piece_id=A623O6EK2ZQB6P37KJG6L7JYZICD5UY6JOYVKZ2BN2SMBUOMGMEA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.734770875 (590h58m31.60585392s) [noise=true , address=145.79.227.15:4873   , piece_id=33B56NW26Q23FA3A4AZ74ZZJYAAZ5M4ZSBDX5JE3M2BX4RVUI2YQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.735257321 (590h58m31.606340366s) [noise=true , address=145.79.227.52:4445   , piece_id=Z4HTRQZLIIBDE34RDPNDZR5BGASGJRJI4Q6DCEW4T3CHMI2PREBA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.736066582 (590h58m31.607149617s) [noise=true , address=145.79.227.7:4293    , piece_id=2WGGEODE53DFZXSKPINQLR7G6AMBEH7C3IEHX44WCRHWOTXWQT5A, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.737627635 (590h58m31.60871067s) [noise=true , address=145.79.227.49:4339   , piece_id=2FQP72I6EC5DPC5B6B6NFRMPQT7QYWVZFOZFWZFQFMVRFO4GCT2A, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:33.442981428 (590h58m33.314064473s) [upload=518086]: Next returned nil segment
Dec 30 06:27:33.443000564 (590h58m33.3140836s) [upload=518086]: Waiting for error group managing segments...
Dec 30 06:27:33.726010138 (590h58m33.597093173s) [noise=true , address=145.79.227.27:4689   , piece_id=C2RDOQOUDRFIHSAPQIJNYFHZJFQUQWPLOKJUWLPNFMKCBA5H4XLA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.726365194 (590h58m33.597448229s) [noise=true , address=145.79.227.45:4230   , piece_id=G64X3YOMTVLAIWQY5RIFY6K5EHDSUIZWCN2RDWK6LRVN3XUZBLKA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.731331761 (590h58m33.602414806s) [noise=true , address=145.79.227.52:4445   , piece_id=Z4HTRQZLIIBDE34RDPNDZR5BGASGJRJI4Q6DCEW4T3CHMI2PREBA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.732488724 (590h58m33.603571759s) [noise=true , address=145.79.227.13:4804   , piece_id=FCZ4CYT6QT3IHOUC6R3H57NOOOMPDM3Z6FQ3TPOH4MR5QNZR7STQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.742934164 (590h58m33.614017199s) [noise=true , address=145.79.227.15:4873   , piece_id=33B56NW26Q23FA3A4AZ74ZZJYAAZ5M4ZSBDX5JE3M2BX4RVUI2YQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.746966712 (590h58m33.618049747s) [noise=true , address=145.79.227.31:4799   , piece_id=SAIJ2QPHM5AGSRV62E7TD2A4YBETORXUCK5YUK4EZQUKN3TUF64Q, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.781208554 (590h58m33.652291599s) [noise=true , address=145.79.227.7:4293    , piece_id=2WGGEODE53DFZXSKPINQLR7G6AMBEH7C3IEHX44WCRHWOTXWQT5A, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.807290017 (590h58m33.678373052s) [noise=true , address=145.79.227.20:4438   , piece_id=A623O6EK2ZQB6P37KJG6L7JYZICD5UY6JOYVKZ2BN2SMBUOMGMEA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.809530753 (590h58m33.680613798s) [noise=true , address=145.79.227.22:4509   , piece_id=7U75JX2T56P7KP3CJIOI24XXY3ED4VAEIMQNJSPHKS5W7YF3FXCA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.812826569 (590h58m33.683909604s) [noise=true , address=145.79.227.17:4972   , piece_id=3Q2WOCLVLN4546C4TTIHVDTEI2A3NXCAKTUD337OUDAN6KSW7AOQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.900372450 (590h58m33.771455495s) [noise=true , address=77.90.31.13:4626     , piece_id=FWF4DQ4MPPWF2SKBBZLNGV7KWQ23BEA7UIS6FHDKINPB6YRAZARQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.916464471 (590h58m33.787547506s) [noise=true , address=77.90.31.21:4880     , piece_id=KCDCBQ3JCAYUP26TFIRYKWXRQ5S7Q7JLWHY4XDB3FXU263DMGJRA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:34.018888070 (590h58m33.889971115s) [noise=true , address=77.90.31.12:4590     , piece_id=FCPRQ6RUSDVTSZIK6QFECZXB3T6FE6SWYH7DNEPICJW7QWFQK3EQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:34.018913669 (590h58m33.889996714s) [seg_pos={0 0}, upload=518086]: Segment reached optimal threshold of 13 pieces.
Dec 30 06:27:34.019155831 (590h58m33.890238876s) [noise=true , address=77.90.31.17:4773     , piece_id=NGPVC3N4UPXTO42JJIHGCQMMZU4MS3C36A3KZIYSGOF6B3PX4EJQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ): protocol: expected piece hash; context canceled; EOF
Dec 30 06:27:34.019166861 (590h58m33.890249906s) [noise=true , address=77.90.31.17:4773     , piece_id=NGPVC3N4UPXTO42JJIHGCQMMZU4MS3C36A3KZIYSGOF6B3PX4EJQ, seg_pos={0 0}, upload=518086]: Long tail cancellation due to optimal threshold
Dec 30 06:27:34.019372272 (590h58m33.890455318s) [noise=true , address=45.91.116.5:4298     , piece_id=XSQHRQH6UQGLUDFGDHXPNVJSTTRBSBDIEELEH4JC5GEEQ2M4KQ5A, seg_pos={0 0}, upload=518086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Dec 30 06:27:34.019400827 (590h58m33.890483862s) [noise=true , address=45.91.116.5:4298     , piece_id=XSQHRQH6UQGLUDFGDHXPNVJSTTRBSBDIEELEH4JC5GEEQ2M4KQ5A, seg_pos={0 0}, upload=518086]: Long tail cancellation due to optimal threshold
Dec 30 06:27:34.019477783 (590h58m33.890560838s) [noise=true , address=145.79.227.49:4339   , piece_id=2FQP72I6EC5DPC5B6B6NFRMPQT7QYWVZFOZFWZFQFMVRFO4GCT2A, seg_pos={0 0}, upload=518086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF
Dec 30 06:27:34.019487012 (590h58m33.890570057s) [noise=true , address=145.79.227.49:4339   , piece_id=2FQP72I6EC5DPC5B6B6NFRMPQT7QYWVZFOZFWZFQFMVRFO4GCT2A, seg_pos={0 0}, upload=518086]: Long tail cancellation due to optimal threshold
Dec 30 06:27:34.019511157 (590h58m33.890594192s) [seg_pos={0 0}, upload=518086]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 30 06:27:34.019579547 (590h58m33.890662582s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:27:34.019584216 (590h58m33.890667251s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:27:34.313480950 (590h58m34.184563985s) [upload=518086]: Done uploading segments...
Dec 30 06:27:34.313532458 (590h58m34.184615493s) [upload=518086]: Upload finished. err: <nil>
Duration: 5.754529108s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [...........................X...X......X............X........]
duration: 
38.38131251s
trace: 
https://jaeger.dev.storj.io/trace/45b769fc71e13448
FAIL (2025-12-30 06:28:32 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
.577697683 (590h53m11.448780728s) [noise=true , address=193.149.164.143:4704 , piece_id=4T2IJIA6WHI5LMIUP5BLJLCD3GRY3A6PXR6G5OWJWUSYZT5ELGHQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578173528 (590h53m11.449256573s) [noise=true , address=64.49.13.27:4965     , piece_id=CO4O5F2IBZAAKBZBV3HWNNOXZOGLNNDPALWMQZ3DEM3MREASVFEA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578542992 (590h53m11.449626027s) [noise=true , address=77.90.31.15:4729     , piece_id=NVMXFEILHGT622IIPYYT4FFHC2WZLHMCZM4VT5WUPHRAPH3DX6TA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578846911 (590h53m11.449929946s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579458044 (590h53m11.450541089s) [noise=true , address=45.91.116.11:4150    , piece_id=E66IDHTJDLYLYJIOWMOIKOOWLXCUNCMBIQ7SQBAD3VTJF6VX5JLQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579891209 (590h53m11.450974245s) [noise=true , address=145.79.227.29:4945   , piece_id=SHL73IDEI54GRCWYNWHRUSJZZ4UUXREAX54DFJLTG5QPZCF5QKIQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579915535 (590h53m11.45099858s) [noise=true , address=145.79.227.30:4772   , piece_id=PVMD5DWRRPVARTSZ6O7HN6MUVTZUYWLYSNQR5GDMNKUJZGXMYPFQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580325466 (590h53m11.451408511s) [noise=true , address=77.90.31.12:4603     , piece_id=2I4L7F2WEGK5OSLODJSJ4672URBA7DUGXWZKTYB6ZNA2TQIGVXWA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580379599 (590h53m11.451462644s) [noise=true , address=77.90.31.14:4671     , piece_id=263TRISJ5ADFTX43ULSSGBAF2KMOXAPISJ56LLE53D74XOEMQ5EA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580692044 (590h53m11.451775089s) [noise=true , address=145.79.227.3:4175    , piece_id=UCV5WQNVWEAMEDBWDNXEVSQEGXPJE7KD6YSWC5A4WXYUKUCK4NLA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580857859 (590h53m11.451940894s) [noise=true , address=77.90.31.19:4860     , piece_id=U2MNFOAD7FHCDBE4FUYOROIP3P33ROJ7K75SF5Z747EFKFTF7RGA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581089210 (590h53m11.452172255s) [noise=true , address=145.79.227.44:4203   , piece_id=WHCKQ2FRLYAZE7Q6HYZNTS4EISVHZNAPDDKH34WN33ALK4MVK2EA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581351320 (590h53m11.452434355s) [noise=true , address=64.49.13.154:4928    , piece_id=SEVBZBMNGURP5TRUEBA4PHRSA6MNANVJUKINALJUWPQWBGKVYNTA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581457091 (590h53m11.452540126s) [noise=true , address=145.79.227.34:4909   , piece_id=3QSWTNR5LGUUAY3N5HJKSPL3TRQ6WO5F5OD4VTXKWHWUXUF7PVVQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581863144 (590h53m11.452946179s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.584010443 (590h53m11.455093478s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.585122791 (590h53m11.456205826s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:12.983305402 (590h53m12.854388447s) [upload=517998]: Next returned nil segment
Dec 30 06:22:12.983321313 (590h53m12.854404348s) [upload=517998]: Waiting for error group managing segments...
Dec 30 06:22:13.379703053 (590h53m13.250786088s) [noise=true , address=64.49.13.27:4965     , piece_id=CO4O5F2IBZAAKBZBV3HWNNOXZOGLNNDPALWMQZ3DEM3MREASVFEA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.418055622 (590h53m13.289138657s) [noise=true , address=145.79.227.3:4175    , piece_id=UCV5WQNVWEAMEDBWDNXEVSQEGXPJE7KD6YSWC5A4WXYUKUCK4NLA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.509034160 (590h53m13.380117205s) [noise=true , address=64.49.13.154:4928    , piece_id=SEVBZBMNGURP5TRUEBA4PHRSA6MNANVJUKINALJUWPQWBGKVYNTA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.642886154 (590h53m13.513969199s) [noise=true , address=77.90.31.14:4671     , piece_id=263TRISJ5ADFTX43ULSSGBAF2KMOXAPISJ56LLE53D74XOEMQ5EA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.788145520 (590h53m13.659228555s) [noise=true , address=77.90.31.12:4603     , piece_id=2I4L7F2WEGK5OSLODJSJ4672URBA7DUGXWZKTYB6ZNA2TQIGVXWA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.858878757 (590h53m13.729961792s) [noise=true , address=145.79.227.49:4369   , piece_id=XUEXGNJJIJ4DUBDNUV7CKF6J5JYHSLZAEPVGEDGBUBY42BIP4XEQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.879550569 (590h53m13.750633614s) [noise=true , address=145.79.227.34:4909   , piece_id=3QSWTNR5LGUUAY3N5HJKSPL3TRQ6WO5F5OD4VTXKWHWUXUF7PVVQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.940897723 (590h53m13.811980769s) [noise=true , address=77.90.31.19:4860     , piece_id=U2MNFOAD7FHCDBE4FUYOROIP3P33ROJ7K75SF5Z747EFKFTF7RGA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.989791936 (590h53m13.860874981s) [noise=true , address=45.91.116.11:4150    , piece_id=E66IDHTJDLYLYJIOWMOIKOOWLXCUNCMBIQ7SQBAD3VTJF6VX5JLQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.289516718 (590h53m14.160599753s) [noise=true , address=145.79.227.44:4203   , piece_id=WHCKQ2FRLYAZE7Q6HYZNTS4EISVHZNAPDDKH34WN33ALK4MVK2EA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.338651537 (590h53m14.209734582s) [noise=true , address=77.90.31.15:4729     , piece_id=NVMXFEILHGT622IIPYYT4FFHC2WZLHMCZM4VT5WUPHRAPH3DX6TA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.344145168 (590h53m14.215228213s) [noise=true , address=145.79.227.30:4772   , piece_id=PVMD5DWRRPVARTSZ6O7HN6MUVTZUYWLYSNQR5GDMNKUJZGXMYPFQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.667232847 (590h53m14.538315892s) [noise=true , address=193.149.164.143:4704 , piece_id=4T2IJIA6WHI5LMIUP5BLJLCD3GRY3A6PXR6G5OWJWUSYZT5ELGHQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.671388990 (590h53m14.542472025s) [noise=true , address=145.79.227.29:4945   , piece_id=SHL73IDEI54GRCWYNWHRUSJZZ4UUXREAX54DFJLTG5QPZCF5QKIQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.671415190 (590h53m14.542498226s) [seg_pos={0 0}, upload=517998]: Segment reached optimal threshold of 14 pieces.
Dec 30 06:22:14.671803600 (590h53m14.542886655s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hU1LwL2gX7rVnrNgzaBCYB37ziqf7s7aUgtF2Uc3antReQ6me): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.671814470 (590h53m14.542897525s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672014932 (590h53m14.543097977s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bhN3cR22QuAYihnnB3x3R97UZRWJ8sFPP8fjQcXZ7qhNZphZG): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672022637 (590h53m14.543105672s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672088933 (590h53m14.543171988s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672127677 (590h53m14.543210742s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672312739 (590h53m14.543395774s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSXWFiq27Dd2vBDD9vVnhDHVG59UmDKn3hVAhf3oyo5goVNaE): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672319953 (590h53m14.543402988s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672337847 (590h53m14.543420882s) [seg_pos={0 0}, upload=517998]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 30 06:22:14.672452947 (590h53m14.543535982s) [upload=517998]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:22:14.672458507 (590h53m14.543541542s) [upload=517998]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:22:14.981437069 (590h53m14.852520114s) [upload=517998]: Done uploading segments...
Dec 30 06:22:14.981456546 (590h53m14.852539581s) [upload=517998]: Upload finished. err: <nil>
Duration: 38.381340344s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [...........................................X................]
duration: 
7.070537175s
trace: 
https://jaeger.dev.storj.io/trace/deb96436003dee
FAIL (2025-12-30 06:28:25 UTC) 
orbiter warning: read tcp 188.166.225.170:52458->45.38.24.2:443: read: connection reset by peer
Duration: 7.070562564s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
5 out of 60 is failed (threshold=6) [...........................X...........X..............XX...X]
duration: 
5.001470301s
trace: 
https://jaeger.dev.storj.io/trace/5d54da3b342a05d9
FAIL (2025-12-30 06:28:16 UTC) 
orbiter warning: context deadline exceeded
Duration: 5.001495629s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip: 
18 out of 60 is failed (threshold=3) [.X.XX.X..X..X..X..XX.......X..X......X....X...X..X.X.X.....X]
duration: 
30.002926158s
trace: 
https://jaeger.dev.storj.io/trace/32a160c1d95b9ce1
FAIL (2025-12-30 06:28:00 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: piecestore: (Node ID: 1vQ1WWxf2CL7wRKRsKsRsWc4nkCbD1h8tRLsA3QYYAft91yUb, Piece ID: KCDCBQ3JCAYUP26TFIRYKWXRQ5S7Q7JLWHY4XDB3FXU263DMGJRA) context deadline exceeded; piecestore: (Node ID: 1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw, Piece ID: FCPRQ6RUSDVTSZIK6QFECZXB3T6FE6SWYH7DNEPICJW7QWFQK3EQ) context deadline exceeded
======LOGS======
Dec 30 06:27:31.479172017 (590h58m31.350255062s) [upload=518086]: Starting upload
Dec 30 06:27:31.479271175 (590h58m31.35035421s) [upload=518086]: Done starting upload
Dec 30 06:27:31.479402385 (590h58m31.35048542s) [upload=518086]: Uploading segments...
Dec 30 06:27:31.480006245 (590h58m31.35108929s) [upload=518086]: Got next segment. Inline: false
Dec 30 06:27:31.480174686 (590h58m31.351257721s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Dec 30 06:27:31.480182702 (590h58m31.351265737s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Dec 30 06:27:31.727629458 (590h58m31.598712493s) [seg_pos={0 0}, upload=518086]: Begin upload segment...
Dec 30 06:27:31.727685714 (590h58m31.598768759s) [seg_pos={0 0}, upload=518086]: Done begin upload segment.
Dec 30 06:27:31.727714169 (590h58m31.598797214s) [noise=true , address=77.90.31.21:4880     , piece_id=KCDCBQ3JCAYUP26TFIRYKWXRQ5S7Q7JLWHY4XDB3FXU263DMGJRA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.727728035 (590h58m31.59881108s) [noise=true , address=145.79.227.17:4972   , piece_id=3Q2WOCLVLN4546C4TTIHVDTEI2A3NXCAKTUD337OUDAN6KSW7AOQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.727802376 (590h58m31.598885421s) [noise=true , address=145.79.227.13:4804   , piece_id=FCZ4CYT6QT3IHOUC6R3H57NOOOMPDM3Z6FQ3TPOH4MR5QNZR7STQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.729155453 (590h58m31.600238488s) [noise=true , address=145.79.227.31:4799   , piece_id=SAIJ2QPHM5AGSRV62E7TD2A4YBETORXUCK5YUK4EZQUKN3TUF64Q, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.729401191 (590h58m31.600484236s) [noise=true , address=145.79.227.22:4509   , piece_id=7U75JX2T56P7KP3CJIOI24XXY3ED4VAEIMQNJSPHKS5W7YF3FXCA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.729850997 (590h58m31.600934032s) [noise=true , address=77.90.31.17:4773     , piece_id=NGPVC3N4UPXTO42JJIHGCQMMZU4MS3C36A3KZIYSGOF6B3PX4EJQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.730681368 (590h58m31.601764404s) [noise=true , address=145.79.227.45:4230   , piece_id=G64X3YOMTVLAIWQY5RIFY6K5EHDSUIZWCN2RDWK6LRVN3XUZBLKA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.731315676 (590h58m31.602398721s) [noise=true , address=145.79.227.27:4689   , piece_id=C2RDOQOUDRFIHSAPQIJNYFHZJFQUQWPLOKJUWLPNFMKCBA5H4XLA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.732192586 (590h58m31.603275631s) [noise=true , address=77.90.31.12:4590     , piece_id=FCPRQ6RUSDVTSZIK6QFECZXB3T6FE6SWYH7DNEPICJW7QWFQK3EQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.732619839 (590h58m31.603702884s) [noise=true , address=45.91.116.5:4298     , piece_id=XSQHRQH6UQGLUDFGDHXPNVJSTTRBSBDIEELEH4JC5GEEQ2M4KQ5A, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.733515114 (590h58m31.604598159s) [noise=true , address=77.90.31.13:4626     , piece_id=FWF4DQ4MPPWF2SKBBZLNGV7KWQ23BEA7UIS6FHDKINPB6YRAZARQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.734041075 (590h58m31.60512412s) [noise=true , address=145.79.227.20:4438   , piece_id=A623O6EK2ZQB6P37KJG6L7JYZICD5UY6JOYVKZ2BN2SMBUOMGMEA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.734770875 (590h58m31.60585392s) [noise=true , address=145.79.227.15:4873   , piece_id=33B56NW26Q23FA3A4AZ74ZZJYAAZ5M4ZSBDX5JE3M2BX4RVUI2YQ, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.735257321 (590h58m31.606340366s) [noise=true , address=145.79.227.52:4445   , piece_id=Z4HTRQZLIIBDE34RDPNDZR5BGASGJRJI4Q6DCEW4T3CHMI2PREBA, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.736066582 (590h58m31.607149617s) [noise=true , address=145.79.227.7:4293    , piece_id=2WGGEODE53DFZXSKPINQLR7G6AMBEH7C3IEHX44WCRHWOTXWQT5A, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:31.737627635 (590h58m31.60871067s) [noise=true , address=145.79.227.49:4339   , piece_id=2FQP72I6EC5DPC5B6B6NFRMPQT7QYWVZFOZFWZFQFMVRFO4GCT2A, seg_pos={0 0}, upload=518086]: Uploading piece...
Dec 30 06:27:33.442981428 (590h58m33.314064473s) [upload=518086]: Next returned nil segment
Dec 30 06:27:33.443000564 (590h58m33.3140836s) [upload=518086]: Waiting for error group managing segments...
Dec 30 06:27:33.726010138 (590h58m33.597093173s) [noise=true , address=145.79.227.27:4689   , piece_id=C2RDOQOUDRFIHSAPQIJNYFHZJFQUQWPLOKJUWLPNFMKCBA5H4XLA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.726365194 (590h58m33.597448229s) [noise=true , address=145.79.227.45:4230   , piece_id=G64X3YOMTVLAIWQY5RIFY6K5EHDSUIZWCN2RDWK6LRVN3XUZBLKA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.731331761 (590h58m33.602414806s) [noise=true , address=145.79.227.52:4445   , piece_id=Z4HTRQZLIIBDE34RDPNDZR5BGASGJRJI4Q6DCEW4T3CHMI2PREBA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.732488724 (590h58m33.603571759s) [noise=true , address=145.79.227.13:4804   , piece_id=FCZ4CYT6QT3IHOUC6R3H57NOOOMPDM3Z6FQ3TPOH4MR5QNZR7STQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.742934164 (590h58m33.614017199s) [noise=true , address=145.79.227.15:4873   , piece_id=33B56NW26Q23FA3A4AZ74ZZJYAAZ5M4ZSBDX5JE3M2BX4RVUI2YQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.746966712 (590h58m33.618049747s) [noise=true , address=145.79.227.31:4799   , piece_id=SAIJ2QPHM5AGSRV62E7TD2A4YBETORXUCK5YUK4EZQUKN3TUF64Q, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.781208554 (590h58m33.652291599s) [noise=true , address=145.79.227.7:4293    , piece_id=2WGGEODE53DFZXSKPINQLR7G6AMBEH7C3IEHX44WCRHWOTXWQT5A, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.807290017 (590h58m33.678373052s) [noise=true , address=145.79.227.20:4438   , piece_id=A623O6EK2ZQB6P37KJG6L7JYZICD5UY6JOYVKZ2BN2SMBUOMGMEA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.809530753 (590h58m33.680613798s) [noise=true , address=145.79.227.22:4509   , piece_id=7U75JX2T56P7KP3CJIOI24XXY3ED4VAEIMQNJSPHKS5W7YF3FXCA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.812826569 (590h58m33.683909604s) [noise=true , address=145.79.227.17:4972   , piece_id=3Q2WOCLVLN4546C4TTIHVDTEI2A3NXCAKTUD337OUDAN6KSW7AOQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.900372450 (590h58m33.771455495s) [noise=true , address=77.90.31.13:4626     , piece_id=FWF4DQ4MPPWF2SKBBZLNGV7KWQ23BEA7UIS6FHDKINPB6YRAZARQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:33.916464471 (590h58m33.787547506s) [noise=true , address=77.90.31.21:4880     , piece_id=KCDCBQ3JCAYUP26TFIRYKWXRQ5S7Q7JLWHY4XDB3FXU263DMGJRA, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:34.018888070 (590h58m33.889971115s) [noise=true , address=77.90.31.12:4590     , piece_id=FCPRQ6RUSDVTSZIK6QFECZXB3T6FE6SWYH7DNEPICJW7QWFQK3EQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: <nil>
Dec 30 06:27:34.018913669 (590h58m33.889996714s) [seg_pos={0 0}, upload=518086]: Segment reached optimal threshold of 13 pieces.
Dec 30 06:27:34.019155831 (590h58m33.890238876s) [noise=true , address=77.90.31.17:4773     , piece_id=NGPVC3N4UPXTO42JJIHGCQMMZU4MS3C36A3KZIYSGOF6B3PX4EJQ, seg_pos={0 0}, upload=518086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mpRyPuesFpUqZvgaXpQ2HDm8ccFRBJiw1QBfSN9WrRm8QSKdZ): protocol: expected piece hash; context canceled; EOF
Dec 30 06:27:34.019166861 (590h58m33.890249906s) [noise=true , address=77.90.31.17:4773     , piece_id=NGPVC3N4UPXTO42JJIHGCQMMZU4MS3C36A3KZIYSGOF6B3PX4EJQ, seg_pos={0 0}, upload=518086]: Long tail cancellation due to optimal threshold
Dec 30 06:27:34.019372272 (590h58m33.890455318s) [noise=true , address=45.91.116.5:4298     , piece_id=XSQHRQH6UQGLUDFGDHXPNVJSTTRBSBDIEELEH4JC5GEEQ2M4KQ5A, seg_pos={0 0}, upload=518086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Dec 30 06:27:34.019400827 (590h58m33.890483862s) [noise=true , address=45.91.116.5:4298     , piece_id=XSQHRQH6UQGLUDFGDHXPNVJSTTRBSBDIEELEH4JC5GEEQ2M4KQ5A, seg_pos={0 0}, upload=518086]: Long tail cancellation due to optimal threshold
Dec 30 06:27:34.019477783 (590h58m33.890560838s) [noise=true , address=145.79.227.49:4339   , piece_id=2FQP72I6EC5DPC5B6B6NFRMPQT7QYWVZFOZFWZFQFMVRFO4GCT2A, seg_pos={0 0}, upload=518086]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R): protocol: expected piece hash; context canceled; EOF
Dec 30 06:27:34.019487012 (590h58m33.890570057s) [noise=true , address=145.79.227.49:4339   , piece_id=2FQP72I6EC5DPC5B6B6NFRMPQT7QYWVZFOZFWZFQFMVRFO4GCT2A, seg_pos={0 0}, upload=518086]: Long tail cancellation due to optimal threshold
Dec 30 06:27:34.019511157 (590h58m33.890594192s) [seg_pos={0 0}, upload=518086]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Dec 30 06:27:34.019579547 (590h58m33.890662582s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:27:34.019584216 (590h58m33.890667251s) [upload=518086]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:27:34.313480950 (590h58m34.184563985s) [upload=518086]: Done uploading segments...
Dec 30 06:27:34.313532458 (590h58m34.184615493s) [upload=518086]: Upload finished. err: <nil>
Duration: 30.00294782s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [............................................X...............]
duration: 
6.139136307s
trace: 
https://jaeger.dev.storj.io/trace/deb96436003dee
FAIL (2025-12-30 06:27:48 UTC) 
orbiter warning: read tcp 188.166.225.170:52458->45.38.24.2:443: read: connection reset by peer
Duration: 6.139161534s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails)
antiblip: 
4 out of 60 is failed (threshold=6) [............................X...........X..............XX...]
duration: 
3.497094388s
trace: 
https://jaeger.dev.storj.io/trace/2e49128c973fa898
FAIL (2025-12-30 06:27:35 UTC) 
orbiter warning: context deadline exceeded
Duration: 3.497158338s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip: 
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration: 
5.994608702s
trace: 
https://jaeger.dev.storj.io/trace/deb96436003dee
FAIL (2025-12-30 06:27:31 UTC) 
orbiter warning: read tcp 188.166.225.170:52458->45.38.24.2:443: read: connection reset by peer
Duration: 5.99463882s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)
antiblip: 
4 out of 60 is failed (threshold=3) [............................X...X......X............X.......]
duration: 
15.367717075s
trace: 
https://jaeger.dev.storj.io/trace/45b769fc71e13448
FAIL (2025-12-30 06:27:19 UTC) 
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
.577697683 (590h53m11.448780728s) [noise=true , address=193.149.164.143:4704 , piece_id=4T2IJIA6WHI5LMIUP5BLJLCD3GRY3A6PXR6G5OWJWUSYZT5ELGHQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578173528 (590h53m11.449256573s) [noise=true , address=64.49.13.27:4965     , piece_id=CO4O5F2IBZAAKBZBV3HWNNOXZOGLNNDPALWMQZ3DEM3MREASVFEA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578542992 (590h53m11.449626027s) [noise=true , address=77.90.31.15:4729     , piece_id=NVMXFEILHGT622IIPYYT4FFHC2WZLHMCZM4VT5WUPHRAPH3DX6TA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.578846911 (590h53m11.449929946s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579458044 (590h53m11.450541089s) [noise=true , address=45.91.116.11:4150    , piece_id=E66IDHTJDLYLYJIOWMOIKOOWLXCUNCMBIQ7SQBAD3VTJF6VX5JLQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579891209 (590h53m11.450974245s) [noise=true , address=145.79.227.29:4945   , piece_id=SHL73IDEI54GRCWYNWHRUSJZZ4UUXREAX54DFJLTG5QPZCF5QKIQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.579915535 (590h53m11.45099858s) [noise=true , address=145.79.227.30:4772   , piece_id=PVMD5DWRRPVARTSZ6O7HN6MUVTZUYWLYSNQR5GDMNKUJZGXMYPFQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580325466 (590h53m11.451408511s) [noise=true , address=77.90.31.12:4603     , piece_id=2I4L7F2WEGK5OSLODJSJ4672URBA7DUGXWZKTYB6ZNA2TQIGVXWA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580379599 (590h53m11.451462644s) [noise=true , address=77.90.31.14:4671     , piece_id=263TRISJ5ADFTX43ULSSGBAF2KMOXAPISJ56LLE53D74XOEMQ5EA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580692044 (590h53m11.451775089s) [noise=true , address=145.79.227.3:4175    , piece_id=UCV5WQNVWEAMEDBWDNXEVSQEGXPJE7KD6YSWC5A4WXYUKUCK4NLA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.580857859 (590h53m11.451940894s) [noise=true , address=77.90.31.19:4860     , piece_id=U2MNFOAD7FHCDBE4FUYOROIP3P33ROJ7K75SF5Z747EFKFTF7RGA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581089210 (590h53m11.452172255s) [noise=true , address=145.79.227.44:4203   , piece_id=WHCKQ2FRLYAZE7Q6HYZNTS4EISVHZNAPDDKH34WN33ALK4MVK2EA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581351320 (590h53m11.452434355s) [noise=true , address=64.49.13.154:4928    , piece_id=SEVBZBMNGURP5TRUEBA4PHRSA6MNANVJUKINALJUWPQWBGKVYNTA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581457091 (590h53m11.452540126s) [noise=true , address=145.79.227.34:4909   , piece_id=3QSWTNR5LGUUAY3N5HJKSPL3TRQ6WO5F5OD4VTXKWHWUXUF7PVVQ, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.581863144 (590h53m11.452946179s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.584010443 (590h53m11.455093478s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:11.585122791 (590h53m11.456205826s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Uploading piece...
Dec 30 06:22:12.983305402 (590h53m12.854388447s) [upload=517998]: Next returned nil segment
Dec 30 06:22:12.983321313 (590h53m12.854404348s) [upload=517998]: Waiting for error group managing segments...
Dec 30 06:22:13.379703053 (590h53m13.250786088s) [noise=true , address=64.49.13.27:4965     , piece_id=CO4O5F2IBZAAKBZBV3HWNNOXZOGLNNDPALWMQZ3DEM3MREASVFEA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.418055622 (590h53m13.289138657s) [noise=true , address=145.79.227.3:4175    , piece_id=UCV5WQNVWEAMEDBWDNXEVSQEGXPJE7KD6YSWC5A4WXYUKUCK4NLA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.509034160 (590h53m13.380117205s) [noise=true , address=64.49.13.154:4928    , piece_id=SEVBZBMNGURP5TRUEBA4PHRSA6MNANVJUKINALJUWPQWBGKVYNTA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.642886154 (590h53m13.513969199s) [noise=true , address=77.90.31.14:4671     , piece_id=263TRISJ5ADFTX43ULSSGBAF2KMOXAPISJ56LLE53D74XOEMQ5EA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.788145520 (590h53m13.659228555s) [noise=true , address=77.90.31.12:4603     , piece_id=2I4L7F2WEGK5OSLODJSJ4672URBA7DUGXWZKTYB6ZNA2TQIGVXWA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.858878757 (590h53m13.729961792s) [noise=true , address=145.79.227.49:4369   , piece_id=XUEXGNJJIJ4DUBDNUV7CKF6J5JYHSLZAEPVGEDGBUBY42BIP4XEQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.879550569 (590h53m13.750633614s) [noise=true , address=145.79.227.34:4909   , piece_id=3QSWTNR5LGUUAY3N5HJKSPL3TRQ6WO5F5OD4VTXKWHWUXUF7PVVQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.940897723 (590h53m13.811980769s) [noise=true , address=77.90.31.19:4860     , piece_id=U2MNFOAD7FHCDBE4FUYOROIP3P33ROJ7K75SF5Z747EFKFTF7RGA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:13.989791936 (590h53m13.860874981s) [noise=true , address=45.91.116.11:4150    , piece_id=E66IDHTJDLYLYJIOWMOIKOOWLXCUNCMBIQ7SQBAD3VTJF6VX5JLQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.289516718 (590h53m14.160599753s) [noise=true , address=145.79.227.44:4203   , piece_id=WHCKQ2FRLYAZE7Q6HYZNTS4EISVHZNAPDDKH34WN33ALK4MVK2EA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.338651537 (590h53m14.209734582s) [noise=true , address=77.90.31.15:4729     , piece_id=NVMXFEILHGT622IIPYYT4FFHC2WZLHMCZM4VT5WUPHRAPH3DX6TA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.344145168 (590h53m14.215228213s) [noise=true , address=145.79.227.30:4772   , piece_id=PVMD5DWRRPVARTSZ6O7HN6MUVTZUYWLYSNQR5GDMNKUJZGXMYPFQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.667232847 (590h53m14.538315892s) [noise=true , address=193.149.164.143:4704 , piece_id=4T2IJIA6WHI5LMIUP5BLJLCD3GRY3A6PXR6G5OWJWUSYZT5ELGHQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.671388990 (590h53m14.542472025s) [noise=true , address=145.79.227.29:4945   , piece_id=SHL73IDEI54GRCWYNWHRUSJZZ4UUXREAX54DFJLTG5QPZCF5QKIQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: <nil>
Dec 30 06:22:14.671415190 (590h53m14.542498226s) [seg_pos={0 0}, upload=517998]: Segment reached optimal threshold of 14 pieces.
Dec 30 06:22:14.671803600 (590h53m14.542886655s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12hU1LwL2gX7rVnrNgzaBCYB37ziqf7s7aUgtF2Uc3antReQ6me): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.671814470 (590h53m14.542897525s) [noise=true , address=145.79.227.40:4070   , piece_id=YOAGDXNN4TTCK35LLQDSP24BOWLZXGNSQU7WMKEEVVMPXDVI74JA, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672014932 (590h53m14.543097977s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1bhN3cR22QuAYihnnB3x3R97UZRWJ8sFPP8fjQcXZ7qhNZphZG): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672022637 (590h53m14.543105672s) [noise=true , address=145.79.227.43:4177   , piece_id=YM37ZI3WNZ7SXGTFC224TOVVTHYNFIPRQB2TFLEZ735RNZE553FQ, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672088933 (590h53m14.543171988s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1mMBjg1b4MqTZPE5NpNNMYDzmsHqWYotE5jBNmZLyA5FyYLZRp): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672127677 (590h53m14.543210742s) [noise=true , address=145.79.227.33:4881   , piece_id=EX66JF7U7A4ZSRWJMP4MCLQRPW2ZZFZFIUNV72XZXU7E5O3KWX3A, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672312739 (590h53m14.543395774s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1xSXWFiq27Dd2vBDD9vVnhDHVG59UmDKn3hVAhf3oyo5goVNaE): protocol: expected piece hash; context canceled; EOF
Dec 30 06:22:14.672319953 (590h53m14.543402988s) [noise=true , address=45.91.116.14:4217    , piece_id=L4MAHTGKTNWBSN3YTB74E3DBJWVMA3DPU57MQK5FNK35DXRZ6AIA, seg_pos={0 0}, upload=517998]: Long tail cancellation due to optimal threshold
Dec 30 06:22:14.672337847 (590h53m14.543420882s) [seg_pos={0 0}, upload=517998]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Dec 30 06:22:14.672452947 (590h53m14.543535982s) [upload=517998]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Dec 30 06:22:14.672458507 (590h53m14.543541542s) [upload=517998]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Dec 30 06:22:14.981437069 (590h53m14.852520114s) [upload=517998]: Done uploading segments...
Dec 30 06:22:14.981456546 (590h53m14.852539581s) [upload=517998]: Upload finished. err: <nil>
Duration: 15.367744707s core uplink us-select-1 us1-placement-20