Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure

Orbiter Check History

Showing 50 of 896132 reports (Page 15534 of 17923)
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
6 out of 60 is failed (threshold=3) [......X.......X..................X........X.....X..X........]
duration:
1.924520006s
FAIL (2025-08-14 23:42:19 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 14 23:37:43.299217097 (150h11m37.730297228s) [upload=156226]: Starting upload
Aug 14 23:37:43.299264879 (150h11m37.73034501s) [upload=156226]: Done starting upload
Aug 14 23:37:43.299312279 (150h11m37.7303924s) [upload=156226]: Uploading segments...
Aug 14 23:37:43.299372313 (150h11m37.730452435s) [upload=156226]: Got next segment. Inline: true
Aug 14 23:37:43.299376893 (150h11m37.730457024s) [upload=156226]: Waiting for error group managing segments...
Aug 14 23:37:43.299413222 (150h11m37.730493343s) [upload=156226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:37:43.299418222 (150h11m37.730498353s) [upload=156226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 23:37:43.299422329 (150h11m37.73050246s) [upload=156226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:37:43.639617167 (150h11m38.070697298s) [upload=156226]: Done uploading segments...
Aug 14 23:37:43.639634600 (150h11m38.070714731s) [upload=156226]: Upload finished. err: <nil>
Duration: 1.924544233s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
6 out of 60 is failed (threshold=3) [.......X.......X..................X........X.....X..X.......]
duration:
2.038154891s
FAIL (2025-08-14 23:42:00 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 14 23:37:43.299217097 (150h11m37.730297228s) [upload=156226]: Starting upload
Aug 14 23:37:43.299264879 (150h11m37.73034501s) [upload=156226]: Done starting upload
Aug 14 23:37:43.299312279 (150h11m37.7303924s) [upload=156226]: Uploading segments...
Aug 14 23:37:43.299372313 (150h11m37.730452435s) [upload=156226]: Got next segment. Inline: true
Aug 14 23:37:43.299376893 (150h11m37.730457024s) [upload=156226]: Waiting for error group managing segments...
Aug 14 23:37:43.299413222 (150h11m37.730493343s) [upload=156226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:37:43.299418222 (150h11m37.730498353s) [upload=156226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 23:37:43.299422329 (150h11m37.73050246s) [upload=156226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:37:43.639617167 (150h11m38.070697298s) [upload=156226]: Done uploading segments...
Aug 14 23:37:43.639634600 (150h11m38.070714731s) [upload=156226]: Upload finished. err: <nil>
Duration: 2.038181894s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
4 out of 60 is failed (threshold=3) [................X.............X....X..X.....................]
duration:
6.441057878s
FAIL (2025-08-14 23:41:38 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 23:25:23.865082679 (149h59m18.29616281s) [upload=156000]: Starting upload
Aug 14 23:25:23.865134989 (149h59m18.29621512s) [upload=156000]: Done starting upload
Aug 14 23:25:23.865241213 (149h59m18.296321344s) [upload=156000]: Uploading segments...
Aug 14 23:25:23.865391189 (149h59m18.29647132s) [upload=156000]: Got next segment. Inline: false
Aug 14 23:25:23.865430435 (149h59m18.296510566s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:25:23.865434993 (149h59m18.296515114s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 23:25:24.427593929 (149h59m18.85867406s) [seg_pos={0 0}, upload=156000]: Begin upload segment...
Aug 14 23:25:24.427659504 (149h59m18.858739635s) [seg_pos={0 0}, upload=156000]: Done begin upload segment.
Aug 14 23:25:24.427681045 (149h59m18.858761167s) [noise=true , address=77.90.31.12:4594     , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.427712806 (149h59m18.858792937s) [noise=true , address=77.90.31.18:4809     , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428058338 (149h59m18.859138469s) [noise=true , address=79.127.219.48:4076   , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428321260 (149h59m18.859401391s) [noise=true , address=104.36.82.3:4796     , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428582981 (149h59m18.859663112s) [noise=true , address=104.36.82.62:4436    , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428780519 (149h59m18.85986064s) [noise=true , address=104.36.82.44:4889    , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428928291 (149h59m18.860008423s) [noise=true , address=104.36.82.34:4570    , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429112424 (149h59m18.860192555s) [noise=true , address=104.36.82.21:4494    , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429144285 (149h59m18.860224406s) [noise=true , address=77.90.31.19:4851     , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429170645 (149h59m18.860250776s) [noise=true , address=104.36.82.15:4290    , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429384725 (149h59m18.860464856s) [noise=true , address=104.36.82.38:4707    , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429432106 (149h59m18.860512227s) [noise=true , address=79.127.201.215:4347  , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429593535 (149h59m18.860673666s) [noise=true , address=104.36.82.46:4495    , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429704938 (149h59m18.860785059s) [noise=true , address=104.36.82.60:4365    , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429992358 (149h59m18.861072489s) [noise=true , address=104.36.82.51:4063    , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430255922 (149h59m18.861336053s) [noise=true , address=77.90.31.21:4891     , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430549503 (149h59m18.861629624s) [noise=true , address=104.36.82.59:4302    , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430809041 (149h59m18.861889172s) [noise=true , address=45.91.116.9:4266     , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:25.923497549 (149h59m20.35457768s) [upload=156000]: Next returned nil segment
Aug 14 23:25:25.923507829 (149h59m20.35458795s) [upload=156000]: Waiting for error group managing segments...
Aug 14 23:25:26.337042342 (149h59m20.768122463s) [noise=true , address=79.127.219.48:4076   , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.350688071 (149h59m20.781768202s) [noise=true , address=77.90.31.21:4891     , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.367283975 (149h59m20.798364106s) [noise=true , address=104.36.82.59:4302    , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.392847758 (149h59m20.823927889s) [noise=true , address=79.127.201.215:4347  , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.476671684 (149h59m20.907751805s) [noise=true , address=104.36.82.34:4570    , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.477883863 (149h59m20.908963994s) [noise=true , address=104.36.82.51:4063    , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.495071439 (149h59m20.92615157s) [noise=true , address=77.90.31.12:4594     , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.499490865 (149h59m20.930571016s) [noise=true , address=104.36.82.3:4796     , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.534749478 (149h59m20.965829599s) [noise=true , address=104.36.82.62:4436    , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.567397536 (149h59m20.998477667s) [noise=true , address=77.90.31.19:4851     , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.581324884 (149h59m21.012405015s) [noise=true , address=104.36.82.60:4365    , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.600511545 (149h59m21.031591676s) [noise=true , address=104.36.82.46:4495    , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.602312732 (149h59m21.033392863s) [noise=true , address=77.90.31.18:4809     , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.614279168 (149h59m21.045359299s) [noise=true , address=45.91.116.9:4266     , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.614295228 (149h59m21.045375359s) [seg_pos={0 0}, upload=156000]: Segment reached optimal threshold of 14 pieces.
Aug 14 23:25:26.614385762 (149h59m21.045465893s) [noise=true , address=104.36.82.44:4889    , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PCtJRFHPHi1dHJNcRnGZg8HZPQDfo5L3aw6DgVnUzVUz92Kyv): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614431238 (149h59m21.045511369s) [noise=true , address=104.36.82.15:4290    , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FmG5i2o4BwJmdL9u2tqKGmTAUErivGEe63TbfDTPpBdELozfz): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614559364 (149h59m21.045639485s) [noise=true , address=104.36.82.21:4494    , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sRaMuQG18B5SfPpzxp5VWjrwe38SS38g4askmbURxU9tepJHi): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614656349 (149h59m21.04573647s) [noise=true , address=104.36.82.38:4707    , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:43504->104.36.82.38:4707: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 23:25:26.614687790 (149h59m21.045767921s) [seg_pos={0 0}, upload=156000]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 23:25:26.614759687 (149h59m21.045839818s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 23:25:26.614763564 (149h59m21.045843695s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:25:27.350074072 (149h59m21.781154203s) [upload=156000]: Done uploading segments...
Aug 14 23:25:27.350115130 (149h59m21.781195261s) [upload=156000]: Upload finished. err: <nil>
Duration: 6.441081905s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
6 out of 60 is failed (threshold=3) [........X.......X..................X........X.....X..X......]
duration:
2.203398087s
FAIL (2025-08-14 23:41:27 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 14 23:37:43.299217097 (150h11m37.730297228s) [upload=156226]: Starting upload
Aug 14 23:37:43.299264879 (150h11m37.73034501s) [upload=156226]: Done starting upload
Aug 14 23:37:43.299312279 (150h11m37.7303924s) [upload=156226]: Uploading segments...
Aug 14 23:37:43.299372313 (150h11m37.730452435s) [upload=156226]: Got next segment. Inline: true
Aug 14 23:37:43.299376893 (150h11m37.730457024s) [upload=156226]: Waiting for error group managing segments...
Aug 14 23:37:43.299413222 (150h11m37.730493343s) [upload=156226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:37:43.299418222 (150h11m37.730498353s) [upload=156226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 23:37:43.299422329 (150h11m37.73050246s) [upload=156226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:37:43.639617167 (150h11m38.070697298s) [upload=156226]: Done uploading segments...
Aug 14 23:37:43.639634600 (150h11m38.070714731s) [upload=156226]: Upload finished. err: <nil>
Duration: 2.203423123s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
4 out of 60 is failed (threshold=3) [.................X.............X....X..X....................]
duration:
6.179797635s
FAIL (2025-08-14 23:40:57 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 23:25:23.865082679 (149h59m18.29616281s) [upload=156000]: Starting upload
Aug 14 23:25:23.865134989 (149h59m18.29621512s) [upload=156000]: Done starting upload
Aug 14 23:25:23.865241213 (149h59m18.296321344s) [upload=156000]: Uploading segments...
Aug 14 23:25:23.865391189 (149h59m18.29647132s) [upload=156000]: Got next segment. Inline: false
Aug 14 23:25:23.865430435 (149h59m18.296510566s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:25:23.865434993 (149h59m18.296515114s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 23:25:24.427593929 (149h59m18.85867406s) [seg_pos={0 0}, upload=156000]: Begin upload segment...
Aug 14 23:25:24.427659504 (149h59m18.858739635s) [seg_pos={0 0}, upload=156000]: Done begin upload segment.
Aug 14 23:25:24.427681045 (149h59m18.858761167s) [noise=true , address=77.90.31.12:4594     , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.427712806 (149h59m18.858792937s) [noise=true , address=77.90.31.18:4809     , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428058338 (149h59m18.859138469s) [noise=true , address=79.127.219.48:4076   , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428321260 (149h59m18.859401391s) [noise=true , address=104.36.82.3:4796     , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428582981 (149h59m18.859663112s) [noise=true , address=104.36.82.62:4436    , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428780519 (149h59m18.85986064s) [noise=true , address=104.36.82.44:4889    , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428928291 (149h59m18.860008423s) [noise=true , address=104.36.82.34:4570    , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429112424 (149h59m18.860192555s) [noise=true , address=104.36.82.21:4494    , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429144285 (149h59m18.860224406s) [noise=true , address=77.90.31.19:4851     , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429170645 (149h59m18.860250776s) [noise=true , address=104.36.82.15:4290    , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429384725 (149h59m18.860464856s) [noise=true , address=104.36.82.38:4707    , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429432106 (149h59m18.860512227s) [noise=true , address=79.127.201.215:4347  , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429593535 (149h59m18.860673666s) [noise=true , address=104.36.82.46:4495    , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429704938 (149h59m18.860785059s) [noise=true , address=104.36.82.60:4365    , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429992358 (149h59m18.861072489s) [noise=true , address=104.36.82.51:4063    , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430255922 (149h59m18.861336053s) [noise=true , address=77.90.31.21:4891     , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430549503 (149h59m18.861629624s) [noise=true , address=104.36.82.59:4302    , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430809041 (149h59m18.861889172s) [noise=true , address=45.91.116.9:4266     , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:25.923497549 (149h59m20.35457768s) [upload=156000]: Next returned nil segment
Aug 14 23:25:25.923507829 (149h59m20.35458795s) [upload=156000]: Waiting for error group managing segments...
Aug 14 23:25:26.337042342 (149h59m20.768122463s) [noise=true , address=79.127.219.48:4076   , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.350688071 (149h59m20.781768202s) [noise=true , address=77.90.31.21:4891     , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.367283975 (149h59m20.798364106s) [noise=true , address=104.36.82.59:4302    , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.392847758 (149h59m20.823927889s) [noise=true , address=79.127.201.215:4347  , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.476671684 (149h59m20.907751805s) [noise=true , address=104.36.82.34:4570    , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.477883863 (149h59m20.908963994s) [noise=true , address=104.36.82.51:4063    , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.495071439 (149h59m20.92615157s) [noise=true , address=77.90.31.12:4594     , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.499490865 (149h59m20.930571016s) [noise=true , address=104.36.82.3:4796     , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.534749478 (149h59m20.965829599s) [noise=true , address=104.36.82.62:4436    , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.567397536 (149h59m20.998477667s) [noise=true , address=77.90.31.19:4851     , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.581324884 (149h59m21.012405015s) [noise=true , address=104.36.82.60:4365    , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.600511545 (149h59m21.031591676s) [noise=true , address=104.36.82.46:4495    , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.602312732 (149h59m21.033392863s) [noise=true , address=77.90.31.18:4809     , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.614279168 (149h59m21.045359299s) [noise=true , address=45.91.116.9:4266     , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.614295228 (149h59m21.045375359s) [seg_pos={0 0}, upload=156000]: Segment reached optimal threshold of 14 pieces.
Aug 14 23:25:26.614385762 (149h59m21.045465893s) [noise=true , address=104.36.82.44:4889    , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PCtJRFHPHi1dHJNcRnGZg8HZPQDfo5L3aw6DgVnUzVUz92Kyv): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614431238 (149h59m21.045511369s) [noise=true , address=104.36.82.15:4290    , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FmG5i2o4BwJmdL9u2tqKGmTAUErivGEe63TbfDTPpBdELozfz): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614559364 (149h59m21.045639485s) [noise=true , address=104.36.82.21:4494    , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sRaMuQG18B5SfPpzxp5VWjrwe38SS38g4askmbURxU9tepJHi): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614656349 (149h59m21.04573647s) [noise=true , address=104.36.82.38:4707    , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:43504->104.36.82.38:4707: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 23:25:26.614687790 (149h59m21.045767921s) [seg_pos={0 0}, upload=156000]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 23:25:26.614759687 (149h59m21.045839818s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 23:25:26.614763564 (149h59m21.045843695s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:25:27.350074072 (149h59m21.781154203s) [upload=156000]: Done uploading segments...
Aug 14 23:25:27.350115130 (149h59m21.781195261s) [upload=156000]: Upload finished. err: <nil>
Duration: 6.179823915s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
6 out of 60 is failed (threshold=3) [.........X.......X..................X........X.....X..X.....]
duration:
2.600968143s
FAIL (2025-08-14 23:40:45 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 14 23:37:43.299217097 (150h11m37.730297228s) [upload=156226]: Starting upload
Aug 14 23:37:43.299264879 (150h11m37.73034501s) [upload=156226]: Done starting upload
Aug 14 23:37:43.299312279 (150h11m37.7303924s) [upload=156226]: Uploading segments...
Aug 14 23:37:43.299372313 (150h11m37.730452435s) [upload=156226]: Got next segment. Inline: true
Aug 14 23:37:43.299376893 (150h11m37.730457024s) [upload=156226]: Waiting for error group managing segments...
Aug 14 23:37:43.299413222 (150h11m37.730493343s) [upload=156226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:37:43.299418222 (150h11m37.730498353s) [upload=156226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 23:37:43.299422329 (150h11m37.73050246s) [upload=156226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:37:43.639617167 (150h11m38.070697298s) [upload=156226]: Done uploading segments...
Aug 14 23:37:43.639634600 (150h11m38.070714731s) [upload=156226]: Upload finished. err: <nil>
Duration: 2.600994524s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
4 out of 60 is failed (threshold=3) [..................X.............X....X..X...................]
duration:
7.039302482s
FAIL (2025-08-14 23:40:20 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 23:25:23.865082679 (149h59m18.29616281s) [upload=156000]: Starting upload
Aug 14 23:25:23.865134989 (149h59m18.29621512s) [upload=156000]: Done starting upload
Aug 14 23:25:23.865241213 (149h59m18.296321344s) [upload=156000]: Uploading segments...
Aug 14 23:25:23.865391189 (149h59m18.29647132s) [upload=156000]: Got next segment. Inline: false
Aug 14 23:25:23.865430435 (149h59m18.296510566s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:25:23.865434993 (149h59m18.296515114s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 23:25:24.427593929 (149h59m18.85867406s) [seg_pos={0 0}, upload=156000]: Begin upload segment...
Aug 14 23:25:24.427659504 (149h59m18.858739635s) [seg_pos={0 0}, upload=156000]: Done begin upload segment.
Aug 14 23:25:24.427681045 (149h59m18.858761167s) [noise=true , address=77.90.31.12:4594     , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.427712806 (149h59m18.858792937s) [noise=true , address=77.90.31.18:4809     , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428058338 (149h59m18.859138469s) [noise=true , address=79.127.219.48:4076   , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428321260 (149h59m18.859401391s) [noise=true , address=104.36.82.3:4796     , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428582981 (149h59m18.859663112s) [noise=true , address=104.36.82.62:4436    , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428780519 (149h59m18.85986064s) [noise=true , address=104.36.82.44:4889    , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428928291 (149h59m18.860008423s) [noise=true , address=104.36.82.34:4570    , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429112424 (149h59m18.860192555s) [noise=true , address=104.36.82.21:4494    , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429144285 (149h59m18.860224406s) [noise=true , address=77.90.31.19:4851     , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429170645 (149h59m18.860250776s) [noise=true , address=104.36.82.15:4290    , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429384725 (149h59m18.860464856s) [noise=true , address=104.36.82.38:4707    , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429432106 (149h59m18.860512227s) [noise=true , address=79.127.201.215:4347  , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429593535 (149h59m18.860673666s) [noise=true , address=104.36.82.46:4495    , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429704938 (149h59m18.860785059s) [noise=true , address=104.36.82.60:4365    , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429992358 (149h59m18.861072489s) [noise=true , address=104.36.82.51:4063    , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430255922 (149h59m18.861336053s) [noise=true , address=77.90.31.21:4891     , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430549503 (149h59m18.861629624s) [noise=true , address=104.36.82.59:4302    , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430809041 (149h59m18.861889172s) [noise=true , address=45.91.116.9:4266     , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:25.923497549 (149h59m20.35457768s) [upload=156000]: Next returned nil segment
Aug 14 23:25:25.923507829 (149h59m20.35458795s) [upload=156000]: Waiting for error group managing segments...
Aug 14 23:25:26.337042342 (149h59m20.768122463s) [noise=true , address=79.127.219.48:4076   , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.350688071 (149h59m20.781768202s) [noise=true , address=77.90.31.21:4891     , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.367283975 (149h59m20.798364106s) [noise=true , address=104.36.82.59:4302    , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.392847758 (149h59m20.823927889s) [noise=true , address=79.127.201.215:4347  , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.476671684 (149h59m20.907751805s) [noise=true , address=104.36.82.34:4570    , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.477883863 (149h59m20.908963994s) [noise=true , address=104.36.82.51:4063    , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.495071439 (149h59m20.92615157s) [noise=true , address=77.90.31.12:4594     , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.499490865 (149h59m20.930571016s) [noise=true , address=104.36.82.3:4796     , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.534749478 (149h59m20.965829599s) [noise=true , address=104.36.82.62:4436    , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.567397536 (149h59m20.998477667s) [noise=true , address=77.90.31.19:4851     , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.581324884 (149h59m21.012405015s) [noise=true , address=104.36.82.60:4365    , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.600511545 (149h59m21.031591676s) [noise=true , address=104.36.82.46:4495    , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.602312732 (149h59m21.033392863s) [noise=true , address=77.90.31.18:4809     , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.614279168 (149h59m21.045359299s) [noise=true , address=45.91.116.9:4266     , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.614295228 (149h59m21.045375359s) [seg_pos={0 0}, upload=156000]: Segment reached optimal threshold of 14 pieces.
Aug 14 23:25:26.614385762 (149h59m21.045465893s) [noise=true , address=104.36.82.44:4889    , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PCtJRFHPHi1dHJNcRnGZg8HZPQDfo5L3aw6DgVnUzVUz92Kyv): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614431238 (149h59m21.045511369s) [noise=true , address=104.36.82.15:4290    , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FmG5i2o4BwJmdL9u2tqKGmTAUErivGEe63TbfDTPpBdELozfz): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614559364 (149h59m21.045639485s) [noise=true , address=104.36.82.21:4494    , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sRaMuQG18B5SfPpzxp5VWjrwe38SS38g4askmbURxU9tepJHi): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614656349 (149h59m21.04573647s) [noise=true , address=104.36.82.38:4707    , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:43504->104.36.82.38:4707: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 23:25:26.614687790 (149h59m21.045767921s) [seg_pos={0 0}, upload=156000]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 23:25:26.614759687 (149h59m21.045839818s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 23:25:26.614763564 (149h59m21.045843695s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:25:27.350074072 (149h59m21.781154203s) [upload=156000]: Done uploading segments...
Aug 14 23:25:27.350115130 (149h59m21.781195261s) [upload=156000]: Upload finished. err: <nil>
Duration: 7.039329664s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
6 out of 60 is failed (threshold=3) [..........X.......X..................X........X.....X..X....]
duration:
2.657135923s
FAIL (2025-08-14 23:39:55 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 14 23:37:43.299217097 (150h11m37.730297228s) [upload=156226]: Starting upload
Aug 14 23:37:43.299264879 (150h11m37.73034501s) [upload=156226]: Done starting upload
Aug 14 23:37:43.299312279 (150h11m37.7303924s) [upload=156226]: Uploading segments...
Aug 14 23:37:43.299372313 (150h11m37.730452435s) [upload=156226]: Got next segment. Inline: true
Aug 14 23:37:43.299376893 (150h11m37.730457024s) [upload=156226]: Waiting for error group managing segments...
Aug 14 23:37:43.299413222 (150h11m37.730493343s) [upload=156226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:37:43.299418222 (150h11m37.730498353s) [upload=156226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 23:37:43.299422329 (150h11m37.73050246s) [upload=156226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:37:43.639617167 (150h11m38.070697298s) [upload=156226]: Done uploading segments...
Aug 14 23:37:43.639634600 (150h11m38.070714731s) [upload=156226]: Upload finished. err: <nil>
Duration: 2.657166531s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................]
duration:
6.185545318s
FAIL (2025-08-14 23:39:53 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.18556724s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
6 out of 60 is failed (threshold=3) [...........X.......X..................X........X.....X..X...]
duration:
2.062494324s
FAIL (2025-08-14 23:39:32 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 14 23:37:43.299217097 (150h11m37.730297228s) [upload=156226]: Starting upload
Aug 14 23:37:43.299264879 (150h11m37.73034501s) [upload=156226]: Done starting upload
Aug 14 23:37:43.299312279 (150h11m37.7303924s) [upload=156226]: Uploading segments...
Aug 14 23:37:43.299372313 (150h11m37.730452435s) [upload=156226]: Got next segment. Inline: true
Aug 14 23:37:43.299376893 (150h11m37.730457024s) [upload=156226]: Waiting for error group managing segments...
Aug 14 23:37:43.299413222 (150h11m37.730493343s) [upload=156226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:37:43.299418222 (150h11m37.730498353s) [upload=156226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 23:37:43.299422329 (150h11m37.73050246s) [upload=156226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:37:43.639617167 (150h11m38.070697298s) [upload=156226]: Done uploading segments...
Aug 14 23:37:43.639634600 (150h11m38.070714731s) [upload=156226]: Upload finished. err: <nil>
Duration: 2.062517039s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
4 out of 60 is failed (threshold=3) [...................X.............X....X..X..................]
duration:
6.046814326s
FAIL (2025-08-14 23:39:24 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 23:25:23.865082679 (149h59m18.29616281s) [upload=156000]: Starting upload
Aug 14 23:25:23.865134989 (149h59m18.29621512s) [upload=156000]: Done starting upload
Aug 14 23:25:23.865241213 (149h59m18.296321344s) [upload=156000]: Uploading segments...
Aug 14 23:25:23.865391189 (149h59m18.29647132s) [upload=156000]: Got next segment. Inline: false
Aug 14 23:25:23.865430435 (149h59m18.296510566s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:25:23.865434993 (149h59m18.296515114s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 23:25:24.427593929 (149h59m18.85867406s) [seg_pos={0 0}, upload=156000]: Begin upload segment...
Aug 14 23:25:24.427659504 (149h59m18.858739635s) [seg_pos={0 0}, upload=156000]: Done begin upload segment.
Aug 14 23:25:24.427681045 (149h59m18.858761167s) [noise=true , address=77.90.31.12:4594     , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.427712806 (149h59m18.858792937s) [noise=true , address=77.90.31.18:4809     , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428058338 (149h59m18.859138469s) [noise=true , address=79.127.219.48:4076   , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428321260 (149h59m18.859401391s) [noise=true , address=104.36.82.3:4796     , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428582981 (149h59m18.859663112s) [noise=true , address=104.36.82.62:4436    , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428780519 (149h59m18.85986064s) [noise=true , address=104.36.82.44:4889    , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428928291 (149h59m18.860008423s) [noise=true , address=104.36.82.34:4570    , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429112424 (149h59m18.860192555s) [noise=true , address=104.36.82.21:4494    , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429144285 (149h59m18.860224406s) [noise=true , address=77.90.31.19:4851     , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429170645 (149h59m18.860250776s) [noise=true , address=104.36.82.15:4290    , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429384725 (149h59m18.860464856s) [noise=true , address=104.36.82.38:4707    , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429432106 (149h59m18.860512227s) [noise=true , address=79.127.201.215:4347  , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429593535 (149h59m18.860673666s) [noise=true , address=104.36.82.46:4495    , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429704938 (149h59m18.860785059s) [noise=true , address=104.36.82.60:4365    , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429992358 (149h59m18.861072489s) [noise=true , address=104.36.82.51:4063    , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430255922 (149h59m18.861336053s) [noise=true , address=77.90.31.21:4891     , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430549503 (149h59m18.861629624s) [noise=true , address=104.36.82.59:4302    , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430809041 (149h59m18.861889172s) [noise=true , address=45.91.116.9:4266     , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:25.923497549 (149h59m20.35457768s) [upload=156000]: Next returned nil segment
Aug 14 23:25:25.923507829 (149h59m20.35458795s) [upload=156000]: Waiting for error group managing segments...
Aug 14 23:25:26.337042342 (149h59m20.768122463s) [noise=true , address=79.127.219.48:4076   , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.350688071 (149h59m20.781768202s) [noise=true , address=77.90.31.21:4891     , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.367283975 (149h59m20.798364106s) [noise=true , address=104.36.82.59:4302    , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.392847758 (149h59m20.823927889s) [noise=true , address=79.127.201.215:4347  , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.476671684 (149h59m20.907751805s) [noise=true , address=104.36.82.34:4570    , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.477883863 (149h59m20.908963994s) [noise=true , address=104.36.82.51:4063    , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.495071439 (149h59m20.92615157s) [noise=true , address=77.90.31.12:4594     , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.499490865 (149h59m20.930571016s) [noise=true , address=104.36.82.3:4796     , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.534749478 (149h59m20.965829599s) [noise=true , address=104.36.82.62:4436    , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.567397536 (149h59m20.998477667s) [noise=true , address=77.90.31.19:4851     , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.581324884 (149h59m21.012405015s) [noise=true , address=104.36.82.60:4365    , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.600511545 (149h59m21.031591676s) [noise=true , address=104.36.82.46:4495    , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.602312732 (149h59m21.033392863s) [noise=true , address=77.90.31.18:4809     , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.614279168 (149h59m21.045359299s) [noise=true , address=45.91.116.9:4266     , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.614295228 (149h59m21.045375359s) [seg_pos={0 0}, upload=156000]: Segment reached optimal threshold of 14 pieces.
Aug 14 23:25:26.614385762 (149h59m21.045465893s) [noise=true , address=104.36.82.44:4889    , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PCtJRFHPHi1dHJNcRnGZg8HZPQDfo5L3aw6DgVnUzVUz92Kyv): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614431238 (149h59m21.045511369s) [noise=true , address=104.36.82.15:4290    , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FmG5i2o4BwJmdL9u2tqKGmTAUErivGEe63TbfDTPpBdELozfz): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614559364 (149h59m21.045639485s) [noise=true , address=104.36.82.21:4494    , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sRaMuQG18B5SfPpzxp5VWjrwe38SS38g4askmbURxU9tepJHi): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614656349 (149h59m21.04573647s) [noise=true , address=104.36.82.38:4707    , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:43504->104.36.82.38:4707: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 23:25:26.614687790 (149h59m21.045767921s) [seg_pos={0 0}, upload=156000]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 23:25:26.614759687 (149h59m21.045839818s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 23:25:26.614763564 (149h59m21.045843695s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:25:27.350074072 (149h59m21.781154203s) [upload=156000]: Done uploading segments...
Aug 14 23:25:27.350115130 (149h59m21.781195261s) [upload=156000]: Upload finished. err: <nil>
Duration: 6.046847378s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
2 out of 60 is failed (threshold=3) [XX..........................................................]
duration:
6.448497794s
FAIL (2025-08-14 23:39:22 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.44851693s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
4 out of 60 is failed (threshold=3) [....................X.............X....X..X.................]
duration:
8.130536566s
FAIL (2025-08-14 23:38:49 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 23:25:23.865082679 (149h59m18.29616281s) [upload=156000]: Starting upload
Aug 14 23:25:23.865134989 (149h59m18.29621512s) [upload=156000]: Done starting upload
Aug 14 23:25:23.865241213 (149h59m18.296321344s) [upload=156000]: Uploading segments...
Aug 14 23:25:23.865391189 (149h59m18.29647132s) [upload=156000]: Got next segment. Inline: false
Aug 14 23:25:23.865430435 (149h59m18.296510566s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:25:23.865434993 (149h59m18.296515114s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 23:25:24.427593929 (149h59m18.85867406s) [seg_pos={0 0}, upload=156000]: Begin upload segment...
Aug 14 23:25:24.427659504 (149h59m18.858739635s) [seg_pos={0 0}, upload=156000]: Done begin upload segment.
Aug 14 23:25:24.427681045 (149h59m18.858761167s) [noise=true , address=77.90.31.12:4594     , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.427712806 (149h59m18.858792937s) [noise=true , address=77.90.31.18:4809     , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428058338 (149h59m18.859138469s) [noise=true , address=79.127.219.48:4076   , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428321260 (149h59m18.859401391s) [noise=true , address=104.36.82.3:4796     , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428582981 (149h59m18.859663112s) [noise=true , address=104.36.82.62:4436    , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428780519 (149h59m18.85986064s) [noise=true , address=104.36.82.44:4889    , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428928291 (149h59m18.860008423s) [noise=true , address=104.36.82.34:4570    , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429112424 (149h59m18.860192555s) [noise=true , address=104.36.82.21:4494    , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429144285 (149h59m18.860224406s) [noise=true , address=77.90.31.19:4851     , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429170645 (149h59m18.860250776s) [noise=true , address=104.36.82.15:4290    , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429384725 (149h59m18.860464856s) [noise=true , address=104.36.82.38:4707    , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429432106 (149h59m18.860512227s) [noise=true , address=79.127.201.215:4347  , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429593535 (149h59m18.860673666s) [noise=true , address=104.36.82.46:4495    , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429704938 (149h59m18.860785059s) [noise=true , address=104.36.82.60:4365    , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429992358 (149h59m18.861072489s) [noise=true , address=104.36.82.51:4063    , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430255922 (149h59m18.861336053s) [noise=true , address=77.90.31.21:4891     , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430549503 (149h59m18.861629624s) [noise=true , address=104.36.82.59:4302    , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430809041 (149h59m18.861889172s) [noise=true , address=45.91.116.9:4266     , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:25.923497549 (149h59m20.35457768s) [upload=156000]: Next returned nil segment
Aug 14 23:25:25.923507829 (149h59m20.35458795s) [upload=156000]: Waiting for error group managing segments...
Aug 14 23:25:26.337042342 (149h59m20.768122463s) [noise=true , address=79.127.219.48:4076   , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.350688071 (149h59m20.781768202s) [noise=true , address=77.90.31.21:4891     , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.367283975 (149h59m20.798364106s) [noise=true , address=104.36.82.59:4302    , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.392847758 (149h59m20.823927889s) [noise=true , address=79.127.201.215:4347  , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.476671684 (149h59m20.907751805s) [noise=true , address=104.36.82.34:4570    , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.477883863 (149h59m20.908963994s) [noise=true , address=104.36.82.51:4063    , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.495071439 (149h59m20.92615157s) [noise=true , address=77.90.31.12:4594     , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.499490865 (149h59m20.930571016s) [noise=true , address=104.36.82.3:4796     , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.534749478 (149h59m20.965829599s) [noise=true , address=104.36.82.62:4436    , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.567397536 (149h59m20.998477667s) [noise=true , address=77.90.31.19:4851     , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.581324884 (149h59m21.012405015s) [noise=true , address=104.36.82.60:4365    , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.600511545 (149h59m21.031591676s) [noise=true , address=104.36.82.46:4495    , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.602312732 (149h59m21.033392863s) [noise=true , address=77.90.31.18:4809     , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.614279168 (149h59m21.045359299s) [noise=true , address=45.91.116.9:4266     , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.614295228 (149h59m21.045375359s) [seg_pos={0 0}, upload=156000]: Segment reached optimal threshold of 14 pieces.
Aug 14 23:25:26.614385762 (149h59m21.045465893s) [noise=true , address=104.36.82.44:4889    , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PCtJRFHPHi1dHJNcRnGZg8HZPQDfo5L3aw6DgVnUzVUz92Kyv): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614431238 (149h59m21.045511369s) [noise=true , address=104.36.82.15:4290    , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FmG5i2o4BwJmdL9u2tqKGmTAUErivGEe63TbfDTPpBdELozfz): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614559364 (149h59m21.045639485s) [noise=true , address=104.36.82.21:4494    , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sRaMuQG18B5SfPpzxp5VWjrwe38SS38g4askmbURxU9tepJHi): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614656349 (149h59m21.04573647s) [noise=true , address=104.36.82.38:4707    , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:43504->104.36.82.38:4707: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 23:25:26.614687790 (149h59m21.045767921s) [seg_pos={0 0}, upload=156000]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 23:25:26.614759687 (149h59m21.045839818s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 23:25:26.614763564 (149h59m21.045843695s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:25:27.350074072 (149h59m21.781154203s) [upload=156000]: Done uploading segments...
Aug 14 23:25:27.350115130 (149h59m21.781195261s) [upload=156000]: Upload finished. err: <nil>
Duration: 8.130568648s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
6 out of 60 is failed (threshold=3) [............X.......X..................X........X.....X..X..]
duration:
2.181877283s
FAIL (2025-08-14 23:38:35 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 14 23:37:43.299217097 (150h11m37.730297228s) [upload=156226]: Starting upload
Aug 14 23:37:43.299264879 (150h11m37.73034501s) [upload=156226]: Done starting upload
Aug 14 23:37:43.299312279 (150h11m37.7303924s) [upload=156226]: Uploading segments...
Aug 14 23:37:43.299372313 (150h11m37.730452435s) [upload=156226]: Got next segment. Inline: true
Aug 14 23:37:43.299376893 (150h11m37.730457024s) [upload=156226]: Waiting for error group managing segments...
Aug 14 23:37:43.299413222 (150h11m37.730493343s) [upload=156226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:37:43.299418222 (150h11m37.730498353s) [upload=156226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 23:37:43.299422329 (150h11m37.73050246s) [upload=156226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:37:43.639617167 (150h11m38.070697298s) [upload=156226]: Done uploading segments...
Aug 14 23:37:43.639634600 (150h11m38.070714731s) [upload=156226]: Upload finished. err: <nil>
Duration: 2.181900729s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
3 out of 60 is failed (threshold=3) [XXX.........................................................]
duration:
6.201876804s
FAIL (2025-08-14 23:38:30 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.201898295s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
6 out of 60 is failed (threshold=3) [.............X.......X..................X........X.....X..X.]
duration:
2.333702353s
FAIL (2025-08-14 23:38:03 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 14 23:37:43.299217097 (150h11m37.730297228s) [upload=156226]: Starting upload
Aug 14 23:37:43.299264879 (150h11m37.73034501s) [upload=156226]: Done starting upload
Aug 14 23:37:43.299312279 (150h11m37.7303924s) [upload=156226]: Uploading segments...
Aug 14 23:37:43.299372313 (150h11m37.730452435s) [upload=156226]: Got next segment. Inline: true
Aug 14 23:37:43.299376893 (150h11m37.730457024s) [upload=156226]: Waiting for error group managing segments...
Aug 14 23:37:43.299413222 (150h11m37.730493343s) [upload=156226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:37:43.299418222 (150h11m37.730498353s) [upload=156226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 23:37:43.299422329 (150h11m37.73050246s) [upload=156226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:37:43.639617167 (150h11m38.070697298s) [upload=156226]: Done uploading segments...
Aug 14 23:37:43.639634600 (150h11m38.070714731s) [upload=156226]: Upload finished. err: <nil>
Duration: 2.333727843s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
4 out of 60 is failed (threshold=3) [XXXX........................................................]
duration:
6.424955536s
FAIL (2025-08-14 23:37:52 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.424975925s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
6 out of 60 is failed (threshold=3) [..............X.......X..................X........X.....X..X]
duration:
1.464388761s
FAIL (2025-08-14 23:37:44 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 14 23:37:43.299217097 (150h11m37.730297228s) [upload=156226]: Starting upload
Aug 14 23:37:43.299264879 (150h11m37.73034501s) [upload=156226]: Done starting upload
Aug 14 23:37:43.299312279 (150h11m37.7303924s) [upload=156226]: Uploading segments...
Aug 14 23:37:43.299372313 (150h11m37.730452435s) [upload=156226]: Got next segment. Inline: true
Aug 14 23:37:43.299376893 (150h11m37.730457024s) [upload=156226]: Waiting for error group managing segments...
Aug 14 23:37:43.299413222 (150h11m37.730493343s) [upload=156226]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:37:43.299418222 (150h11m37.730498353s) [upload=156226]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 23:37:43.299422329 (150h11m37.73050246s) [upload=156226]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:37:43.639617167 (150h11m38.070697298s) [upload=156226]: Done uploading segments...
Aug 14 23:37:43.639634600 (150h11m38.070714731s) [upload=156226]: Upload finished. err: <nil>
Duration: 1.464438325s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
4 out of 60 is failed (threshold=3) [.....................X.............X....X..X................]
duration:
6.866913313s
FAIL (2025-08-14 23:37:37 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 23:25:23.865082679 (149h59m18.29616281s) [upload=156000]: Starting upload
Aug 14 23:25:23.865134989 (149h59m18.29621512s) [upload=156000]: Done starting upload
Aug 14 23:25:23.865241213 (149h59m18.296321344s) [upload=156000]: Uploading segments...
Aug 14 23:25:23.865391189 (149h59m18.29647132s) [upload=156000]: Got next segment. Inline: false
Aug 14 23:25:23.865430435 (149h59m18.296510566s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:25:23.865434993 (149h59m18.296515114s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 23:25:24.427593929 (149h59m18.85867406s) [seg_pos={0 0}, upload=156000]: Begin upload segment...
Aug 14 23:25:24.427659504 (149h59m18.858739635s) [seg_pos={0 0}, upload=156000]: Done begin upload segment.
Aug 14 23:25:24.427681045 (149h59m18.858761167s) [noise=true , address=77.90.31.12:4594     , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.427712806 (149h59m18.858792937s) [noise=true , address=77.90.31.18:4809     , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428058338 (149h59m18.859138469s) [noise=true , address=79.127.219.48:4076   , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428321260 (149h59m18.859401391s) [noise=true , address=104.36.82.3:4796     , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428582981 (149h59m18.859663112s) [noise=true , address=104.36.82.62:4436    , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428780519 (149h59m18.85986064s) [noise=true , address=104.36.82.44:4889    , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428928291 (149h59m18.860008423s) [noise=true , address=104.36.82.34:4570    , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429112424 (149h59m18.860192555s) [noise=true , address=104.36.82.21:4494    , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429144285 (149h59m18.860224406s) [noise=true , address=77.90.31.19:4851     , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429170645 (149h59m18.860250776s) [noise=true , address=104.36.82.15:4290    , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429384725 (149h59m18.860464856s) [noise=true , address=104.36.82.38:4707    , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429432106 (149h59m18.860512227s) [noise=true , address=79.127.201.215:4347  , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429593535 (149h59m18.860673666s) [noise=true , address=104.36.82.46:4495    , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429704938 (149h59m18.860785059s) [noise=true , address=104.36.82.60:4365    , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429992358 (149h59m18.861072489s) [noise=true , address=104.36.82.51:4063    , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430255922 (149h59m18.861336053s) [noise=true , address=77.90.31.21:4891     , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430549503 (149h59m18.861629624s) [noise=true , address=104.36.82.59:4302    , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430809041 (149h59m18.861889172s) [noise=true , address=45.91.116.9:4266     , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:25.923497549 (149h59m20.35457768s) [upload=156000]: Next returned nil segment
Aug 14 23:25:25.923507829 (149h59m20.35458795s) [upload=156000]: Waiting for error group managing segments...
Aug 14 23:25:26.337042342 (149h59m20.768122463s) [noise=true , address=79.127.219.48:4076   , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.350688071 (149h59m20.781768202s) [noise=true , address=77.90.31.21:4891     , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.367283975 (149h59m20.798364106s) [noise=true , address=104.36.82.59:4302    , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.392847758 (149h59m20.823927889s) [noise=true , address=79.127.201.215:4347  , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.476671684 (149h59m20.907751805s) [noise=true , address=104.36.82.34:4570    , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.477883863 (149h59m20.908963994s) [noise=true , address=104.36.82.51:4063    , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.495071439 (149h59m20.92615157s) [noise=true , address=77.90.31.12:4594     , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.499490865 (149h59m20.930571016s) [noise=true , address=104.36.82.3:4796     , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.534749478 (149h59m20.965829599s) [noise=true , address=104.36.82.62:4436    , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.567397536 (149h59m20.998477667s) [noise=true , address=77.90.31.19:4851     , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.581324884 (149h59m21.012405015s) [noise=true , address=104.36.82.60:4365    , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.600511545 (149h59m21.031591676s) [noise=true , address=104.36.82.46:4495    , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.602312732 (149h59m21.033392863s) [noise=true , address=77.90.31.18:4809     , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.614279168 (149h59m21.045359299s) [noise=true , address=45.91.116.9:4266     , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.614295228 (149h59m21.045375359s) [seg_pos={0 0}, upload=156000]: Segment reached optimal threshold of 14 pieces.
Aug 14 23:25:26.614385762 (149h59m21.045465893s) [noise=true , address=104.36.82.44:4889    , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PCtJRFHPHi1dHJNcRnGZg8HZPQDfo5L3aw6DgVnUzVUz92Kyv): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614431238 (149h59m21.045511369s) [noise=true , address=104.36.82.15:4290    , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FmG5i2o4BwJmdL9u2tqKGmTAUErivGEe63TbfDTPpBdELozfz): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614559364 (149h59m21.045639485s) [noise=true , address=104.36.82.21:4494    , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sRaMuQG18B5SfPpzxp5VWjrwe38SS38g4askmbURxU9tepJHi): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614656349 (149h59m21.04573647s) [noise=true , address=104.36.82.38:4707    , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:43504->104.36.82.38:4707: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 23:25:26.614687790 (149h59m21.045767921s) [seg_pos={0 0}, upload=156000]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 23:25:26.614759687 (149h59m21.045839818s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 23:25:26.614763564 (149h59m21.045843695s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:25:27.350074072 (149h59m21.781154203s) [upload=156000]: Done uploading segments...
Aug 14 23:25:27.350115130 (149h59m21.781195261s) [upload=156000]: Upload finished. err: <nil>
Duration: 6.866939033s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
4 out of 60 is failed (threshold=3) [......................X.............X....X..X...............]
duration:
6.129158278s
FAIL (2025-08-14 23:37:02 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 23:25:23.865082679 (149h59m18.29616281s) [upload=156000]: Starting upload
Aug 14 23:25:23.865134989 (149h59m18.29621512s) [upload=156000]: Done starting upload
Aug 14 23:25:23.865241213 (149h59m18.296321344s) [upload=156000]: Uploading segments...
Aug 14 23:25:23.865391189 (149h59m18.29647132s) [upload=156000]: Got next segment. Inline: false
Aug 14 23:25:23.865430435 (149h59m18.296510566s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:25:23.865434993 (149h59m18.296515114s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 23:25:24.427593929 (149h59m18.85867406s) [seg_pos={0 0}, upload=156000]: Begin upload segment...
Aug 14 23:25:24.427659504 (149h59m18.858739635s) [seg_pos={0 0}, upload=156000]: Done begin upload segment.
Aug 14 23:25:24.427681045 (149h59m18.858761167s) [noise=true , address=77.90.31.12:4594     , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.427712806 (149h59m18.858792937s) [noise=true , address=77.90.31.18:4809     , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428058338 (149h59m18.859138469s) [noise=true , address=79.127.219.48:4076   , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428321260 (149h59m18.859401391s) [noise=true , address=104.36.82.3:4796     , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428582981 (149h59m18.859663112s) [noise=true , address=104.36.82.62:4436    , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428780519 (149h59m18.85986064s) [noise=true , address=104.36.82.44:4889    , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428928291 (149h59m18.860008423s) [noise=true , address=104.36.82.34:4570    , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429112424 (149h59m18.860192555s) [noise=true , address=104.36.82.21:4494    , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429144285 (149h59m18.860224406s) [noise=true , address=77.90.31.19:4851     , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429170645 (149h59m18.860250776s) [noise=true , address=104.36.82.15:4290    , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429384725 (149h59m18.860464856s) [noise=true , address=104.36.82.38:4707    , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429432106 (149h59m18.860512227s) [noise=true , address=79.127.201.215:4347  , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429593535 (149h59m18.860673666s) [noise=true , address=104.36.82.46:4495    , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429704938 (149h59m18.860785059s) [noise=true , address=104.36.82.60:4365    , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429992358 (149h59m18.861072489s) [noise=true , address=104.36.82.51:4063    , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430255922 (149h59m18.861336053s) [noise=true , address=77.90.31.21:4891     , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430549503 (149h59m18.861629624s) [noise=true , address=104.36.82.59:4302    , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430809041 (149h59m18.861889172s) [noise=true , address=45.91.116.9:4266     , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:25.923497549 (149h59m20.35457768s) [upload=156000]: Next returned nil segment
Aug 14 23:25:25.923507829 (149h59m20.35458795s) [upload=156000]: Waiting for error group managing segments...
Aug 14 23:25:26.337042342 (149h59m20.768122463s) [noise=true , address=79.127.219.48:4076   , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.350688071 (149h59m20.781768202s) [noise=true , address=77.90.31.21:4891     , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.367283975 (149h59m20.798364106s) [noise=true , address=104.36.82.59:4302    , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.392847758 (149h59m20.823927889s) [noise=true , address=79.127.201.215:4347  , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.476671684 (149h59m20.907751805s) [noise=true , address=104.36.82.34:4570    , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.477883863 (149h59m20.908963994s) [noise=true , address=104.36.82.51:4063    , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.495071439 (149h59m20.92615157s) [noise=true , address=77.90.31.12:4594     , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.499490865 (149h59m20.930571016s) [noise=true , address=104.36.82.3:4796     , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.534749478 (149h59m20.965829599s) [noise=true , address=104.36.82.62:4436    , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.567397536 (149h59m20.998477667s) [noise=true , address=77.90.31.19:4851     , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.581324884 (149h59m21.012405015s) [noise=true , address=104.36.82.60:4365    , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.600511545 (149h59m21.031591676s) [noise=true , address=104.36.82.46:4495    , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.602312732 (149h59m21.033392863s) [noise=true , address=77.90.31.18:4809     , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.614279168 (149h59m21.045359299s) [noise=true , address=45.91.116.9:4266     , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.614295228 (149h59m21.045375359s) [seg_pos={0 0}, upload=156000]: Segment reached optimal threshold of 14 pieces.
Aug 14 23:25:26.614385762 (149h59m21.045465893s) [noise=true , address=104.36.82.44:4889    , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PCtJRFHPHi1dHJNcRnGZg8HZPQDfo5L3aw6DgVnUzVUz92Kyv): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614431238 (149h59m21.045511369s) [noise=true , address=104.36.82.15:4290    , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FmG5i2o4BwJmdL9u2tqKGmTAUErivGEe63TbfDTPpBdELozfz): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614559364 (149h59m21.045639485s) [noise=true , address=104.36.82.21:4494    , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sRaMuQG18B5SfPpzxp5VWjrwe38SS38g4askmbURxU9tepJHi): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614656349 (149h59m21.04573647s) [noise=true , address=104.36.82.38:4707    , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:43504->104.36.82.38:4707: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 23:25:26.614687790 (149h59m21.045767921s) [seg_pos={0 0}, upload=156000]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 23:25:26.614759687 (149h59m21.045839818s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 23:25:26.614763564 (149h59m21.045843695s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:25:27.350074072 (149h59m21.781154203s) [upload=156000]: Done uploading segments...
Aug 14 23:25:27.350115130 (149h59m21.781195261s) [upload=156000]: Upload finished. err: <nil>
Duration: 6.129197493s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
5 out of 60 is failed (threshold=3) [XXXXX.......................................................]
duration:
5.958851024s
FAIL (2025-08-14 23:36:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.958899586s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
5 out of 60 is failed (threshold=3) [...............X.......X..................X........X.....X..]
duration:
2.039091767s
FAIL (2025-08-14 23:36:52 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 14 23:35:49.356526551 (150h9m43.787606682s) [upload=156193]: Starting upload
Aug 14 23:35:49.356573310 (150h9m43.787653431s) [upload=156193]: Done starting upload
Aug 14 23:35:49.356642933 (150h9m43.787723064s) [upload=156193]: Uploading segments...
Aug 14 23:35:49.356675105 (150h9m43.787755236s) [upload=156193]: Got next segment. Inline: true
Aug 14 23:35:49.356678722 (150h9m43.787758853s) [upload=156193]: Waiting for error group managing segments...
Aug 14 23:35:49.356708950 (150h9m43.787789081s) [upload=156193]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:35:49.356713258 (150h9m43.787793389s) [upload=156193]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 23:35:49.356715943 (150h9m43.787796074s) [upload=156193]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:35:49.663919095 (150h9m44.094999226s) [upload=156193]: Done uploading segments...
Aug 14 23:35:49.663943642 (150h9m44.095023773s) [upload=156193]: Upload finished. err: <nil>
Duration: 2.039111644s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
4 out of 60 is failed (threshold=3) [.......................X.............X....X..X..............]
duration:
7.720657616s
FAIL (2025-08-14 23:36:37 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 23:25:23.865082679 (149h59m18.29616281s) [upload=156000]: Starting upload
Aug 14 23:25:23.865134989 (149h59m18.29621512s) [upload=156000]: Done starting upload
Aug 14 23:25:23.865241213 (149h59m18.296321344s) [upload=156000]: Uploading segments...
Aug 14 23:25:23.865391189 (149h59m18.29647132s) [upload=156000]: Got next segment. Inline: false
Aug 14 23:25:23.865430435 (149h59m18.296510566s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:25:23.865434993 (149h59m18.296515114s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 23:25:24.427593929 (149h59m18.85867406s) [seg_pos={0 0}, upload=156000]: Begin upload segment...
Aug 14 23:25:24.427659504 (149h59m18.858739635s) [seg_pos={0 0}, upload=156000]: Done begin upload segment.
Aug 14 23:25:24.427681045 (149h59m18.858761167s) [noise=true , address=77.90.31.12:4594     , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.427712806 (149h59m18.858792937s) [noise=true , address=77.90.31.18:4809     , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428058338 (149h59m18.859138469s) [noise=true , address=79.127.219.48:4076   , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428321260 (149h59m18.859401391s) [noise=true , address=104.36.82.3:4796     , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428582981 (149h59m18.859663112s) [noise=true , address=104.36.82.62:4436    , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428780519 (149h59m18.85986064s) [noise=true , address=104.36.82.44:4889    , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428928291 (149h59m18.860008423s) [noise=true , address=104.36.82.34:4570    , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429112424 (149h59m18.860192555s) [noise=true , address=104.36.82.21:4494    , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429144285 (149h59m18.860224406s) [noise=true , address=77.90.31.19:4851     , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429170645 (149h59m18.860250776s) [noise=true , address=104.36.82.15:4290    , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429384725 (149h59m18.860464856s) [noise=true , address=104.36.82.38:4707    , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429432106 (149h59m18.860512227s) [noise=true , address=79.127.201.215:4347  , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429593535 (149h59m18.860673666s) [noise=true , address=104.36.82.46:4495    , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429704938 (149h59m18.860785059s) [noise=true , address=104.36.82.60:4365    , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429992358 (149h59m18.861072489s) [noise=true , address=104.36.82.51:4063    , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430255922 (149h59m18.861336053s) [noise=true , address=77.90.31.21:4891     , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430549503 (149h59m18.861629624s) [noise=true , address=104.36.82.59:4302    , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430809041 (149h59m18.861889172s) [noise=true , address=45.91.116.9:4266     , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:25.923497549 (149h59m20.35457768s) [upload=156000]: Next returned nil segment
Aug 14 23:25:25.923507829 (149h59m20.35458795s) [upload=156000]: Waiting for error group managing segments...
Aug 14 23:25:26.337042342 (149h59m20.768122463s) [noise=true , address=79.127.219.48:4076   , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.350688071 (149h59m20.781768202s) [noise=true , address=77.90.31.21:4891     , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.367283975 (149h59m20.798364106s) [noise=true , address=104.36.82.59:4302    , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.392847758 (149h59m20.823927889s) [noise=true , address=79.127.201.215:4347  , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.476671684 (149h59m20.907751805s) [noise=true , address=104.36.82.34:4570    , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.477883863 (149h59m20.908963994s) [noise=true , address=104.36.82.51:4063    , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.495071439 (149h59m20.92615157s) [noise=true , address=77.90.31.12:4594     , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.499490865 (149h59m20.930571016s) [noise=true , address=104.36.82.3:4796     , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.534749478 (149h59m20.965829599s) [noise=true , address=104.36.82.62:4436    , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.567397536 (149h59m20.998477667s) [noise=true , address=77.90.31.19:4851     , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.581324884 (149h59m21.012405015s) [noise=true , address=104.36.82.60:4365    , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.600511545 (149h59m21.031591676s) [noise=true , address=104.36.82.46:4495    , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.602312732 (149h59m21.033392863s) [noise=true , address=77.90.31.18:4809     , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.614279168 (149h59m21.045359299s) [noise=true , address=45.91.116.9:4266     , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.614295228 (149h59m21.045375359s) [seg_pos={0 0}, upload=156000]: Segment reached optimal threshold of 14 pieces.
Aug 14 23:25:26.614385762 (149h59m21.045465893s) [noise=true , address=104.36.82.44:4889    , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PCtJRFHPHi1dHJNcRnGZg8HZPQDfo5L3aw6DgVnUzVUz92Kyv): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614431238 (149h59m21.045511369s) [noise=true , address=104.36.82.15:4290    , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FmG5i2o4BwJmdL9u2tqKGmTAUErivGEe63TbfDTPpBdELozfz): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614559364 (149h59m21.045639485s) [noise=true , address=104.36.82.21:4494    , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sRaMuQG18B5SfPpzxp5VWjrwe38SS38g4askmbURxU9tepJHi): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614656349 (149h59m21.04573647s) [noise=true , address=104.36.82.38:4707    , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:43504->104.36.82.38:4707: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 23:25:26.614687790 (149h59m21.045767921s) [seg_pos={0 0}, upload=156000]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 23:25:26.614759687 (149h59m21.045839818s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 23:25:26.614763564 (149h59m21.045843695s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:25:27.350074072 (149h59m21.781154203s) [upload=156000]: Done uploading segments...
Aug 14 23:25:27.350115130 (149h59m21.781195261s) [upload=156000]: Upload finished. err: <nil>
Duration: 7.72069082s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
5 out of 60 is failed (threshold=3) [................X.......X..................X........X.....X.]
duration:
2.439143131s
FAIL (2025-08-14 23:36:36 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 14 23:35:49.356526551 (150h9m43.787606682s) [upload=156193]: Starting upload
Aug 14 23:35:49.356573310 (150h9m43.787653431s) [upload=156193]: Done starting upload
Aug 14 23:35:49.356642933 (150h9m43.787723064s) [upload=156193]: Uploading segments...
Aug 14 23:35:49.356675105 (150h9m43.787755236s) [upload=156193]: Got next segment. Inline: true
Aug 14 23:35:49.356678722 (150h9m43.787758853s) [upload=156193]: Waiting for error group managing segments...
Aug 14 23:35:49.356708950 (150h9m43.787789081s) [upload=156193]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:35:49.356713258 (150h9m43.787793389s) [upload=156193]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 23:35:49.356715943 (150h9m43.787796074s) [upload=156193]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:35:49.663919095 (150h9m44.094999226s) [upload=156193]: Done uploading segments...
Aug 14 23:35:49.663943642 (150h9m44.095023773s) [upload=156193]: Upload finished. err: <nil>
Duration: 2.439178398s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
6 out of 60 is failed (threshold=3) [XXXXXX......................................................]
duration:
6.138302928s
FAIL (2025-08-14 23:36:29 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.138327846s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
5 out of 60 is failed (threshold=3) [.................X.......X..................X........X.....X]
duration:
1.403486933s
FAIL (2025-08-14 23:35:50 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 14 23:35:49.356526551 (150h9m43.787606682s) [upload=156193]: Starting upload
Aug 14 23:35:49.356573310 (150h9m43.787653431s) [upload=156193]: Done starting upload
Aug 14 23:35:49.356642933 (150h9m43.787723064s) [upload=156193]: Uploading segments...
Aug 14 23:35:49.356675105 (150h9m43.787755236s) [upload=156193]: Got next segment. Inline: true
Aug 14 23:35:49.356678722 (150h9m43.787758853s) [upload=156193]: Waiting for error group managing segments...
Aug 14 23:35:49.356708950 (150h9m43.787789081s) [upload=156193]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:35:49.356713258 (150h9m43.787793389s) [upload=156193]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 23:35:49.356715943 (150h9m43.787796074s) [upload=156193]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:35:49.663919095 (150h9m44.094999226s) [upload=156193]: Done uploading segments...
Aug 14 23:35:49.663943642 (150h9m44.095023773s) [upload=156193]: Upload finished. err: <nil>
Duration: 1.403511661s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
4 out of 60 is failed (threshold=3) [........................X.............X....X..X.............]
duration:
6.346198143s
FAIL (2025-08-14 23:35:26 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 23:25:23.865082679 (149h59m18.29616281s) [upload=156000]: Starting upload
Aug 14 23:25:23.865134989 (149h59m18.29621512s) [upload=156000]: Done starting upload
Aug 14 23:25:23.865241213 (149h59m18.296321344s) [upload=156000]: Uploading segments...
Aug 14 23:25:23.865391189 (149h59m18.29647132s) [upload=156000]: Got next segment. Inline: false
Aug 14 23:25:23.865430435 (149h59m18.296510566s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:25:23.865434993 (149h59m18.296515114s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 23:25:24.427593929 (149h59m18.85867406s) [seg_pos={0 0}, upload=156000]: Begin upload segment...
Aug 14 23:25:24.427659504 (149h59m18.858739635s) [seg_pos={0 0}, upload=156000]: Done begin upload segment.
Aug 14 23:25:24.427681045 (149h59m18.858761167s) [noise=true , address=77.90.31.12:4594     , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.427712806 (149h59m18.858792937s) [noise=true , address=77.90.31.18:4809     , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428058338 (149h59m18.859138469s) [noise=true , address=79.127.219.48:4076   , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428321260 (149h59m18.859401391s) [noise=true , address=104.36.82.3:4796     , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428582981 (149h59m18.859663112s) [noise=true , address=104.36.82.62:4436    , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428780519 (149h59m18.85986064s) [noise=true , address=104.36.82.44:4889    , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428928291 (149h59m18.860008423s) [noise=true , address=104.36.82.34:4570    , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429112424 (149h59m18.860192555s) [noise=true , address=104.36.82.21:4494    , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429144285 (149h59m18.860224406s) [noise=true , address=77.90.31.19:4851     , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429170645 (149h59m18.860250776s) [noise=true , address=104.36.82.15:4290    , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429384725 (149h59m18.860464856s) [noise=true , address=104.36.82.38:4707    , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429432106 (149h59m18.860512227s) [noise=true , address=79.127.201.215:4347  , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429593535 (149h59m18.860673666s) [noise=true , address=104.36.82.46:4495    , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429704938 (149h59m18.860785059s) [noise=true , address=104.36.82.60:4365    , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429992358 (149h59m18.861072489s) [noise=true , address=104.36.82.51:4063    , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430255922 (149h59m18.861336053s) [noise=true , address=77.90.31.21:4891     , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430549503 (149h59m18.861629624s) [noise=true , address=104.36.82.59:4302    , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430809041 (149h59m18.861889172s) [noise=true , address=45.91.116.9:4266     , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:25.923497549 (149h59m20.35457768s) [upload=156000]: Next returned nil segment
Aug 14 23:25:25.923507829 (149h59m20.35458795s) [upload=156000]: Waiting for error group managing segments...
Aug 14 23:25:26.337042342 (149h59m20.768122463s) [noise=true , address=79.127.219.48:4076   , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.350688071 (149h59m20.781768202s) [noise=true , address=77.90.31.21:4891     , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.367283975 (149h59m20.798364106s) [noise=true , address=104.36.82.59:4302    , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.392847758 (149h59m20.823927889s) [noise=true , address=79.127.201.215:4347  , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.476671684 (149h59m20.907751805s) [noise=true , address=104.36.82.34:4570    , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.477883863 (149h59m20.908963994s) [noise=true , address=104.36.82.51:4063    , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.495071439 (149h59m20.92615157s) [noise=true , address=77.90.31.12:4594     , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.499490865 (149h59m20.930571016s) [noise=true , address=104.36.82.3:4796     , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.534749478 (149h59m20.965829599s) [noise=true , address=104.36.82.62:4436    , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.567397536 (149h59m20.998477667s) [noise=true , address=77.90.31.19:4851     , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.581324884 (149h59m21.012405015s) [noise=true , address=104.36.82.60:4365    , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.600511545 (149h59m21.031591676s) [noise=true , address=104.36.82.46:4495    , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.602312732 (149h59m21.033392863s) [noise=true , address=77.90.31.18:4809     , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.614279168 (149h59m21.045359299s) [noise=true , address=45.91.116.9:4266     , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.614295228 (149h59m21.045375359s) [seg_pos={0 0}, upload=156000]: Segment reached optimal threshold of 14 pieces.
Aug 14 23:25:26.614385762 (149h59m21.045465893s) [noise=true , address=104.36.82.44:4889    , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PCtJRFHPHi1dHJNcRnGZg8HZPQDfo5L3aw6DgVnUzVUz92Kyv): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614431238 (149h59m21.045511369s) [noise=true , address=104.36.82.15:4290    , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FmG5i2o4BwJmdL9u2tqKGmTAUErivGEe63TbfDTPpBdELozfz): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614559364 (149h59m21.045639485s) [noise=true , address=104.36.82.21:4494    , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sRaMuQG18B5SfPpzxp5VWjrwe38SS38g4askmbURxU9tepJHi): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614656349 (149h59m21.04573647s) [noise=true , address=104.36.82.38:4707    , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:43504->104.36.82.38:4707: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 23:25:26.614687790 (149h59m21.045767921s) [seg_pos={0 0}, upload=156000]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 23:25:26.614759687 (149h59m21.045839818s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 23:25:26.614763564 (149h59m21.045843695s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:25:27.350074072 (149h59m21.781154203s) [upload=156000]: Done uploading segments...
Aug 14 23:25:27.350115130 (149h59m21.781195261s) [upload=156000]: Upload finished. err: <nil>
Duration: 6.346219754s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
7 out of 60 is failed (threshold=3) [XXXXXXX.....................................................]
duration:
6.231702089s
FAIL (2025-08-14 23:35:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.231726064s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
4 out of 60 is failed (threshold=3) [.........................X.............X....X..X............]
duration:
6.043076159s
FAIL (2025-08-14 23:35:02 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 23:25:23.865082679 (149h59m18.29616281s) [upload=156000]: Starting upload
Aug 14 23:25:23.865134989 (149h59m18.29621512s) [upload=156000]: Done starting upload
Aug 14 23:25:23.865241213 (149h59m18.296321344s) [upload=156000]: Uploading segments...
Aug 14 23:25:23.865391189 (149h59m18.29647132s) [upload=156000]: Got next segment. Inline: false
Aug 14 23:25:23.865430435 (149h59m18.296510566s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:25:23.865434993 (149h59m18.296515114s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 23:25:24.427593929 (149h59m18.85867406s) [seg_pos={0 0}, upload=156000]: Begin upload segment...
Aug 14 23:25:24.427659504 (149h59m18.858739635s) [seg_pos={0 0}, upload=156000]: Done begin upload segment.
Aug 14 23:25:24.427681045 (149h59m18.858761167s) [noise=true , address=77.90.31.12:4594     , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.427712806 (149h59m18.858792937s) [noise=true , address=77.90.31.18:4809     , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428058338 (149h59m18.859138469s) [noise=true , address=79.127.219.48:4076   , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428321260 (149h59m18.859401391s) [noise=true , address=104.36.82.3:4796     , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428582981 (149h59m18.859663112s) [noise=true , address=104.36.82.62:4436    , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428780519 (149h59m18.85986064s) [noise=true , address=104.36.82.44:4889    , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428928291 (149h59m18.860008423s) [noise=true , address=104.36.82.34:4570    , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429112424 (149h59m18.860192555s) [noise=true , address=104.36.82.21:4494    , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429144285 (149h59m18.860224406s) [noise=true , address=77.90.31.19:4851     , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429170645 (149h59m18.860250776s) [noise=true , address=104.36.82.15:4290    , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429384725 (149h59m18.860464856s) [noise=true , address=104.36.82.38:4707    , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429432106 (149h59m18.860512227s) [noise=true , address=79.127.201.215:4347  , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429593535 (149h59m18.860673666s) [noise=true , address=104.36.82.46:4495    , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429704938 (149h59m18.860785059s) [noise=true , address=104.36.82.60:4365    , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429992358 (149h59m18.861072489s) [noise=true , address=104.36.82.51:4063    , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430255922 (149h59m18.861336053s) [noise=true , address=77.90.31.21:4891     , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430549503 (149h59m18.861629624s) [noise=true , address=104.36.82.59:4302    , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430809041 (149h59m18.861889172s) [noise=true , address=45.91.116.9:4266     , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:25.923497549 (149h59m20.35457768s) [upload=156000]: Next returned nil segment
Aug 14 23:25:25.923507829 (149h59m20.35458795s) [upload=156000]: Waiting for error group managing segments...
Aug 14 23:25:26.337042342 (149h59m20.768122463s) [noise=true , address=79.127.219.48:4076   , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.350688071 (149h59m20.781768202s) [noise=true , address=77.90.31.21:4891     , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.367283975 (149h59m20.798364106s) [noise=true , address=104.36.82.59:4302    , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.392847758 (149h59m20.823927889s) [noise=true , address=79.127.201.215:4347  , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.476671684 (149h59m20.907751805s) [noise=true , address=104.36.82.34:4570    , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.477883863 (149h59m20.908963994s) [noise=true , address=104.36.82.51:4063    , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.495071439 (149h59m20.92615157s) [noise=true , address=77.90.31.12:4594     , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.499490865 (149h59m20.930571016s) [noise=true , address=104.36.82.3:4796     , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.534749478 (149h59m20.965829599s) [noise=true , address=104.36.82.62:4436    , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.567397536 (149h59m20.998477667s) [noise=true , address=77.90.31.19:4851     , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.581324884 (149h59m21.012405015s) [noise=true , address=104.36.82.60:4365    , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.600511545 (149h59m21.031591676s) [noise=true , address=104.36.82.46:4495    , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.602312732 (149h59m21.033392863s) [noise=true , address=77.90.31.18:4809     , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.614279168 (149h59m21.045359299s) [noise=true , address=45.91.116.9:4266     , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.614295228 (149h59m21.045375359s) [seg_pos={0 0}, upload=156000]: Segment reached optimal threshold of 14 pieces.
Aug 14 23:25:26.614385762 (149h59m21.045465893s) [noise=true , address=104.36.82.44:4889    , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PCtJRFHPHi1dHJNcRnGZg8HZPQDfo5L3aw6DgVnUzVUz92Kyv): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614431238 (149h59m21.045511369s) [noise=true , address=104.36.82.15:4290    , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FmG5i2o4BwJmdL9u2tqKGmTAUErivGEe63TbfDTPpBdELozfz): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614559364 (149h59m21.045639485s) [noise=true , address=104.36.82.21:4494    , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sRaMuQG18B5SfPpzxp5VWjrwe38SS38g4askmbURxU9tepJHi): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614656349 (149h59m21.04573647s) [noise=true , address=104.36.82.38:4707    , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:43504->104.36.82.38:4707: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 23:25:26.614687790 (149h59m21.045767921s) [seg_pos={0 0}, upload=156000]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 23:25:26.614759687 (149h59m21.045839818s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 23:25:26.614763564 (149h59m21.045843695s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:25:27.350074072 (149h59m21.781154203s) [upload=156000]: Done uploading segments...
Aug 14 23:25:27.350115130 (149h59m21.781195261s) [upload=156000]: Upload finished. err: <nil>
Duration: 6.043102258s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [..................X.......X..................X........X.....]
duration:
1.965189173s
FAIL (2025-08-14 23:34:52 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 81c02bfcfd90e8245e2d7c8a2865ee22352f3defdf415bb9285961bec8babc20 != before 52f2f9d966313cbaa1d38e6fa4d5afff7f4eae33bca7ad00281333aff03d6be2
======LOGS======
Aug 14 23:30:29.426485301 (150h4m23.857565432s) [upload=156095]: Starting upload
Aug 14 23:30:29.426537110 (150h4m23.857617251s) [upload=156095]: Done starting upload
Aug 14 23:30:29.426597155 (150h4m23.857677296s) [upload=156095]: Uploading segments...
Aug 14 23:30:29.426657821 (150h4m23.857737952s) [upload=156095]: Got next segment. Inline: true
Aug 14 23:30:29.426661959 (150h4m23.85774209s) [upload=156095]: Waiting for error group managing segments...
Aug 14 23:30:29.426694651 (150h4m23.857774782s) [upload=156095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:30:29.426698579 (150h4m23.85777871s) [upload=156095]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 23:30:29.426701043 (150h4m23.857781174s) [upload=156095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:30:29.726950891 (150h4m24.158031023s) [upload=156095]: Done uploading segments...
Aug 14 23:30:29.726967833 (150h4m24.158047954s) [upload=156095]: Upload finished. err: <nil>
Duration: 1.965230723s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
8 out of 60 is failed (threshold=3) [XXXXXXXX....................................................]
duration:
6.254862669s
FAIL (2025-08-14 23:34:28 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.254883599s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [...................X.......X..................X........X....]
duration:
2.306223038s
FAIL (2025-08-14 23:34:08 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 81c02bfcfd90e8245e2d7c8a2865ee22352f3defdf415bb9285961bec8babc20 != before 52f2f9d966313cbaa1d38e6fa4d5afff7f4eae33bca7ad00281333aff03d6be2
======LOGS======
Aug 14 23:30:29.426485301 (150h4m23.857565432s) [upload=156095]: Starting upload
Aug 14 23:30:29.426537110 (150h4m23.857617251s) [upload=156095]: Done starting upload
Aug 14 23:30:29.426597155 (150h4m23.857677296s) [upload=156095]: Uploading segments...
Aug 14 23:30:29.426657821 (150h4m23.857737952s) [upload=156095]: Got next segment. Inline: true
Aug 14 23:30:29.426661959 (150h4m23.85774209s) [upload=156095]: Waiting for error group managing segments...
Aug 14 23:30:29.426694651 (150h4m23.857774782s) [upload=156095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:30:29.426698579 (150h4m23.85777871s) [upload=156095]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 23:30:29.426701043 (150h4m23.857781174s) [upload=156095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:30:29.726950891 (150h4m24.158031023s) [upload=156095]: Done uploading segments...
Aug 14 23:30:29.726967833 (150h4m24.158047954s) [upload=156095]: Upload finished. err: <nil>
Duration: 2.306253807s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
4 out of 60 is failed (threshold=3) [..........................X.............X....X..X...........]
duration:
6.851144582s
FAIL (2025-08-14 23:33:52 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 23:25:23.865082679 (149h59m18.29616281s) [upload=156000]: Starting upload
Aug 14 23:25:23.865134989 (149h59m18.29621512s) [upload=156000]: Done starting upload
Aug 14 23:25:23.865241213 (149h59m18.296321344s) [upload=156000]: Uploading segments...
Aug 14 23:25:23.865391189 (149h59m18.29647132s) [upload=156000]: Got next segment. Inline: false
Aug 14 23:25:23.865430435 (149h59m18.296510566s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:25:23.865434993 (149h59m18.296515114s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 23:25:24.427593929 (149h59m18.85867406s) [seg_pos={0 0}, upload=156000]: Begin upload segment...
Aug 14 23:25:24.427659504 (149h59m18.858739635s) [seg_pos={0 0}, upload=156000]: Done begin upload segment.
Aug 14 23:25:24.427681045 (149h59m18.858761167s) [noise=true , address=77.90.31.12:4594     , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.427712806 (149h59m18.858792937s) [noise=true , address=77.90.31.18:4809     , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428058338 (149h59m18.859138469s) [noise=true , address=79.127.219.48:4076   , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428321260 (149h59m18.859401391s) [noise=true , address=104.36.82.3:4796     , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428582981 (149h59m18.859663112s) [noise=true , address=104.36.82.62:4436    , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428780519 (149h59m18.85986064s) [noise=true , address=104.36.82.44:4889    , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428928291 (149h59m18.860008423s) [noise=true , address=104.36.82.34:4570    , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429112424 (149h59m18.860192555s) [noise=true , address=104.36.82.21:4494    , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429144285 (149h59m18.860224406s) [noise=true , address=77.90.31.19:4851     , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429170645 (149h59m18.860250776s) [noise=true , address=104.36.82.15:4290    , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429384725 (149h59m18.860464856s) [noise=true , address=104.36.82.38:4707    , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429432106 (149h59m18.860512227s) [noise=true , address=79.127.201.215:4347  , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429593535 (149h59m18.860673666s) [noise=true , address=104.36.82.46:4495    , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429704938 (149h59m18.860785059s) [noise=true , address=104.36.82.60:4365    , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429992358 (149h59m18.861072489s) [noise=true , address=104.36.82.51:4063    , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430255922 (149h59m18.861336053s) [noise=true , address=77.90.31.21:4891     , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430549503 (149h59m18.861629624s) [noise=true , address=104.36.82.59:4302    , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430809041 (149h59m18.861889172s) [noise=true , address=45.91.116.9:4266     , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:25.923497549 (149h59m20.35457768s) [upload=156000]: Next returned nil segment
Aug 14 23:25:25.923507829 (149h59m20.35458795s) [upload=156000]: Waiting for error group managing segments...
Aug 14 23:25:26.337042342 (149h59m20.768122463s) [noise=true , address=79.127.219.48:4076   , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.350688071 (149h59m20.781768202s) [noise=true , address=77.90.31.21:4891     , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.367283975 (149h59m20.798364106s) [noise=true , address=104.36.82.59:4302    , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.392847758 (149h59m20.823927889s) [noise=true , address=79.127.201.215:4347  , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.476671684 (149h59m20.907751805s) [noise=true , address=104.36.82.34:4570    , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.477883863 (149h59m20.908963994s) [noise=true , address=104.36.82.51:4063    , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.495071439 (149h59m20.92615157s) [noise=true , address=77.90.31.12:4594     , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.499490865 (149h59m20.930571016s) [noise=true , address=104.36.82.3:4796     , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.534749478 (149h59m20.965829599s) [noise=true , address=104.36.82.62:4436    , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.567397536 (149h59m20.998477667s) [noise=true , address=77.90.31.19:4851     , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.581324884 (149h59m21.012405015s) [noise=true , address=104.36.82.60:4365    , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.600511545 (149h59m21.031591676s) [noise=true , address=104.36.82.46:4495    , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.602312732 (149h59m21.033392863s) [noise=true , address=77.90.31.18:4809     , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.614279168 (149h59m21.045359299s) [noise=true , address=45.91.116.9:4266     , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.614295228 (149h59m21.045375359s) [seg_pos={0 0}, upload=156000]: Segment reached optimal threshold of 14 pieces.
Aug 14 23:25:26.614385762 (149h59m21.045465893s) [noise=true , address=104.36.82.44:4889    , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PCtJRFHPHi1dHJNcRnGZg8HZPQDfo5L3aw6DgVnUzVUz92Kyv): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614431238 (149h59m21.045511369s) [noise=true , address=104.36.82.15:4290    , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FmG5i2o4BwJmdL9u2tqKGmTAUErivGEe63TbfDTPpBdELozfz): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614559364 (149h59m21.045639485s) [noise=true , address=104.36.82.21:4494    , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sRaMuQG18B5SfPpzxp5VWjrwe38SS38g4askmbURxU9tepJHi): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614656349 (149h59m21.04573647s) [noise=true , address=104.36.82.38:4707    , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:43504->104.36.82.38:4707: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 23:25:26.614687790 (149h59m21.045767921s) [seg_pos={0 0}, upload=156000]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 23:25:26.614759687 (149h59m21.045839818s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 23:25:26.614763564 (149h59m21.045843695s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:25:27.350074072 (149h59m21.781154203s) [upload=156000]: Done uploading segments...
Aug 14 23:25:27.350115130 (149h59m21.781195261s) [upload=156000]: Upload finished. err: <nil>
Duration: 6.85116957s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
9 out of 60 is failed (threshold=3) [XXXXXXXXX...................................................]
duration:
6.330396198s
FAIL (2025-08-14 23:33:34 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.330451743s edge gateway us-select-1
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................]
duration:
742.908676ms
FAIL (2025-08-14 23:33:21 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error
Duration: 742.937351ms edge authservice http us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [....................X.......X..................X........X...]
duration:
2.262083694s
FAIL (2025-08-14 23:32:56 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 81c02bfcfd90e8245e2d7c8a2865ee22352f3defdf415bb9285961bec8babc20 != before 52f2f9d966313cbaa1d38e6fa4d5afff7f4eae33bca7ad00281333aff03d6be2
======LOGS======
Aug 14 23:30:29.426485301 (150h4m23.857565432s) [upload=156095]: Starting upload
Aug 14 23:30:29.426537110 (150h4m23.857617251s) [upload=156095]: Done starting upload
Aug 14 23:30:29.426597155 (150h4m23.857677296s) [upload=156095]: Uploading segments...
Aug 14 23:30:29.426657821 (150h4m23.857737952s) [upload=156095]: Got next segment. Inline: true
Aug 14 23:30:29.426661959 (150h4m23.85774209s) [upload=156095]: Waiting for error group managing segments...
Aug 14 23:30:29.426694651 (150h4m23.857774782s) [upload=156095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:30:29.426698579 (150h4m23.85777871s) [upload=156095]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 23:30:29.426701043 (150h4m23.857781174s) [upload=156095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:30:29.726950891 (150h4m24.158031023s) [upload=156095]: Done uploading segments...
Aug 14 23:30:29.726967833 (150h4m24.158047954s) [upload=156095]: Upload finished. err: <nil>
Duration: 2.262109905s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................]
duration:
732.170079ms
FAIL (2025-08-14 23:32:50 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error
Duration: 732.194205ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
10 out of 60 is failed (threshold=3) [XXXXXXXXXX..................................................]
duration:
5.974001471s
FAIL (2025-08-14 23:32:48 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.974026538s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
4 out of 60 is failed (threshold=3) [...........................X.............X....X..X..........]
duration:
6.322533124s
FAIL (2025-08-14 23:32:39 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 23:25:23.865082679 (149h59m18.29616281s) [upload=156000]: Starting upload
Aug 14 23:25:23.865134989 (149h59m18.29621512s) [upload=156000]: Done starting upload
Aug 14 23:25:23.865241213 (149h59m18.296321344s) [upload=156000]: Uploading segments...
Aug 14 23:25:23.865391189 (149h59m18.29647132s) [upload=156000]: Got next segment. Inline: false
Aug 14 23:25:23.865430435 (149h59m18.296510566s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:25:23.865434993 (149h59m18.296515114s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 23:25:24.427593929 (149h59m18.85867406s) [seg_pos={0 0}, upload=156000]: Begin upload segment...
Aug 14 23:25:24.427659504 (149h59m18.858739635s) [seg_pos={0 0}, upload=156000]: Done begin upload segment.
Aug 14 23:25:24.427681045 (149h59m18.858761167s) [noise=true , address=77.90.31.12:4594     , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.427712806 (149h59m18.858792937s) [noise=true , address=77.90.31.18:4809     , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428058338 (149h59m18.859138469s) [noise=true , address=79.127.219.48:4076   , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428321260 (149h59m18.859401391s) [noise=true , address=104.36.82.3:4796     , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428582981 (149h59m18.859663112s) [noise=true , address=104.36.82.62:4436    , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428780519 (149h59m18.85986064s) [noise=true , address=104.36.82.44:4889    , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428928291 (149h59m18.860008423s) [noise=true , address=104.36.82.34:4570    , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429112424 (149h59m18.860192555s) [noise=true , address=104.36.82.21:4494    , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429144285 (149h59m18.860224406s) [noise=true , address=77.90.31.19:4851     , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429170645 (149h59m18.860250776s) [noise=true , address=104.36.82.15:4290    , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429384725 (149h59m18.860464856s) [noise=true , address=104.36.82.38:4707    , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429432106 (149h59m18.860512227s) [noise=true , address=79.127.201.215:4347  , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429593535 (149h59m18.860673666s) [noise=true , address=104.36.82.46:4495    , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429704938 (149h59m18.860785059s) [noise=true , address=104.36.82.60:4365    , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429992358 (149h59m18.861072489s) [noise=true , address=104.36.82.51:4063    , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430255922 (149h59m18.861336053s) [noise=true , address=77.90.31.21:4891     , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430549503 (149h59m18.861629624s) [noise=true , address=104.36.82.59:4302    , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430809041 (149h59m18.861889172s) [noise=true , address=45.91.116.9:4266     , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:25.923497549 (149h59m20.35457768s) [upload=156000]: Next returned nil segment
Aug 14 23:25:25.923507829 (149h59m20.35458795s) [upload=156000]: Waiting for error group managing segments...
Aug 14 23:25:26.337042342 (149h59m20.768122463s) [noise=true , address=79.127.219.48:4076   , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.350688071 (149h59m20.781768202s) [noise=true , address=77.90.31.21:4891     , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.367283975 (149h59m20.798364106s) [noise=true , address=104.36.82.59:4302    , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.392847758 (149h59m20.823927889s) [noise=true , address=79.127.201.215:4347  , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.476671684 (149h59m20.907751805s) [noise=true , address=104.36.82.34:4570    , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.477883863 (149h59m20.908963994s) [noise=true , address=104.36.82.51:4063    , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.495071439 (149h59m20.92615157s) [noise=true , address=77.90.31.12:4594     , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.499490865 (149h59m20.930571016s) [noise=true , address=104.36.82.3:4796     , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.534749478 (149h59m20.965829599s) [noise=true , address=104.36.82.62:4436    , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.567397536 (149h59m20.998477667s) [noise=true , address=77.90.31.19:4851     , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.581324884 (149h59m21.012405015s) [noise=true , address=104.36.82.60:4365    , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.600511545 (149h59m21.031591676s) [noise=true , address=104.36.82.46:4495    , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.602312732 (149h59m21.033392863s) [noise=true , address=77.90.31.18:4809     , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.614279168 (149h59m21.045359299s) [noise=true , address=45.91.116.9:4266     , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.614295228 (149h59m21.045375359s) [seg_pos={0 0}, upload=156000]: Segment reached optimal threshold of 14 pieces.
Aug 14 23:25:26.614385762 (149h59m21.045465893s) [noise=true , address=104.36.82.44:4889    , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PCtJRFHPHi1dHJNcRnGZg8HZPQDfo5L3aw6DgVnUzVUz92Kyv): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614431238 (149h59m21.045511369s) [noise=true , address=104.36.82.15:4290    , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FmG5i2o4BwJmdL9u2tqKGmTAUErivGEe63TbfDTPpBdELozfz): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614559364 (149h59m21.045639485s) [noise=true , address=104.36.82.21:4494    , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sRaMuQG18B5SfPpzxp5VWjrwe38SS38g4askmbURxU9tepJHi): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614656349 (149h59m21.04573647s) [noise=true , address=104.36.82.38:4707    , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:43504->104.36.82.38:4707: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 23:25:26.614687790 (149h59m21.045767921s) [seg_pos={0 0}, upload=156000]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 23:25:26.614759687 (149h59m21.045839818s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 23:25:26.614763564 (149h59m21.045843695s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:25:27.350074072 (149h59m21.781154203s) [upload=156000]: Done uploading segments...
Aug 14 23:25:27.350115130 (149h59m21.781195261s) [upload=156000]: Upload finished. err: <nil>
Duration: 6.322556008s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................]
duration:
748.987409ms
FAIL (2025-08-14 23:32:23 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error
Duration: 749.02428ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
11 out of 60 is failed (threshold=3) [XXXXXXXXXXX.................................................]
duration:
6.157868203s
FAIL (2025-08-14 23:32:21 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.157887319s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [.....................X.......X..................X........X..]
duration:
1.862433505s
FAIL (2025-08-14 23:32:14 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 81c02bfcfd90e8245e2d7c8a2865ee22352f3defdf415bb9285961bec8babc20 != before 52f2f9d966313cbaa1d38e6fa4d5afff7f4eae33bca7ad00281333aff03d6be2
======LOGS======
Aug 14 23:30:29.426485301 (150h4m23.857565432s) [upload=156095]: Starting upload
Aug 14 23:30:29.426537110 (150h4m23.857617251s) [upload=156095]: Done starting upload
Aug 14 23:30:29.426597155 (150h4m23.857677296s) [upload=156095]: Uploading segments...
Aug 14 23:30:29.426657821 (150h4m23.857737952s) [upload=156095]: Got next segment. Inline: true
Aug 14 23:30:29.426661959 (150h4m23.85774209s) [upload=156095]: Waiting for error group managing segments...
Aug 14 23:30:29.426694651 (150h4m23.857774782s) [upload=156095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:30:29.426698579 (150h4m23.85777871s) [upload=156095]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 23:30:29.426701043 (150h4m23.857781174s) [upload=156095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:30:29.726950891 (150h4m24.158031023s) [upload=156095]: Done uploading segments...
Aug 14 23:30:29.726967833 (150h4m24.158047954s) [upload=156095]: Upload finished. err: <nil>
Duration: 1.862460616s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
12 out of 60 is failed (threshold=3) [XXXXXXXXXXXX................................................]
duration:
6.233396366s
FAIL (2025-08-14 23:31:58 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.233424759s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
4 out of 60 is failed (threshold=3) [............................X.............X....X..X.........]
duration:
6.410941177s
FAIL (2025-08-14 23:31:38 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 23:25:23.865082679 (149h59m18.29616281s) [upload=156000]: Starting upload
Aug 14 23:25:23.865134989 (149h59m18.29621512s) [upload=156000]: Done starting upload
Aug 14 23:25:23.865241213 (149h59m18.296321344s) [upload=156000]: Uploading segments...
Aug 14 23:25:23.865391189 (149h59m18.29647132s) [upload=156000]: Got next segment. Inline: false
Aug 14 23:25:23.865430435 (149h59m18.296510566s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:25:23.865434993 (149h59m18.296515114s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 23:25:24.427593929 (149h59m18.85867406s) [seg_pos={0 0}, upload=156000]: Begin upload segment...
Aug 14 23:25:24.427659504 (149h59m18.858739635s) [seg_pos={0 0}, upload=156000]: Done begin upload segment.
Aug 14 23:25:24.427681045 (149h59m18.858761167s) [noise=true , address=77.90.31.12:4594     , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.427712806 (149h59m18.858792937s) [noise=true , address=77.90.31.18:4809     , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428058338 (149h59m18.859138469s) [noise=true , address=79.127.219.48:4076   , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428321260 (149h59m18.859401391s) [noise=true , address=104.36.82.3:4796     , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428582981 (149h59m18.859663112s) [noise=true , address=104.36.82.62:4436    , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428780519 (149h59m18.85986064s) [noise=true , address=104.36.82.44:4889    , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428928291 (149h59m18.860008423s) [noise=true , address=104.36.82.34:4570    , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429112424 (149h59m18.860192555s) [noise=true , address=104.36.82.21:4494    , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429144285 (149h59m18.860224406s) [noise=true , address=77.90.31.19:4851     , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429170645 (149h59m18.860250776s) [noise=true , address=104.36.82.15:4290    , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429384725 (149h59m18.860464856s) [noise=true , address=104.36.82.38:4707    , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429432106 (149h59m18.860512227s) [noise=true , address=79.127.201.215:4347  , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429593535 (149h59m18.860673666s) [noise=true , address=104.36.82.46:4495    , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429704938 (149h59m18.860785059s) [noise=true , address=104.36.82.60:4365    , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429992358 (149h59m18.861072489s) [noise=true , address=104.36.82.51:4063    , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430255922 (149h59m18.861336053s) [noise=true , address=77.90.31.21:4891     , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430549503 (149h59m18.861629624s) [noise=true , address=104.36.82.59:4302    , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430809041 (149h59m18.861889172s) [noise=true , address=45.91.116.9:4266     , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:25.923497549 (149h59m20.35457768s) [upload=156000]: Next returned nil segment
Aug 14 23:25:25.923507829 (149h59m20.35458795s) [upload=156000]: Waiting for error group managing segments...
Aug 14 23:25:26.337042342 (149h59m20.768122463s) [noise=true , address=79.127.219.48:4076   , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.350688071 (149h59m20.781768202s) [noise=true , address=77.90.31.21:4891     , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.367283975 (149h59m20.798364106s) [noise=true , address=104.36.82.59:4302    , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.392847758 (149h59m20.823927889s) [noise=true , address=79.127.201.215:4347  , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.476671684 (149h59m20.907751805s) [noise=true , address=104.36.82.34:4570    , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.477883863 (149h59m20.908963994s) [noise=true , address=104.36.82.51:4063    , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.495071439 (149h59m20.92615157s) [noise=true , address=77.90.31.12:4594     , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.499490865 (149h59m20.930571016s) [noise=true , address=104.36.82.3:4796     , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.534749478 (149h59m20.965829599s) [noise=true , address=104.36.82.62:4436    , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.567397536 (149h59m20.998477667s) [noise=true , address=77.90.31.19:4851     , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.581324884 (149h59m21.012405015s) [noise=true , address=104.36.82.60:4365    , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.600511545 (149h59m21.031591676s) [noise=true , address=104.36.82.46:4495    , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.602312732 (149h59m21.033392863s) [noise=true , address=77.90.31.18:4809     , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.614279168 (149h59m21.045359299s) [noise=true , address=45.91.116.9:4266     , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.614295228 (149h59m21.045375359s) [seg_pos={0 0}, upload=156000]: Segment reached optimal threshold of 14 pieces.
Aug 14 23:25:26.614385762 (149h59m21.045465893s) [noise=true , address=104.36.82.44:4889    , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PCtJRFHPHi1dHJNcRnGZg8HZPQDfo5L3aw6DgVnUzVUz92Kyv): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614431238 (149h59m21.045511369s) [noise=true , address=104.36.82.15:4290    , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FmG5i2o4BwJmdL9u2tqKGmTAUErivGEe63TbfDTPpBdELozfz): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614559364 (149h59m21.045639485s) [noise=true , address=104.36.82.21:4494    , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sRaMuQG18B5SfPpzxp5VWjrwe38SS38g4askmbURxU9tepJHi): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614656349 (149h59m21.04573647s) [noise=true , address=104.36.82.38:4707    , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:43504->104.36.82.38:4707: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 23:25:26.614687790 (149h59m21.045767921s) [seg_pos={0 0}, upload=156000]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 23:25:26.614759687 (149h59m21.045839818s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 23:25:26.614763564 (149h59m21.045843695s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:25:27.350074072 (149h59m21.781154203s) [upload=156000]: Done uploading segments...
Aug 14 23:25:27.350115130 (149h59m21.781195261s) [upload=156000]: Upload finished. err: <nil>
Duration: 6.410972888s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.AuthServiceHTTP{"https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777"} failure (antiblip window 3/60): (authservice.us_select_1)
antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................]
duration:
816.306673ms
FAIL (2025-08-14 23:31:14 UTC)
orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": remote error: tls: internal error
Duration: 816.329407ms edge authservice http us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
13 out of 60 is failed (threshold=3) [XXXXXXXXXXXXX...............................................]
duration:
6.226644047s
FAIL (2025-08-14 23:31:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.226668915s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [......................X.......X..................X........X.]
duration:
1.85307932s
FAIL (2025-08-14 23:31:03 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 81c02bfcfd90e8245e2d7c8a2865ee22352f3defdf415bb9285961bec8babc20 != before 52f2f9d966313cbaa1d38e6fa4d5afff7f4eae33bca7ad00281333aff03d6be2
======LOGS======
Aug 14 23:30:29.426485301 (150h4m23.857565432s) [upload=156095]: Starting upload
Aug 14 23:30:29.426537110 (150h4m23.857617251s) [upload=156095]: Done starting upload
Aug 14 23:30:29.426597155 (150h4m23.857677296s) [upload=156095]: Uploading segments...
Aug 14 23:30:29.426657821 (150h4m23.857737952s) [upload=156095]: Got next segment. Inline: true
Aug 14 23:30:29.426661959 (150h4m23.85774209s) [upload=156095]: Waiting for error group managing segments...
Aug 14 23:30:29.426694651 (150h4m23.857774782s) [upload=156095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:30:29.426698579 (150h4m23.85777871s) [upload=156095]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 23:30:29.426701043 (150h4m23.857781174s) [upload=156095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:30:29.726950891 (150h4m24.158031023s) [upload=156095]: Done uploading segments...
Aug 14 23:30:29.726967833 (150h4m24.158047954s) [upload=156095]: Upload finished. err: <nil>
Duration: 1.853103155s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)
antiblip:
14 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXX..............................................]
duration:
6.162636989s
FAIL (2025-08-14 23:30:42 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.162660554s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
4 out of 60 is failed (threshold=3) [.............................X.............X....X..X........]
duration:
6.801968192s
FAIL (2025-08-14 23:30:32 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 14 23:25:23.865082679 (149h59m18.29616281s) [upload=156000]: Starting upload
Aug 14 23:25:23.865134989 (149h59m18.29621512s) [upload=156000]: Done starting upload
Aug 14 23:25:23.865241213 (149h59m18.296321344s) [upload=156000]: Uploading segments...
Aug 14 23:25:23.865391189 (149h59m18.29647132s) [upload=156000]: Got next segment. Inline: false
Aug 14 23:25:23.865430435 (149h59m18.296510566s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:25:23.865434993 (149h59m18.296515114s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 14 23:25:24.427593929 (149h59m18.85867406s) [seg_pos={0 0}, upload=156000]: Begin upload segment...
Aug 14 23:25:24.427659504 (149h59m18.858739635s) [seg_pos={0 0}, upload=156000]: Done begin upload segment.
Aug 14 23:25:24.427681045 (149h59m18.858761167s) [noise=true , address=77.90.31.12:4594     , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.427712806 (149h59m18.858792937s) [noise=true , address=77.90.31.18:4809     , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428058338 (149h59m18.859138469s) [noise=true , address=79.127.219.48:4076   , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428321260 (149h59m18.859401391s) [noise=true , address=104.36.82.3:4796     , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428582981 (149h59m18.859663112s) [noise=true , address=104.36.82.62:4436    , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428780519 (149h59m18.85986064s) [noise=true , address=104.36.82.44:4889    , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.428928291 (149h59m18.860008423s) [noise=true , address=104.36.82.34:4570    , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429112424 (149h59m18.860192555s) [noise=true , address=104.36.82.21:4494    , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429144285 (149h59m18.860224406s) [noise=true , address=77.90.31.19:4851     , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429170645 (149h59m18.860250776s) [noise=true , address=104.36.82.15:4290    , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429384725 (149h59m18.860464856s) [noise=true , address=104.36.82.38:4707    , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429432106 (149h59m18.860512227s) [noise=true , address=79.127.201.215:4347  , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429593535 (149h59m18.860673666s) [noise=true , address=104.36.82.46:4495    , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429704938 (149h59m18.860785059s) [noise=true , address=104.36.82.60:4365    , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.429992358 (149h59m18.861072489s) [noise=true , address=104.36.82.51:4063    , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430255922 (149h59m18.861336053s) [noise=true , address=77.90.31.21:4891     , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430549503 (149h59m18.861629624s) [noise=true , address=104.36.82.59:4302    , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:24.430809041 (149h59m18.861889172s) [noise=true , address=45.91.116.9:4266     , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Uploading piece...
Aug 14 23:25:25.923497549 (149h59m20.35457768s) [upload=156000]: Next returned nil segment
Aug 14 23:25:25.923507829 (149h59m20.35458795s) [upload=156000]: Waiting for error group managing segments...
Aug 14 23:25:26.337042342 (149h59m20.768122463s) [noise=true , address=79.127.219.48:4076   , piece_id=2MQMWXT5523NS5PYGDCQ4Z22CJ23KCN3S3UPCS7WI6TMU6X355CA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.350688071 (149h59m20.781768202s) [noise=true , address=77.90.31.21:4891     , piece_id=WK3MWAOBT4BQT5VA36KBN2RWUT5JVHBFPXTSZSRIH6J2HRSJW4IQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.367283975 (149h59m20.798364106s) [noise=true , address=104.36.82.59:4302    , piece_id=SFCJYOAJKPT26MASF3X4NYUHLV4HYCHPKCJUV2BWBH2TKC3RIVRA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.392847758 (149h59m20.823927889s) [noise=true , address=79.127.201.215:4347  , piece_id=FULXIVH2YVM3AVFF33XJFMEJK2QAM7EA6WS6I5X7XPT4TR7YQDYA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.476671684 (149h59m20.907751805s) [noise=true , address=104.36.82.34:4570    , piece_id=KUK5NYXHUA46Y3MZYC5USNVRSKUF6PLK5GSUPLWXRQXSECIOXLSQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.477883863 (149h59m20.908963994s) [noise=true , address=104.36.82.51:4063    , piece_id=OBDG6K567SOAA2DERKZP4GSZERTUHRJEI7BJ4MIVL3JHPNMVJG4Q, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.495071439 (149h59m20.92615157s) [noise=true , address=77.90.31.12:4594     , piece_id=PVTRB6VZG4GCAP44UDAKKP2VF4TN2ODKEBATJT7EYR2KD7EOQVMA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.499490865 (149h59m20.930571016s) [noise=true , address=104.36.82.3:4796     , piece_id=5JBUWYKUBQHHBR2A7BZJOCN7HEQJKQ6FX3MWQS55QI7LGUH5PKSA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.534749478 (149h59m20.965829599s) [noise=true , address=104.36.82.62:4436    , piece_id=5RTH5H3PD755UV2XLIRW5CNMDCZY6VCOTIKNZF7IMVMFDV5CQLQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.567397536 (149h59m20.998477667s) [noise=true , address=77.90.31.19:4851     , piece_id=RWQ6L76GA66LIVEHAYGU7SWE7T2LC6GGZ6NQJVTGHVZ76CA6X3EQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.581324884 (149h59m21.012405015s) [noise=true , address=104.36.82.60:4365    , piece_id=7WYNE5TBGOJM5R7MVCIZ7CDG5737XZGVMQRSFSPCVEWHRGSY3XMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.600511545 (149h59m21.031591676s) [noise=true , address=104.36.82.46:4495    , piece_id=XNRCALQ6NSXEBUV7Z25OQ2E4DLDREK3XQKCNHZH3YWXA4OFIPVPA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.602312732 (149h59m21.033392863s) [noise=true , address=77.90.31.18:4809     , piece_id=TFDTIW6CWJXTN3KKGJTIACJT4ZXCSRAE4CM2W25BWPRLLGZI5UGA, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.614279168 (149h59m21.045359299s) [noise=true , address=45.91.116.9:4266     , piece_id=R6LXPDABDOXCMIFF2PV43BSKRBH4KXPLCGPZ3DU3H7HL66WWYWNQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: <nil>
Aug 14 23:25:26.614295228 (149h59m21.045375359s) [seg_pos={0 0}, upload=156000]: Segment reached optimal threshold of 14 pieces.
Aug 14 23:25:26.614385762 (149h59m21.045465893s) [noise=true , address=104.36.82.44:4889    , piece_id=H2KS4DZ6I5UZ42TNCNXTPGYU573Q2KB45OBK3MTNP32H4Q2ILUDQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1PCtJRFHPHi1dHJNcRnGZg8HZPQDfo5L3aw6DgVnUzVUz92Kyv): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614431238 (149h59m21.045511369s) [noise=true , address=104.36.82.15:4290    , piece_id=AM4FQ7FJUUI5LTV4RIETMT6MW5CS6V35B5QN52SDXKW5OD5YKFAQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12FmG5i2o4BwJmdL9u2tqKGmTAUErivGEe63TbfDTPpBdELozfz): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614559364 (149h59m21.045639485s) [noise=true , address=104.36.82.21:4494    , piece_id=3EU3EVA4ESIIUW5MVSAJEV5BP6GYIF4YSYFANMPU3H6EYD7M3HQQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1sRaMuQG18B5SfPpzxp5VWjrwe38SS38g4askmbURxU9tepJHi): protocol: expected piece hash; context canceled; EOF
Aug 14 23:25:26.614656349 (149h59m21.04573647s) [noise=true , address=104.36.82.38:4707    , piece_id=6W3I4M7OO56SXQ6737N5LYU6EKXC3FOKJBDSS4XFRIWLFTTNGQMQ, seg_pos={0 0}, upload=156000]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1N7XaDABpimefP5xEz5Swk53fiZk4DTv5L8Hg5cNDgeG6gHP1T): protocol: write tcp 188.166.225.170:43504->104.36.82.38:4707: use of closed network connection; conn closed: op; piecestore: piecestore close: conn closed: op
Aug 14 23:25:26.614687790 (149h59m21.045767921s) [seg_pos={0 0}, upload=156000]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 14 23:25:26.614759687 (149h59m21.045839818s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 14 23:25:26.614763564 (149h59m21.045843695s) [upload=156000]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:25:27.350074072 (149h59m21.781154203s) [upload=156000]: Done uploading segments...
Aug 14 23:25:27.350115130 (149h59m21.781195261s) [upload=156000]: Upload finished. err: <nil>
Duration: 6.80199345s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
4 out of 60 is failed (threshold=3) [.......................X.......X..................X........X]
duration:
1.80268775s
FAIL (2025-08-14 23:30:30 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/1K):: after 81c02bfcfd90e8245e2d7c8a2865ee22352f3defdf415bb9285961bec8babc20 != before 52f2f9d966313cbaa1d38e6fa4d5afff7f4eae33bca7ad00281333aff03d6be2
======LOGS======
Aug 14 23:30:29.426485301 (150h4m23.857565432s) [upload=156095]: Starting upload
Aug 14 23:30:29.426537110 (150h4m23.857617251s) [upload=156095]: Done starting upload
Aug 14 23:30:29.426597155 (150h4m23.857677296s) [upload=156095]: Uploading segments...
Aug 14 23:30:29.426657821 (150h4m23.857737952s) [upload=156095]: Got next segment. Inline: true
Aug 14 23:30:29.426661959 (150h4m23.85774209s) [upload=156095]: Waiting for error group managing segments...
Aug 14 23:30:29.426694651 (150h4m23.857774782s) [upload=156095]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 14 23:30:29.426698579 (150h4m23.85777871s) [upload=156095]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 14 23:30:29.426701043 (150h4m23.857781174s) [upload=156095]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 14 23:30:29.726950891 (150h4m24.158031023s) [upload=156095]: Done uploading segments...
Aug 14 23:30:29.726967833 (150h4m24.158047954s) [upload=156095]: Upload finished. err: <nil>
Duration: 1.80271968s core uplink us-select-1 us1-placement-20 metainfo-projects