Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure

Orbiter Check History

Showing 50 of 889833 reports (Page 15597 of 17797)
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [................X..........X................................]
duration:
2.01405163s
FAIL (2025-08-12 17:03:26 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 12 16:39:09.008146755 (95h13m3.439226887s) [upload=99194]: Starting upload
Aug 12 16:39:09.008201260 (95h13m3.439281391s) [upload=99194]: Done starting upload
Aug 12 16:39:09.008258329 (95h13m3.43933846s) [upload=99194]: Uploading segments...
Aug 12 16:39:09.008290200 (95h13m3.439370331s) [upload=99194]: Got next segment. Inline: true
Aug 12 16:39:09.008295661 (95h13m3.439375782s) [upload=99194]: Waiting for error group managing segments...
Aug 12 16:39:09.008328123 (95h13m3.439408254s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:39:09.008334585 (95h13m3.439414716s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 12 16:39:09.008337160 (95h13m3.439417281s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:39:09.337170261 (95h13m3.768250392s) [upload=99194]: Done uploading segments...
Aug 12 16:39:09.337190520 (95h13m3.768270651s) [upload=99194]: Upload finished. err: <nil>
Duration: 2.014080255s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
6 out of 60 is failed (threshold=3) [........X.X...X.............................X.X.........X...]
duration:
6.165660725s
FAIL (2025-08-12 17:03:05 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 16:59:38.687530140 (95h33m33.118610271s) [upload=99560]: Starting upload
Aug 12 16:59:38.687574635 (95h33m33.118654766s) [upload=99560]: Done starting upload
Aug 12 16:59:38.687634360 (95h33m33.118714491s) [upload=99560]: Uploading segments...
Aug 12 16:59:38.687738799 (95h33m33.11881892s) [upload=99560]: Got next segment. Inline: false
Aug 12 16:59:38.687772675 (95h33m33.118852806s) [upload=99560]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:59:38.687777594 (95h33m33.118857725s) [upload=99560]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:59:39.197902742 (95h33m33.628982873s) [seg_pos={0 0}, upload=99560]: Begin upload segment...
Aug 12 16:59:39.197949550 (95h33m33.629029682s) [seg_pos={0 0}, upload=99560]: Done begin upload segment.
Aug 12 16:59:39.197963598 (95h33m33.629043729s) [noise=true , address=104.36.82.21:4495    , piece_id=6PW2LL4YAWQO6EGJWRPGO7PDK7VRJ63Y6E5FIS3FIMQDQS37JE2Q, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.197979778 (95h33m33.629059909s) [noise=true , address=104.36.82.61:4405    , piece_id=42XK2XF4LW6JDERRITW4BGU4SASVH5XAIAI4I7H7WJBMPDD2UVZQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.198019174 (95h33m33.629099305s) [noise=true , address=104.36.82.62:4410    , piece_id=NNHLCIVHJSFAQOF5BPARODUZ7NDKRIO7VZ4TXMDPSIT7CPBM7LGA, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.198062236 (95h33m33.629142357s) [noise=true , address=77.90.31.19:4844     , piece_id=6ACO5XJCM7JKXI6DZNS7Q6FMNIIF2H4QX5GFFZP275LGK4LAG6KQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.198334707 (95h33m33.629414828s) [noise=true , address=104.36.82.58:4285    , piece_id=RSNIOADYVBK6XD3XNUUNRLYBSDKJNLXTGGQSUQA5MF2KOGCY7WVQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.198339377 (95h33m33.629419508s) [noise=true , address=79.127.201.214:4320  , piece_id=KTDAMSYK7CDMKJDYD7EL45LDWFRECADQYJWINN6BFJUKFCHCXKCQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.198607269 (95h33m33.6296874s) [noise=true , address=104.36.82.23:4467    , piece_id=72OG4FRL66Q522MHHPWUEX5F7TBW7BHTNBUEB2FTLVX6GNEKEBUQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.198865934 (95h33m33.629946065s) [noise=true , address=104.36.82.35:4607    , piece_id=MEGUKOCNGAXTQF6JKS4UM2FTUOJNH22XUUCEOLZG56XXBFRESSRQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.200169648 (95h33m33.631249779s) [noise=true , address=104.36.82.35:4583    , piece_id=F425SAQ7MSRGMEAFG75XFNNVQPJOXKKXOCF4DXUYB3ZJJX7O3Y2Q, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.200909183 (95h33m33.631989315s) [noise=true , address=104.36.82.3:4796     , piece_id=GKGL3BVJKJI34563P6NAAMQBH6K53WQ2XR5A5TRPTA4VK24WN7HA, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.201550832 (95h33m33.632630963s) [noise=true , address=104.36.82.47:4519    , piece_id=CWQ2QS6LJLG2MGBY3B5KHVUKDJQ64ZAWHCQSEIMBHYXVZ2KQONWA, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.202192539 (95h33m33.63327267s) [noise=true , address=193.149.164.143:4698 , piece_id=I7BDBG7QK66PCZNNU3MDNT3IENTGDLSMHIQMFDAJGGGLTWNNW7IA, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.202627732 (95h33m33.633707863s) [noise=true , address=104.36.82.5:4869     , piece_id=TOHQG3BR5YJQNJDMVDWUZ6DLBKNOI5NCOCOI6G2L44BSJ24CR42Q, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.202954337 (95h33m33.634034468s) [noise=true , address=104.36.82.46:4490    , piece_id=MFHE7SH22T6KPVQD57THJ47O7ANA3UL6DSXPXE5VKKZGZHCXHWMQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.203178796 (95h33m33.634258927s) [noise=true , address=104.36.82.18:4366    , piece_id=ABVSGRVBMLWFCYO4RGTYAZ4XMYFCKKL4OMFAMS2WLD4OFNCHKUZQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.203380622 (95h33m33.634460753s) [noise=true , address=104.36.82.16:4297    , piece_id=VDDGO3TNUEPV45LB3J65UZX7WYF4BORGTQ5FZDLOLPUIWGHFDG6Q, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.203821095 (95h33m33.634901226s) [noise=true , address=79.127.201.215:4350  , piece_id=J5FYRE2SDV7OCGN2OK3BBY2TZ6JKCJ5TUIPJ67SEMTQRBIJN3E2A, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.205764854 (95h33m33.636844995s) [noise=true , address=104.36.82.60:4372    , piece_id=M54ATKGBFCQWGXWTCFU7GDGGWPTN5UJONPFDT6QEW4BP5CJCRKIA, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:40.363639120 (95h33m34.794719261s) [upload=99560]: Next returned nil segment
Aug 12 16:59:40.363657104 (95h33m34.794737235s) [upload=99560]: Waiting for error group managing segments...
Aug 12 16:59:40.692247382 (95h33m35.123327513s) [noise=true , address=193.149.164.143:4698 , piece_id=I7BDBG7QK66PCZNNU3MDNT3IENTGDLSMHIQMFDAJGGGLTWNNW7IA, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.169955785 (95h33m35.601035916s) [noise=true , address=104.36.82.21:4495    , piece_id=6PW2LL4YAWQO6EGJWRPGO7PDK7VRJ63Y6E5FIS3FIMQDQS37JE2Q, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.173959115 (95h33m35.605039236s) [noise=true , address=77.90.31.19:4844     , piece_id=6ACO5XJCM7JKXI6DZNS7Q6FMNIIF2H4QX5GFFZP275LGK4LAG6KQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.202640181 (95h33m35.633720302s) [noise=true , address=104.36.82.62:4410    , piece_id=NNHLCIVHJSFAQOF5BPARODUZ7NDKRIO7VZ4TXMDPSIT7CPBM7LGA, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.217521444 (95h33m35.648601575s) [noise=true , address=104.36.82.47:4519    , piece_id=CWQ2QS6LJLG2MGBY3B5KHVUKDJQ64ZAWHCQSEIMBHYXVZ2KQONWA, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.246049799 (95h33m35.67712993s) [noise=true , address=104.36.82.3:4796     , piece_id=GKGL3BVJKJI34563P6NAAMQBH6K53WQ2XR5A5TRPTA4VK24WN7HA, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.264431349 (95h33m35.69551148s) [noise=true , address=104.36.82.18:4366    , piece_id=ABVSGRVBMLWFCYO4RGTYAZ4XMYFCKKL4OMFAMS2WLD4OFNCHKUZQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.367834365 (95h33m35.798914496s) [noise=true , address=104.36.82.60:4372    , piece_id=M54ATKGBFCQWGXWTCFU7GDGGWPTN5UJONPFDT6QEW4BP5CJCRKIA, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.368115543 (95h33m35.799195664s) [noise=true , address=104.36.82.58:4285    , piece_id=RSNIOADYVBK6XD3XNUUNRLYBSDKJNLXTGGQSUQA5MF2KOGCY7WVQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.396228793 (95h33m35.827308934s) [noise=true , address=104.36.82.46:4490    , piece_id=MFHE7SH22T6KPVQD57THJ47O7ANA3UL6DSXPXE5VKKZGZHCXHWMQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.404358458 (95h33m35.835438599s) [noise=true , address=104.36.82.35:4583    , piece_id=F425SAQ7MSRGMEAFG75XFNNVQPJOXKKXOCF4DXUYB3ZJJX7O3Y2Q, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.424749884 (95h33m35.855830015s) [noise=true , address=104.36.82.16:4297    , piece_id=VDDGO3TNUEPV45LB3J65UZX7WYF4BORGTQ5FZDLOLPUIWGHFDG6Q, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.457148824 (95h33m35.888228945s) [noise=true , address=104.36.82.35:4607    , piece_id=MEGUKOCNGAXTQF6JKS4UM2FTUOJNH22XUUCEOLZG56XXBFRESSRQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.505612983 (95h33m35.936693114s) [noise=true , address=104.36.82.61:4405    , piece_id=42XK2XF4LW6JDERRITW4BGU4SASVH5XAIAI4I7H7WJBMPDD2UVZQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.505632861 (95h33m35.936712992s) [seg_pos={0 0}, upload=99560]: Segment reached optimal threshold of 14 pieces.
Aug 12 16:59:41.505886516 (95h33m35.936966647s) [noise=true , address=79.127.201.214:4320  , piece_id=KTDAMSYK7CDMKJDYD7EL45LDWFRECADQYJWINN6BFJUKFCHCXKCQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLCXYP6sppXZcmj49C8jjgXbLGzgyowtpb1um9XZguzfVnM2r): protocol: expected piece hash; context canceled; EOF
Aug 12 16:59:41.505927656 (95h33m35.937007787s) [noise=true , address=104.36.82.23:4467    , piece_id=72OG4FRL66Q522MHHPWUEX5F7TBW7BHTNBUEB2FTLVX6GNEKEBUQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RegmCcGuZED5cPuhVJ9mLRuouCHBEZ3hecf7aseHsMCgo1ajT): protocol: expected piece hash; context canceled; EOF
Aug 12 16:59:41.505990275 (95h33m35.937070406s) [noise=true , address=79.127.201.215:4350  , piece_id=J5FYRE2SDV7OCGN2OK3BBY2TZ6JKCJ5TUIPJ67SEMTQRBIJN3E2A, seg_pos={0 0}, upload=99560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 12 16:59:41.506052915 (95h33m35.937133036s) [noise=true , address=104.36.82.5:4869     , piece_id=TOHQG3BR5YJQNJDMVDWUZ6DLBKNOI5NCOCOI6G2L44BSJ24CR42Q, seg_pos={0 0}, upload=99560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1273igSPBbnYnP5bTMPjCphwkCSK4WdBdBMFVgfnrPaq4oSUZQr): protocol: write tcp 188.166.225.170:39306->104.36.82.5:4869: use of closed network connection; write tcp 188.166.225.170:39306->104.36.82.5:4869: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39306->104.36.82.5:4869: use of closed network connection
Aug 12 16:59:41.506075017 (95h33m35.937155148s) [seg_pos={0 0}, upload=99560]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 16:59:41.506137476 (95h33m35.937217597s) [upload=99560]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:59:41.506141796 (95h33m35.937221927s) [upload=99560]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:59:41.812022822 (95h33m36.243102943s) [upload=99560]: Done uploading segments...
Aug 12 16:59:41.812034574 (95h33m36.243114695s) [upload=99560]: Upload finished. err: <nil>
Duration: 6.165685883s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................]
duration:
6.320443429s
FAIL (2025-08-12 17:03:04 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
Aug 12 16:51:00.342944596 (95h24m54.774024727s) [upload=99416]: Starting upload
Aug 12 16:51:00.343003058 (95h24m54.774083189s) [upload=99416]: Done starting upload
Aug 12 16:51:00.343093682 (95h24m54.774173803s) [upload=99416]: Uploading segments...
Aug 12 16:51:00.343214823 (95h24m54.774294954s) [upload=99416]: Got next segment. Inline: false
Aug 12 16:51:00.343269027 (95h24m54.774349158s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:51:00.343273756 (95h24m54.774353887s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:51:00.585349151 (95h24m55.016429282s) [seg_pos={0 0}, upload=99416]: Begin upload segment...
Aug 12 16:51:00.585396822 (95h24m55.016476973s) [seg_pos={0 0}, upload=99416]: Done begin upload segment.
Aug 12 16:51:00.585410067 (95h24m55.016490208s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585507734 (95h24m55.016587895s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585886159 (95h24m55.0169663s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586089607 (95h24m55.017169738s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586541652 (95h24m55.017621803s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587004688 (95h24m55.018084819s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587619234 (95h24m55.018699385s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587983842 (95h24m55.019063983s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588303153 (95h24m55.019383284s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588688090 (95h24m55.019768221s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.589902393 (95h24m55.020982534s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.590674450 (95h24m55.021754601s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.591296961 (95h24m55.022377092s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.592189969 (95h24m55.02327011s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.593156619 (95h24m55.02423678s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.594056290 (95h24m55.025136421s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:02.362133336 (95h24m56.793213467s) [upload=99416]: Next returned nil segment
Aug 12 16:51:02.362159547 (95h24m56.793239678s) [upload=99416]: Waiting for error group managing segments...
Aug 12 16:51:02.650293798 (95h24m57.081373929s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.663772758 (95h24m57.094852919s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.696344749 (95h24m57.12742488s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.709104884 (95h24m57.140185025s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.722233484 (95h24m57.153313625s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.727048907 (95h24m57.158129038s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.741870376 (95h24m57.172950507s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.772732365 (95h24m57.203812507s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.805755481 (95h24m57.236835612s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.878280266 (95h24m57.309360397s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.913734542 (95h24m57.344814673s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.972369120 (95h24m57.403449251s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983815812 (95h24m57.414895943s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983842733 (95h24m57.414922864s) [seg_pos={0 0}, upload=99416]: Segment reached optimal threshold of 13 pieces.
Aug 12 16:51:02.983942084 (95h24m57.415022215s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.983999583 (95h24m57.415079715s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984087211 (95h24m57.415167342s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984124363 (95h24m57.415204494s) [seg_pos={0 0}, upload=99416]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 12 16:51:02.984229683 (95h24m57.415309814s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:51:02.984234323 (95h24m57.415314454s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:51:03.289516404 (95h24m57.720596575s) [upload=99416]: Done uploading segments...
Aug 12 16:51:03.289540049 (95h24m57.7206202s) [upload=99416]: Upload finished. err: <nil>
Duration: 6.320472804s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................]
duration:
6.232739743s
FAIL (2025-08-12 17:02:30 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
Aug 12 16:51:00.342944596 (95h24m54.774024727s) [upload=99416]: Starting upload
Aug 12 16:51:00.343003058 (95h24m54.774083189s) [upload=99416]: Done starting upload
Aug 12 16:51:00.343093682 (95h24m54.774173803s) [upload=99416]: Uploading segments...
Aug 12 16:51:00.343214823 (95h24m54.774294954s) [upload=99416]: Got next segment. Inline: false
Aug 12 16:51:00.343269027 (95h24m54.774349158s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:51:00.343273756 (95h24m54.774353887s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:51:00.585349151 (95h24m55.016429282s) [seg_pos={0 0}, upload=99416]: Begin upload segment...
Aug 12 16:51:00.585396822 (95h24m55.016476973s) [seg_pos={0 0}, upload=99416]: Done begin upload segment.
Aug 12 16:51:00.585410067 (95h24m55.016490208s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585507734 (95h24m55.016587895s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585886159 (95h24m55.0169663s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586089607 (95h24m55.017169738s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586541652 (95h24m55.017621803s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587004688 (95h24m55.018084819s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587619234 (95h24m55.018699385s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587983842 (95h24m55.019063983s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588303153 (95h24m55.019383284s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588688090 (95h24m55.019768221s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.589902393 (95h24m55.020982534s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.590674450 (95h24m55.021754601s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.591296961 (95h24m55.022377092s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.592189969 (95h24m55.02327011s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.593156619 (95h24m55.02423678s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.594056290 (95h24m55.025136421s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:02.362133336 (95h24m56.793213467s) [upload=99416]: Next returned nil segment
Aug 12 16:51:02.362159547 (95h24m56.793239678s) [upload=99416]: Waiting for error group managing segments...
Aug 12 16:51:02.650293798 (95h24m57.081373929s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.663772758 (95h24m57.094852919s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.696344749 (95h24m57.12742488s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.709104884 (95h24m57.140185025s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.722233484 (95h24m57.153313625s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.727048907 (95h24m57.158129038s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.741870376 (95h24m57.172950507s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.772732365 (95h24m57.203812507s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.805755481 (95h24m57.236835612s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.878280266 (95h24m57.309360397s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.913734542 (95h24m57.344814673s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.972369120 (95h24m57.403449251s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983815812 (95h24m57.414895943s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983842733 (95h24m57.414922864s) [seg_pos={0 0}, upload=99416]: Segment reached optimal threshold of 13 pieces.
Aug 12 16:51:02.983942084 (95h24m57.415022215s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.983999583 (95h24m57.415079715s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984087211 (95h24m57.415167342s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984124363 (95h24m57.415204494s) [seg_pos={0 0}, upload=99416]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 12 16:51:02.984229683 (95h24m57.415309814s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:51:02.984234323 (95h24m57.415314454s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:51:03.289516404 (95h24m57.720596575s) [upload=99416]: Done uploading segments...
Aug 12 16:51:03.289540049 (95h24m57.7206202s) [upload=99416]: Upload finished. err: <nil>
Duration: 6.232764349s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [.................X..........X...............................]
duration:
1.993275158s
FAIL (2025-08-12 17:02:23 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 12 16:39:09.008146755 (95h13m3.439226887s) [upload=99194]: Starting upload
Aug 12 16:39:09.008201260 (95h13m3.439281391s) [upload=99194]: Done starting upload
Aug 12 16:39:09.008258329 (95h13m3.43933846s) [upload=99194]: Uploading segments...
Aug 12 16:39:09.008290200 (95h13m3.439370331s) [upload=99194]: Got next segment. Inline: true
Aug 12 16:39:09.008295661 (95h13m3.439375782s) [upload=99194]: Waiting for error group managing segments...
Aug 12 16:39:09.008328123 (95h13m3.439408254s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:39:09.008334585 (95h13m3.439414716s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 12 16:39:09.008337160 (95h13m3.439417281s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:39:09.337170261 (95h13m3.768250392s) [upload=99194]: Done uploading segments...
Aug 12 16:39:09.337190520 (95h13m3.768270651s) [upload=99194]: Upload finished. err: <nil>
Duration: 1.993303271s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............]
duration:
6.059061462s
FAIL (2025-08-12 17:02:13 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
Aug 12 16:51:00.342944596 (95h24m54.774024727s) [upload=99416]: Starting upload
Aug 12 16:51:00.343003058 (95h24m54.774083189s) [upload=99416]: Done starting upload
Aug 12 16:51:00.343093682 (95h24m54.774173803s) [upload=99416]: Uploading segments...
Aug 12 16:51:00.343214823 (95h24m54.774294954s) [upload=99416]: Got next segment. Inline: false
Aug 12 16:51:00.343269027 (95h24m54.774349158s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:51:00.343273756 (95h24m54.774353887s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:51:00.585349151 (95h24m55.016429282s) [seg_pos={0 0}, upload=99416]: Begin upload segment...
Aug 12 16:51:00.585396822 (95h24m55.016476973s) [seg_pos={0 0}, upload=99416]: Done begin upload segment.
Aug 12 16:51:00.585410067 (95h24m55.016490208s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585507734 (95h24m55.016587895s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585886159 (95h24m55.0169663s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586089607 (95h24m55.017169738s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586541652 (95h24m55.017621803s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587004688 (95h24m55.018084819s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587619234 (95h24m55.018699385s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587983842 (95h24m55.019063983s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588303153 (95h24m55.019383284s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588688090 (95h24m55.019768221s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.589902393 (95h24m55.020982534s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.590674450 (95h24m55.021754601s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.591296961 (95h24m55.022377092s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.592189969 (95h24m55.02327011s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.593156619 (95h24m55.02423678s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.594056290 (95h24m55.025136421s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:02.362133336 (95h24m56.793213467s) [upload=99416]: Next returned nil segment
Aug 12 16:51:02.362159547 (95h24m56.793239678s) [upload=99416]: Waiting for error group managing segments...
Aug 12 16:51:02.650293798 (95h24m57.081373929s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.663772758 (95h24m57.094852919s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.696344749 (95h24m57.12742488s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.709104884 (95h24m57.140185025s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.722233484 (95h24m57.153313625s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.727048907 (95h24m57.158129038s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.741870376 (95h24m57.172950507s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.772732365 (95h24m57.203812507s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.805755481 (95h24m57.236835612s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.878280266 (95h24m57.309360397s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.913734542 (95h24m57.344814673s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.972369120 (95h24m57.403449251s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983815812 (95h24m57.414895943s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983842733 (95h24m57.414922864s) [seg_pos={0 0}, upload=99416]: Segment reached optimal threshold of 13 pieces.
Aug 12 16:51:02.983942084 (95h24m57.415022215s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.983999583 (95h24m57.415079715s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984087211 (95h24m57.415167342s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984124363 (95h24m57.415204494s) [seg_pos={0 0}, upload=99416]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 12 16:51:02.984229683 (95h24m57.415309814s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:51:02.984234323 (95h24m57.415314454s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:51:03.289516404 (95h24m57.720596575s) [upload=99416]: Done uploading segments...
Aug 12 16:51:03.289540049 (95h24m57.7206202s) [upload=99416]: Upload finished. err: <nil>
Duration: 6.059092201s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
6 out of 60 is failed (threshold=3) [.........X.X...X.............................X.X.........X..]
duration:
5.847067412s
FAIL (2025-08-12 17:01:51 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 16:59:38.687530140 (95h33m33.118610271s) [upload=99560]: Starting upload
Aug 12 16:59:38.687574635 (95h33m33.118654766s) [upload=99560]: Done starting upload
Aug 12 16:59:38.687634360 (95h33m33.118714491s) [upload=99560]: Uploading segments...
Aug 12 16:59:38.687738799 (95h33m33.11881892s) [upload=99560]: Got next segment. Inline: false
Aug 12 16:59:38.687772675 (95h33m33.118852806s) [upload=99560]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:59:38.687777594 (95h33m33.118857725s) [upload=99560]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:59:39.197902742 (95h33m33.628982873s) [seg_pos={0 0}, upload=99560]: Begin upload segment...
Aug 12 16:59:39.197949550 (95h33m33.629029682s) [seg_pos={0 0}, upload=99560]: Done begin upload segment.
Aug 12 16:59:39.197963598 (95h33m33.629043729s) [noise=true , address=104.36.82.21:4495    , piece_id=6PW2LL4YAWQO6EGJWRPGO7PDK7VRJ63Y6E5FIS3FIMQDQS37JE2Q, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.197979778 (95h33m33.629059909s) [noise=true , address=104.36.82.61:4405    , piece_id=42XK2XF4LW6JDERRITW4BGU4SASVH5XAIAI4I7H7WJBMPDD2UVZQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.198019174 (95h33m33.629099305s) [noise=true , address=104.36.82.62:4410    , piece_id=NNHLCIVHJSFAQOF5BPARODUZ7NDKRIO7VZ4TXMDPSIT7CPBM7LGA, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.198062236 (95h33m33.629142357s) [noise=true , address=77.90.31.19:4844     , piece_id=6ACO5XJCM7JKXI6DZNS7Q6FMNIIF2H4QX5GFFZP275LGK4LAG6KQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.198334707 (95h33m33.629414828s) [noise=true , address=104.36.82.58:4285    , piece_id=RSNIOADYVBK6XD3XNUUNRLYBSDKJNLXTGGQSUQA5MF2KOGCY7WVQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.198339377 (95h33m33.629419508s) [noise=true , address=79.127.201.214:4320  , piece_id=KTDAMSYK7CDMKJDYD7EL45LDWFRECADQYJWINN6BFJUKFCHCXKCQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.198607269 (95h33m33.6296874s) [noise=true , address=104.36.82.23:4467    , piece_id=72OG4FRL66Q522MHHPWUEX5F7TBW7BHTNBUEB2FTLVX6GNEKEBUQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.198865934 (95h33m33.629946065s) [noise=true , address=104.36.82.35:4607    , piece_id=MEGUKOCNGAXTQF6JKS4UM2FTUOJNH22XUUCEOLZG56XXBFRESSRQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.200169648 (95h33m33.631249779s) [noise=true , address=104.36.82.35:4583    , piece_id=F425SAQ7MSRGMEAFG75XFNNVQPJOXKKXOCF4DXUYB3ZJJX7O3Y2Q, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.200909183 (95h33m33.631989315s) [noise=true , address=104.36.82.3:4796     , piece_id=GKGL3BVJKJI34563P6NAAMQBH6K53WQ2XR5A5TRPTA4VK24WN7HA, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.201550832 (95h33m33.632630963s) [noise=true , address=104.36.82.47:4519    , piece_id=CWQ2QS6LJLG2MGBY3B5KHVUKDJQ64ZAWHCQSEIMBHYXVZ2KQONWA, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.202192539 (95h33m33.63327267s) [noise=true , address=193.149.164.143:4698 , piece_id=I7BDBG7QK66PCZNNU3MDNT3IENTGDLSMHIQMFDAJGGGLTWNNW7IA, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.202627732 (95h33m33.633707863s) [noise=true , address=104.36.82.5:4869     , piece_id=TOHQG3BR5YJQNJDMVDWUZ6DLBKNOI5NCOCOI6G2L44BSJ24CR42Q, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.202954337 (95h33m33.634034468s) [noise=true , address=104.36.82.46:4490    , piece_id=MFHE7SH22T6KPVQD57THJ47O7ANA3UL6DSXPXE5VKKZGZHCXHWMQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.203178796 (95h33m33.634258927s) [noise=true , address=104.36.82.18:4366    , piece_id=ABVSGRVBMLWFCYO4RGTYAZ4XMYFCKKL4OMFAMS2WLD4OFNCHKUZQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.203380622 (95h33m33.634460753s) [noise=true , address=104.36.82.16:4297    , piece_id=VDDGO3TNUEPV45LB3J65UZX7WYF4BORGTQ5FZDLOLPUIWGHFDG6Q, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.203821095 (95h33m33.634901226s) [noise=true , address=79.127.201.215:4350  , piece_id=J5FYRE2SDV7OCGN2OK3BBY2TZ6JKCJ5TUIPJ67SEMTQRBIJN3E2A, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.205764854 (95h33m33.636844995s) [noise=true , address=104.36.82.60:4372    , piece_id=M54ATKGBFCQWGXWTCFU7GDGGWPTN5UJONPFDT6QEW4BP5CJCRKIA, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:40.363639120 (95h33m34.794719261s) [upload=99560]: Next returned nil segment
Aug 12 16:59:40.363657104 (95h33m34.794737235s) [upload=99560]: Waiting for error group managing segments...
Aug 12 16:59:40.692247382 (95h33m35.123327513s) [noise=true , address=193.149.164.143:4698 , piece_id=I7BDBG7QK66PCZNNU3MDNT3IENTGDLSMHIQMFDAJGGGLTWNNW7IA, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.169955785 (95h33m35.601035916s) [noise=true , address=104.36.82.21:4495    , piece_id=6PW2LL4YAWQO6EGJWRPGO7PDK7VRJ63Y6E5FIS3FIMQDQS37JE2Q, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.173959115 (95h33m35.605039236s) [noise=true , address=77.90.31.19:4844     , piece_id=6ACO5XJCM7JKXI6DZNS7Q6FMNIIF2H4QX5GFFZP275LGK4LAG6KQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.202640181 (95h33m35.633720302s) [noise=true , address=104.36.82.62:4410    , piece_id=NNHLCIVHJSFAQOF5BPARODUZ7NDKRIO7VZ4TXMDPSIT7CPBM7LGA, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.217521444 (95h33m35.648601575s) [noise=true , address=104.36.82.47:4519    , piece_id=CWQ2QS6LJLG2MGBY3B5KHVUKDJQ64ZAWHCQSEIMBHYXVZ2KQONWA, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.246049799 (95h33m35.67712993s) [noise=true , address=104.36.82.3:4796     , piece_id=GKGL3BVJKJI34563P6NAAMQBH6K53WQ2XR5A5TRPTA4VK24WN7HA, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.264431349 (95h33m35.69551148s) [noise=true , address=104.36.82.18:4366    , piece_id=ABVSGRVBMLWFCYO4RGTYAZ4XMYFCKKL4OMFAMS2WLD4OFNCHKUZQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.367834365 (95h33m35.798914496s) [noise=true , address=104.36.82.60:4372    , piece_id=M54ATKGBFCQWGXWTCFU7GDGGWPTN5UJONPFDT6QEW4BP5CJCRKIA, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.368115543 (95h33m35.799195664s) [noise=true , address=104.36.82.58:4285    , piece_id=RSNIOADYVBK6XD3XNUUNRLYBSDKJNLXTGGQSUQA5MF2KOGCY7WVQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.396228793 (95h33m35.827308934s) [noise=true , address=104.36.82.46:4490    , piece_id=MFHE7SH22T6KPVQD57THJ47O7ANA3UL6DSXPXE5VKKZGZHCXHWMQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.404358458 (95h33m35.835438599s) [noise=true , address=104.36.82.35:4583    , piece_id=F425SAQ7MSRGMEAFG75XFNNVQPJOXKKXOCF4DXUYB3ZJJX7O3Y2Q, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.424749884 (95h33m35.855830015s) [noise=true , address=104.36.82.16:4297    , piece_id=VDDGO3TNUEPV45LB3J65UZX7WYF4BORGTQ5FZDLOLPUIWGHFDG6Q, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.457148824 (95h33m35.888228945s) [noise=true , address=104.36.82.35:4607    , piece_id=MEGUKOCNGAXTQF6JKS4UM2FTUOJNH22XUUCEOLZG56XXBFRESSRQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.505612983 (95h33m35.936693114s) [noise=true , address=104.36.82.61:4405    , piece_id=42XK2XF4LW6JDERRITW4BGU4SASVH5XAIAI4I7H7WJBMPDD2UVZQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.505632861 (95h33m35.936712992s) [seg_pos={0 0}, upload=99560]: Segment reached optimal threshold of 14 pieces.
Aug 12 16:59:41.505886516 (95h33m35.936966647s) [noise=true , address=79.127.201.214:4320  , piece_id=KTDAMSYK7CDMKJDYD7EL45LDWFRECADQYJWINN6BFJUKFCHCXKCQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLCXYP6sppXZcmj49C8jjgXbLGzgyowtpb1um9XZguzfVnM2r): protocol: expected piece hash; context canceled; EOF
Aug 12 16:59:41.505927656 (95h33m35.937007787s) [noise=true , address=104.36.82.23:4467    , piece_id=72OG4FRL66Q522MHHPWUEX5F7TBW7BHTNBUEB2FTLVX6GNEKEBUQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RegmCcGuZED5cPuhVJ9mLRuouCHBEZ3hecf7aseHsMCgo1ajT): protocol: expected piece hash; context canceled; EOF
Aug 12 16:59:41.505990275 (95h33m35.937070406s) [noise=true , address=79.127.201.215:4350  , piece_id=J5FYRE2SDV7OCGN2OK3BBY2TZ6JKCJ5TUIPJ67SEMTQRBIJN3E2A, seg_pos={0 0}, upload=99560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 12 16:59:41.506052915 (95h33m35.937133036s) [noise=true , address=104.36.82.5:4869     , piece_id=TOHQG3BR5YJQNJDMVDWUZ6DLBKNOI5NCOCOI6G2L44BSJ24CR42Q, seg_pos={0 0}, upload=99560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1273igSPBbnYnP5bTMPjCphwkCSK4WdBdBMFVgfnrPaq4oSUZQr): protocol: write tcp 188.166.225.170:39306->104.36.82.5:4869: use of closed network connection; write tcp 188.166.225.170:39306->104.36.82.5:4869: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39306->104.36.82.5:4869: use of closed network connection
Aug 12 16:59:41.506075017 (95h33m35.937155148s) [seg_pos={0 0}, upload=99560]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 16:59:41.506137476 (95h33m35.937217597s) [upload=99560]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:59:41.506141796 (95h33m35.937221927s) [upload=99560]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:59:41.812022822 (95h33m36.243102943s) [upload=99560]: Done uploading segments...
Aug 12 16:59:41.812034574 (95h33m36.243114695s) [upload=99560]: Upload finished. err: <nil>
Duration: 5.847097461s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............]
duration:
6.00263911s
FAIL (2025-08-12 17:01:11 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
Aug 12 16:51:00.342944596 (95h24m54.774024727s) [upload=99416]: Starting upload
Aug 12 16:51:00.343003058 (95h24m54.774083189s) [upload=99416]: Done starting upload
Aug 12 16:51:00.343093682 (95h24m54.774173803s) [upload=99416]: Uploading segments...
Aug 12 16:51:00.343214823 (95h24m54.774294954s) [upload=99416]: Got next segment. Inline: false
Aug 12 16:51:00.343269027 (95h24m54.774349158s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:51:00.343273756 (95h24m54.774353887s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:51:00.585349151 (95h24m55.016429282s) [seg_pos={0 0}, upload=99416]: Begin upload segment...
Aug 12 16:51:00.585396822 (95h24m55.016476973s) [seg_pos={0 0}, upload=99416]: Done begin upload segment.
Aug 12 16:51:00.585410067 (95h24m55.016490208s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585507734 (95h24m55.016587895s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585886159 (95h24m55.0169663s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586089607 (95h24m55.017169738s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586541652 (95h24m55.017621803s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587004688 (95h24m55.018084819s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587619234 (95h24m55.018699385s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587983842 (95h24m55.019063983s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588303153 (95h24m55.019383284s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588688090 (95h24m55.019768221s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.589902393 (95h24m55.020982534s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.590674450 (95h24m55.021754601s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.591296961 (95h24m55.022377092s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.592189969 (95h24m55.02327011s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.593156619 (95h24m55.02423678s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.594056290 (95h24m55.025136421s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:02.362133336 (95h24m56.793213467s) [upload=99416]: Next returned nil segment
Aug 12 16:51:02.362159547 (95h24m56.793239678s) [upload=99416]: Waiting for error group managing segments...
Aug 12 16:51:02.650293798 (95h24m57.081373929s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.663772758 (95h24m57.094852919s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.696344749 (95h24m57.12742488s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.709104884 (95h24m57.140185025s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.722233484 (95h24m57.153313625s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.727048907 (95h24m57.158129038s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.741870376 (95h24m57.172950507s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.772732365 (95h24m57.203812507s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.805755481 (95h24m57.236835612s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.878280266 (95h24m57.309360397s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.913734542 (95h24m57.344814673s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.972369120 (95h24m57.403449251s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983815812 (95h24m57.414895943s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983842733 (95h24m57.414922864s) [seg_pos={0 0}, upload=99416]: Segment reached optimal threshold of 13 pieces.
Aug 12 16:51:02.983942084 (95h24m57.415022215s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.983999583 (95h24m57.415079715s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984087211 (95h24m57.415167342s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984124363 (95h24m57.415204494s) [seg_pos={0 0}, upload=99416]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 12 16:51:02.984229683 (95h24m57.415309814s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:51:02.984234323 (95h24m57.415314454s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:51:03.289516404 (95h24m57.720596575s) [upload=99416]: Done uploading segments...
Aug 12 16:51:03.289540049 (95h24m57.7206202s) [upload=99416]: Upload finished. err: <nil>
Duration: 6.002665331s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [..................X..........X..............................]
duration:
1.84074567s
FAIL (2025-08-12 17:01:10 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 12 16:39:09.008146755 (95h13m3.439226887s) [upload=99194]: Starting upload
Aug 12 16:39:09.008201260 (95h13m3.439281391s) [upload=99194]: Done starting upload
Aug 12 16:39:09.008258329 (95h13m3.43933846s) [upload=99194]: Uploading segments...
Aug 12 16:39:09.008290200 (95h13m3.439370331s) [upload=99194]: Got next segment. Inline: true
Aug 12 16:39:09.008295661 (95h13m3.439375782s) [upload=99194]: Waiting for error group managing segments...
Aug 12 16:39:09.008328123 (95h13m3.439408254s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:39:09.008334585 (95h13m3.439414716s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 12 16:39:09.008337160 (95h13m3.439417281s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:39:09.337170261 (95h13m3.768250392s) [upload=99194]: Done uploading segments...
Aug 12 16:39:09.337190520 (95h13m3.768270651s) [upload=99194]: Upload finished. err: <nil>
Duration: 1.840770557s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [...................X..........X.............................]
duration:
2.076501468s
FAIL (2025-08-12 17:00:53 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 12 16:39:09.008146755 (95h13m3.439226887s) [upload=99194]: Starting upload
Aug 12 16:39:09.008201260 (95h13m3.439281391s) [upload=99194]: Done starting upload
Aug 12 16:39:09.008258329 (95h13m3.43933846s) [upload=99194]: Uploading segments...
Aug 12 16:39:09.008290200 (95h13m3.439370331s) [upload=99194]: Got next segment. Inline: true
Aug 12 16:39:09.008295661 (95h13m3.439375782s) [upload=99194]: Waiting for error group managing segments...
Aug 12 16:39:09.008328123 (95h13m3.439408254s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:39:09.008334585 (95h13m3.439414716s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 12 16:39:09.008337160 (95h13m3.439417281s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:39:09.337170261 (95h13m3.768250392s) [upload=99194]: Done uploading segments...
Aug 12 16:39:09.337190520 (95h13m3.768270651s) [upload=99194]: Upload finished. err: <nil>
Duration: 2.076532969s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
6 out of 60 is failed (threshold=3) [..........X.X...X.............................X.X.........X.]
duration:
6.104175026s
FAIL (2025-08-12 17:00:45 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 16:59:38.687530140 (95h33m33.118610271s) [upload=99560]: Starting upload
Aug 12 16:59:38.687574635 (95h33m33.118654766s) [upload=99560]: Done starting upload
Aug 12 16:59:38.687634360 (95h33m33.118714491s) [upload=99560]: Uploading segments...
Aug 12 16:59:38.687738799 (95h33m33.11881892s) [upload=99560]: Got next segment. Inline: false
Aug 12 16:59:38.687772675 (95h33m33.118852806s) [upload=99560]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:59:38.687777594 (95h33m33.118857725s) [upload=99560]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:59:39.197902742 (95h33m33.628982873s) [seg_pos={0 0}, upload=99560]: Begin upload segment...
Aug 12 16:59:39.197949550 (95h33m33.629029682s) [seg_pos={0 0}, upload=99560]: Done begin upload segment.
Aug 12 16:59:39.197963598 (95h33m33.629043729s) [noise=true , address=104.36.82.21:4495    , piece_id=6PW2LL4YAWQO6EGJWRPGO7PDK7VRJ63Y6E5FIS3FIMQDQS37JE2Q, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.197979778 (95h33m33.629059909s) [noise=true , address=104.36.82.61:4405    , piece_id=42XK2XF4LW6JDERRITW4BGU4SASVH5XAIAI4I7H7WJBMPDD2UVZQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.198019174 (95h33m33.629099305s) [noise=true , address=104.36.82.62:4410    , piece_id=NNHLCIVHJSFAQOF5BPARODUZ7NDKRIO7VZ4TXMDPSIT7CPBM7LGA, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.198062236 (95h33m33.629142357s) [noise=true , address=77.90.31.19:4844     , piece_id=6ACO5XJCM7JKXI6DZNS7Q6FMNIIF2H4QX5GFFZP275LGK4LAG6KQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.198334707 (95h33m33.629414828s) [noise=true , address=104.36.82.58:4285    , piece_id=RSNIOADYVBK6XD3XNUUNRLYBSDKJNLXTGGQSUQA5MF2KOGCY7WVQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.198339377 (95h33m33.629419508s) [noise=true , address=79.127.201.214:4320  , piece_id=KTDAMSYK7CDMKJDYD7EL45LDWFRECADQYJWINN6BFJUKFCHCXKCQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.198607269 (95h33m33.6296874s) [noise=true , address=104.36.82.23:4467    , piece_id=72OG4FRL66Q522MHHPWUEX5F7TBW7BHTNBUEB2FTLVX6GNEKEBUQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.198865934 (95h33m33.629946065s) [noise=true , address=104.36.82.35:4607    , piece_id=MEGUKOCNGAXTQF6JKS4UM2FTUOJNH22XUUCEOLZG56XXBFRESSRQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.200169648 (95h33m33.631249779s) [noise=true , address=104.36.82.35:4583    , piece_id=F425SAQ7MSRGMEAFG75XFNNVQPJOXKKXOCF4DXUYB3ZJJX7O3Y2Q, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.200909183 (95h33m33.631989315s) [noise=true , address=104.36.82.3:4796     , piece_id=GKGL3BVJKJI34563P6NAAMQBH6K53WQ2XR5A5TRPTA4VK24WN7HA, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.201550832 (95h33m33.632630963s) [noise=true , address=104.36.82.47:4519    , piece_id=CWQ2QS6LJLG2MGBY3B5KHVUKDJQ64ZAWHCQSEIMBHYXVZ2KQONWA, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.202192539 (95h33m33.63327267s) [noise=true , address=193.149.164.143:4698 , piece_id=I7BDBG7QK66PCZNNU3MDNT3IENTGDLSMHIQMFDAJGGGLTWNNW7IA, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.202627732 (95h33m33.633707863s) [noise=true , address=104.36.82.5:4869     , piece_id=TOHQG3BR5YJQNJDMVDWUZ6DLBKNOI5NCOCOI6G2L44BSJ24CR42Q, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.202954337 (95h33m33.634034468s) [noise=true , address=104.36.82.46:4490    , piece_id=MFHE7SH22T6KPVQD57THJ47O7ANA3UL6DSXPXE5VKKZGZHCXHWMQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.203178796 (95h33m33.634258927s) [noise=true , address=104.36.82.18:4366    , piece_id=ABVSGRVBMLWFCYO4RGTYAZ4XMYFCKKL4OMFAMS2WLD4OFNCHKUZQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.203380622 (95h33m33.634460753s) [noise=true , address=104.36.82.16:4297    , piece_id=VDDGO3TNUEPV45LB3J65UZX7WYF4BORGTQ5FZDLOLPUIWGHFDG6Q, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.203821095 (95h33m33.634901226s) [noise=true , address=79.127.201.215:4350  , piece_id=J5FYRE2SDV7OCGN2OK3BBY2TZ6JKCJ5TUIPJ67SEMTQRBIJN3E2A, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.205764854 (95h33m33.636844995s) [noise=true , address=104.36.82.60:4372    , piece_id=M54ATKGBFCQWGXWTCFU7GDGGWPTN5UJONPFDT6QEW4BP5CJCRKIA, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:40.363639120 (95h33m34.794719261s) [upload=99560]: Next returned nil segment
Aug 12 16:59:40.363657104 (95h33m34.794737235s) [upload=99560]: Waiting for error group managing segments...
Aug 12 16:59:40.692247382 (95h33m35.123327513s) [noise=true , address=193.149.164.143:4698 , piece_id=I7BDBG7QK66PCZNNU3MDNT3IENTGDLSMHIQMFDAJGGGLTWNNW7IA, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.169955785 (95h33m35.601035916s) [noise=true , address=104.36.82.21:4495    , piece_id=6PW2LL4YAWQO6EGJWRPGO7PDK7VRJ63Y6E5FIS3FIMQDQS37JE2Q, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.173959115 (95h33m35.605039236s) [noise=true , address=77.90.31.19:4844     , piece_id=6ACO5XJCM7JKXI6DZNS7Q6FMNIIF2H4QX5GFFZP275LGK4LAG6KQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.202640181 (95h33m35.633720302s) [noise=true , address=104.36.82.62:4410    , piece_id=NNHLCIVHJSFAQOF5BPARODUZ7NDKRIO7VZ4TXMDPSIT7CPBM7LGA, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.217521444 (95h33m35.648601575s) [noise=true , address=104.36.82.47:4519    , piece_id=CWQ2QS6LJLG2MGBY3B5KHVUKDJQ64ZAWHCQSEIMBHYXVZ2KQONWA, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.246049799 (95h33m35.67712993s) [noise=true , address=104.36.82.3:4796     , piece_id=GKGL3BVJKJI34563P6NAAMQBH6K53WQ2XR5A5TRPTA4VK24WN7HA, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.264431349 (95h33m35.69551148s) [noise=true , address=104.36.82.18:4366    , piece_id=ABVSGRVBMLWFCYO4RGTYAZ4XMYFCKKL4OMFAMS2WLD4OFNCHKUZQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.367834365 (95h33m35.798914496s) [noise=true , address=104.36.82.60:4372    , piece_id=M54ATKGBFCQWGXWTCFU7GDGGWPTN5UJONPFDT6QEW4BP5CJCRKIA, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.368115543 (95h33m35.799195664s) [noise=true , address=104.36.82.58:4285    , piece_id=RSNIOADYVBK6XD3XNUUNRLYBSDKJNLXTGGQSUQA5MF2KOGCY7WVQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.396228793 (95h33m35.827308934s) [noise=true , address=104.36.82.46:4490    , piece_id=MFHE7SH22T6KPVQD57THJ47O7ANA3UL6DSXPXE5VKKZGZHCXHWMQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.404358458 (95h33m35.835438599s) [noise=true , address=104.36.82.35:4583    , piece_id=F425SAQ7MSRGMEAFG75XFNNVQPJOXKKXOCF4DXUYB3ZJJX7O3Y2Q, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.424749884 (95h33m35.855830015s) [noise=true , address=104.36.82.16:4297    , piece_id=VDDGO3TNUEPV45LB3J65UZX7WYF4BORGTQ5FZDLOLPUIWGHFDG6Q, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.457148824 (95h33m35.888228945s) [noise=true , address=104.36.82.35:4607    , piece_id=MEGUKOCNGAXTQF6JKS4UM2FTUOJNH22XUUCEOLZG56XXBFRESSRQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.505612983 (95h33m35.936693114s) [noise=true , address=104.36.82.61:4405    , piece_id=42XK2XF4LW6JDERRITW4BGU4SASVH5XAIAI4I7H7WJBMPDD2UVZQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.505632861 (95h33m35.936712992s) [seg_pos={0 0}, upload=99560]: Segment reached optimal threshold of 14 pieces.
Aug 12 16:59:41.505886516 (95h33m35.936966647s) [noise=true , address=79.127.201.214:4320  , piece_id=KTDAMSYK7CDMKJDYD7EL45LDWFRECADQYJWINN6BFJUKFCHCXKCQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLCXYP6sppXZcmj49C8jjgXbLGzgyowtpb1um9XZguzfVnM2r): protocol: expected piece hash; context canceled; EOF
Aug 12 16:59:41.505927656 (95h33m35.937007787s) [noise=true , address=104.36.82.23:4467    , piece_id=72OG4FRL66Q522MHHPWUEX5F7TBW7BHTNBUEB2FTLVX6GNEKEBUQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RegmCcGuZED5cPuhVJ9mLRuouCHBEZ3hecf7aseHsMCgo1ajT): protocol: expected piece hash; context canceled; EOF
Aug 12 16:59:41.505990275 (95h33m35.937070406s) [noise=true , address=79.127.201.215:4350  , piece_id=J5FYRE2SDV7OCGN2OK3BBY2TZ6JKCJ5TUIPJ67SEMTQRBIJN3E2A, seg_pos={0 0}, upload=99560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 12 16:59:41.506052915 (95h33m35.937133036s) [noise=true , address=104.36.82.5:4869     , piece_id=TOHQG3BR5YJQNJDMVDWUZ6DLBKNOI5NCOCOI6G2L44BSJ24CR42Q, seg_pos={0 0}, upload=99560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1273igSPBbnYnP5bTMPjCphwkCSK4WdBdBMFVgfnrPaq4oSUZQr): protocol: write tcp 188.166.225.170:39306->104.36.82.5:4869: use of closed network connection; write tcp 188.166.225.170:39306->104.36.82.5:4869: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39306->104.36.82.5:4869: use of closed network connection
Aug 12 16:59:41.506075017 (95h33m35.937155148s) [seg_pos={0 0}, upload=99560]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 16:59:41.506137476 (95h33m35.937217597s) [upload=99560]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:59:41.506141796 (95h33m35.937221927s) [upload=99560]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:59:41.812022822 (95h33m36.243102943s) [upload=99560]: Done uploading segments...
Aug 12 16:59:41.812034574 (95h33m36.243114695s) [upload=99560]: Upload finished. err: <nil>
Duration: 6.104196347s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [....................X..........X............................]
duration:
2.089770006s
FAIL (2025-08-12 17:00:18 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 12 16:39:09.008146755 (95h13m3.439226887s) [upload=99194]: Starting upload
Aug 12 16:39:09.008201260 (95h13m3.439281391s) [upload=99194]: Done starting upload
Aug 12 16:39:09.008258329 (95h13m3.43933846s) [upload=99194]: Uploading segments...
Aug 12 16:39:09.008290200 (95h13m3.439370331s) [upload=99194]: Got next segment. Inline: true
Aug 12 16:39:09.008295661 (95h13m3.439375782s) [upload=99194]: Waiting for error group managing segments...
Aug 12 16:39:09.008328123 (95h13m3.439408254s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:39:09.008334585 (95h13m3.439414716s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 12 16:39:09.008337160 (95h13m3.439417281s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:39:09.337170261 (95h13m3.768250392s) [upload=99194]: Done uploading segments...
Aug 12 16:39:09.337190520 (95h13m3.768270651s) [upload=99194]: Upload finished. err: <nil>
Duration: 2.089794974s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............]
duration:
5.87266016s
FAIL (2025-08-12 17:00:11 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
Aug 12 16:51:00.342944596 (95h24m54.774024727s) [upload=99416]: Starting upload
Aug 12 16:51:00.343003058 (95h24m54.774083189s) [upload=99416]: Done starting upload
Aug 12 16:51:00.343093682 (95h24m54.774173803s) [upload=99416]: Uploading segments...
Aug 12 16:51:00.343214823 (95h24m54.774294954s) [upload=99416]: Got next segment. Inline: false
Aug 12 16:51:00.343269027 (95h24m54.774349158s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:51:00.343273756 (95h24m54.774353887s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:51:00.585349151 (95h24m55.016429282s) [seg_pos={0 0}, upload=99416]: Begin upload segment...
Aug 12 16:51:00.585396822 (95h24m55.016476973s) [seg_pos={0 0}, upload=99416]: Done begin upload segment.
Aug 12 16:51:00.585410067 (95h24m55.016490208s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585507734 (95h24m55.016587895s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585886159 (95h24m55.0169663s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586089607 (95h24m55.017169738s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586541652 (95h24m55.017621803s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587004688 (95h24m55.018084819s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587619234 (95h24m55.018699385s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587983842 (95h24m55.019063983s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588303153 (95h24m55.019383284s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588688090 (95h24m55.019768221s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.589902393 (95h24m55.020982534s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.590674450 (95h24m55.021754601s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.591296961 (95h24m55.022377092s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.592189969 (95h24m55.02327011s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.593156619 (95h24m55.02423678s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.594056290 (95h24m55.025136421s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:02.362133336 (95h24m56.793213467s) [upload=99416]: Next returned nil segment
Aug 12 16:51:02.362159547 (95h24m56.793239678s) [upload=99416]: Waiting for error group managing segments...
Aug 12 16:51:02.650293798 (95h24m57.081373929s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.663772758 (95h24m57.094852919s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.696344749 (95h24m57.12742488s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.709104884 (95h24m57.140185025s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.722233484 (95h24m57.153313625s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.727048907 (95h24m57.158129038s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.741870376 (95h24m57.172950507s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.772732365 (95h24m57.203812507s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.805755481 (95h24m57.236835612s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.878280266 (95h24m57.309360397s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.913734542 (95h24m57.344814673s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.972369120 (95h24m57.403449251s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983815812 (95h24m57.414895943s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983842733 (95h24m57.414922864s) [seg_pos={0 0}, upload=99416]: Segment reached optimal threshold of 13 pieces.
Aug 12 16:51:02.983942084 (95h24m57.415022215s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.983999583 (95h24m57.415079715s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984087211 (95h24m57.415167342s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984124363 (95h24m57.415204494s) [seg_pos={0 0}, upload=99416]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 12 16:51:02.984229683 (95h24m57.415309814s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:51:02.984234323 (95h24m57.415314454s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:51:03.289516404 (95h24m57.720596575s) [upload=99416]: Done uploading segments...
Aug 12 16:51:03.289540049 (95h24m57.7206202s) [upload=99416]: Upload finished. err: <nil>
Duration: 5.872691209s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............]
duration:
5.764296994s
FAIL (2025-08-12 16:59:44 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
Aug 12 16:51:00.342944596 (95h24m54.774024727s) [upload=99416]: Starting upload
Aug 12 16:51:00.343003058 (95h24m54.774083189s) [upload=99416]: Done starting upload
Aug 12 16:51:00.343093682 (95h24m54.774173803s) [upload=99416]: Uploading segments...
Aug 12 16:51:00.343214823 (95h24m54.774294954s) [upload=99416]: Got next segment. Inline: false
Aug 12 16:51:00.343269027 (95h24m54.774349158s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:51:00.343273756 (95h24m54.774353887s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:51:00.585349151 (95h24m55.016429282s) [seg_pos={0 0}, upload=99416]: Begin upload segment...
Aug 12 16:51:00.585396822 (95h24m55.016476973s) [seg_pos={0 0}, upload=99416]: Done begin upload segment.
Aug 12 16:51:00.585410067 (95h24m55.016490208s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585507734 (95h24m55.016587895s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585886159 (95h24m55.0169663s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586089607 (95h24m55.017169738s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586541652 (95h24m55.017621803s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587004688 (95h24m55.018084819s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587619234 (95h24m55.018699385s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587983842 (95h24m55.019063983s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588303153 (95h24m55.019383284s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588688090 (95h24m55.019768221s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.589902393 (95h24m55.020982534s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.590674450 (95h24m55.021754601s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.591296961 (95h24m55.022377092s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.592189969 (95h24m55.02327011s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.593156619 (95h24m55.02423678s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.594056290 (95h24m55.025136421s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:02.362133336 (95h24m56.793213467s) [upload=99416]: Next returned nil segment
Aug 12 16:51:02.362159547 (95h24m56.793239678s) [upload=99416]: Waiting for error group managing segments...
Aug 12 16:51:02.650293798 (95h24m57.081373929s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.663772758 (95h24m57.094852919s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.696344749 (95h24m57.12742488s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.709104884 (95h24m57.140185025s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.722233484 (95h24m57.153313625s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.727048907 (95h24m57.158129038s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.741870376 (95h24m57.172950507s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.772732365 (95h24m57.203812507s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.805755481 (95h24m57.236835612s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.878280266 (95h24m57.309360397s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.913734542 (95h24m57.344814673s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.972369120 (95h24m57.403449251s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983815812 (95h24m57.414895943s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983842733 (95h24m57.414922864s) [seg_pos={0 0}, upload=99416]: Segment reached optimal threshold of 13 pieces.
Aug 12 16:51:02.983942084 (95h24m57.415022215s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.983999583 (95h24m57.415079715s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984087211 (95h24m57.415167342s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984124363 (95h24m57.415204494s) [seg_pos={0 0}, upload=99416]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 12 16:51:02.984229683 (95h24m57.415309814s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:51:02.984234323 (95h24m57.415314454s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:51:03.289516404 (95h24m57.720596575s) [upload=99416]: Done uploading segments...
Aug 12 16:51:03.289540049 (95h24m57.7206202s) [upload=99416]: Upload finished. err: <nil>
Duration: 5.764325539s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
6 out of 60 is failed (threshold=3) [...........X.X...X.............................X.X.........X]
duration:
4.224295769s
FAIL (2025-08-12 16:59:42 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 16:59:38.687530140 (95h33m33.118610271s) [upload=99560]: Starting upload
Aug 12 16:59:38.687574635 (95h33m33.118654766s) [upload=99560]: Done starting upload
Aug 12 16:59:38.687634360 (95h33m33.118714491s) [upload=99560]: Uploading segments...
Aug 12 16:59:38.687738799 (95h33m33.11881892s) [upload=99560]: Got next segment. Inline: false
Aug 12 16:59:38.687772675 (95h33m33.118852806s) [upload=99560]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:59:38.687777594 (95h33m33.118857725s) [upload=99560]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:59:39.197902742 (95h33m33.628982873s) [seg_pos={0 0}, upload=99560]: Begin upload segment...
Aug 12 16:59:39.197949550 (95h33m33.629029682s) [seg_pos={0 0}, upload=99560]: Done begin upload segment.
Aug 12 16:59:39.197963598 (95h33m33.629043729s) [noise=true , address=104.36.82.21:4495    , piece_id=6PW2LL4YAWQO6EGJWRPGO7PDK7VRJ63Y6E5FIS3FIMQDQS37JE2Q, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.197979778 (95h33m33.629059909s) [noise=true , address=104.36.82.61:4405    , piece_id=42XK2XF4LW6JDERRITW4BGU4SASVH5XAIAI4I7H7WJBMPDD2UVZQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.198019174 (95h33m33.629099305s) [noise=true , address=104.36.82.62:4410    , piece_id=NNHLCIVHJSFAQOF5BPARODUZ7NDKRIO7VZ4TXMDPSIT7CPBM7LGA, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.198062236 (95h33m33.629142357s) [noise=true , address=77.90.31.19:4844     , piece_id=6ACO5XJCM7JKXI6DZNS7Q6FMNIIF2H4QX5GFFZP275LGK4LAG6KQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.198334707 (95h33m33.629414828s) [noise=true , address=104.36.82.58:4285    , piece_id=RSNIOADYVBK6XD3XNUUNRLYBSDKJNLXTGGQSUQA5MF2KOGCY7WVQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.198339377 (95h33m33.629419508s) [noise=true , address=79.127.201.214:4320  , piece_id=KTDAMSYK7CDMKJDYD7EL45LDWFRECADQYJWINN6BFJUKFCHCXKCQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.198607269 (95h33m33.6296874s) [noise=true , address=104.36.82.23:4467    , piece_id=72OG4FRL66Q522MHHPWUEX5F7TBW7BHTNBUEB2FTLVX6GNEKEBUQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.198865934 (95h33m33.629946065s) [noise=true , address=104.36.82.35:4607    , piece_id=MEGUKOCNGAXTQF6JKS4UM2FTUOJNH22XUUCEOLZG56XXBFRESSRQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.200169648 (95h33m33.631249779s) [noise=true , address=104.36.82.35:4583    , piece_id=F425SAQ7MSRGMEAFG75XFNNVQPJOXKKXOCF4DXUYB3ZJJX7O3Y2Q, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.200909183 (95h33m33.631989315s) [noise=true , address=104.36.82.3:4796     , piece_id=GKGL3BVJKJI34563P6NAAMQBH6K53WQ2XR5A5TRPTA4VK24WN7HA, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.201550832 (95h33m33.632630963s) [noise=true , address=104.36.82.47:4519    , piece_id=CWQ2QS6LJLG2MGBY3B5KHVUKDJQ64ZAWHCQSEIMBHYXVZ2KQONWA, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.202192539 (95h33m33.63327267s) [noise=true , address=193.149.164.143:4698 , piece_id=I7BDBG7QK66PCZNNU3MDNT3IENTGDLSMHIQMFDAJGGGLTWNNW7IA, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.202627732 (95h33m33.633707863s) [noise=true , address=104.36.82.5:4869     , piece_id=TOHQG3BR5YJQNJDMVDWUZ6DLBKNOI5NCOCOI6G2L44BSJ24CR42Q, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.202954337 (95h33m33.634034468s) [noise=true , address=104.36.82.46:4490    , piece_id=MFHE7SH22T6KPVQD57THJ47O7ANA3UL6DSXPXE5VKKZGZHCXHWMQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.203178796 (95h33m33.634258927s) [noise=true , address=104.36.82.18:4366    , piece_id=ABVSGRVBMLWFCYO4RGTYAZ4XMYFCKKL4OMFAMS2WLD4OFNCHKUZQ, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.203380622 (95h33m33.634460753s) [noise=true , address=104.36.82.16:4297    , piece_id=VDDGO3TNUEPV45LB3J65UZX7WYF4BORGTQ5FZDLOLPUIWGHFDG6Q, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.203821095 (95h33m33.634901226s) [noise=true , address=79.127.201.215:4350  , piece_id=J5FYRE2SDV7OCGN2OK3BBY2TZ6JKCJ5TUIPJ67SEMTQRBIJN3E2A, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:39.205764854 (95h33m33.636844995s) [noise=true , address=104.36.82.60:4372    , piece_id=M54ATKGBFCQWGXWTCFU7GDGGWPTN5UJONPFDT6QEW4BP5CJCRKIA, seg_pos={0 0}, upload=99560]: Uploading piece...
Aug 12 16:59:40.363639120 (95h33m34.794719261s) [upload=99560]: Next returned nil segment
Aug 12 16:59:40.363657104 (95h33m34.794737235s) [upload=99560]: Waiting for error group managing segments...
Aug 12 16:59:40.692247382 (95h33m35.123327513s) [noise=true , address=193.149.164.143:4698 , piece_id=I7BDBG7QK66PCZNNU3MDNT3IENTGDLSMHIQMFDAJGGGLTWNNW7IA, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.169955785 (95h33m35.601035916s) [noise=true , address=104.36.82.21:4495    , piece_id=6PW2LL4YAWQO6EGJWRPGO7PDK7VRJ63Y6E5FIS3FIMQDQS37JE2Q, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.173959115 (95h33m35.605039236s) [noise=true , address=77.90.31.19:4844     , piece_id=6ACO5XJCM7JKXI6DZNS7Q6FMNIIF2H4QX5GFFZP275LGK4LAG6KQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.202640181 (95h33m35.633720302s) [noise=true , address=104.36.82.62:4410    , piece_id=NNHLCIVHJSFAQOF5BPARODUZ7NDKRIO7VZ4TXMDPSIT7CPBM7LGA, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.217521444 (95h33m35.648601575s) [noise=true , address=104.36.82.47:4519    , piece_id=CWQ2QS6LJLG2MGBY3B5KHVUKDJQ64ZAWHCQSEIMBHYXVZ2KQONWA, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.246049799 (95h33m35.67712993s) [noise=true , address=104.36.82.3:4796     , piece_id=GKGL3BVJKJI34563P6NAAMQBH6K53WQ2XR5A5TRPTA4VK24WN7HA, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.264431349 (95h33m35.69551148s) [noise=true , address=104.36.82.18:4366    , piece_id=ABVSGRVBMLWFCYO4RGTYAZ4XMYFCKKL4OMFAMS2WLD4OFNCHKUZQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.367834365 (95h33m35.798914496s) [noise=true , address=104.36.82.60:4372    , piece_id=M54ATKGBFCQWGXWTCFU7GDGGWPTN5UJONPFDT6QEW4BP5CJCRKIA, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.368115543 (95h33m35.799195664s) [noise=true , address=104.36.82.58:4285    , piece_id=RSNIOADYVBK6XD3XNUUNRLYBSDKJNLXTGGQSUQA5MF2KOGCY7WVQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.396228793 (95h33m35.827308934s) [noise=true , address=104.36.82.46:4490    , piece_id=MFHE7SH22T6KPVQD57THJ47O7ANA3UL6DSXPXE5VKKZGZHCXHWMQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.404358458 (95h33m35.835438599s) [noise=true , address=104.36.82.35:4583    , piece_id=F425SAQ7MSRGMEAFG75XFNNVQPJOXKKXOCF4DXUYB3ZJJX7O3Y2Q, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.424749884 (95h33m35.855830015s) [noise=true , address=104.36.82.16:4297    , piece_id=VDDGO3TNUEPV45LB3J65UZX7WYF4BORGTQ5FZDLOLPUIWGHFDG6Q, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.457148824 (95h33m35.888228945s) [noise=true , address=104.36.82.35:4607    , piece_id=MEGUKOCNGAXTQF6JKS4UM2FTUOJNH22XUUCEOLZG56XXBFRESSRQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.505612983 (95h33m35.936693114s) [noise=true , address=104.36.82.61:4405    , piece_id=42XK2XF4LW6JDERRITW4BGU4SASVH5XAIAI4I7H7WJBMPDD2UVZQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: <nil>
Aug 12 16:59:41.505632861 (95h33m35.936712992s) [seg_pos={0 0}, upload=99560]: Segment reached optimal threshold of 14 pieces.
Aug 12 16:59:41.505886516 (95h33m35.936966647s) [noise=true , address=79.127.201.214:4320  , piece_id=KTDAMSYK7CDMKJDYD7EL45LDWFRECADQYJWINN6BFJUKFCHCXKCQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12ZLCXYP6sppXZcmj49C8jjgXbLGzgyowtpb1um9XZguzfVnM2r): protocol: expected piece hash; context canceled; EOF
Aug 12 16:59:41.505927656 (95h33m35.937007787s) [noise=true , address=104.36.82.23:4467    , piece_id=72OG4FRL66Q522MHHPWUEX5F7TBW7BHTNBUEB2FTLVX6GNEKEBUQ, seg_pos={0 0}, upload=99560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1RegmCcGuZED5cPuhVJ9mLRuouCHBEZ3hecf7aseHsMCgo1ajT): protocol: expected piece hash; context canceled; EOF
Aug 12 16:59:41.505990275 (95h33m35.937070406s) [noise=true , address=79.127.201.215:4350  , piece_id=J5FYRE2SDV7OCGN2OK3BBY2TZ6JKCJ5TUIPJ67SEMTQRBIJN3E2A, seg_pos={0 0}, upload=99560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 12 16:59:41.506052915 (95h33m35.937133036s) [noise=true , address=104.36.82.5:4869     , piece_id=TOHQG3BR5YJQNJDMVDWUZ6DLBKNOI5NCOCOI6G2L44BSJ24CR42Q, seg_pos={0 0}, upload=99560]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1273igSPBbnYnP5bTMPjCphwkCSK4WdBdBMFVgfnrPaq4oSUZQr): protocol: write tcp 188.166.225.170:39306->104.36.82.5:4869: use of closed network connection; write tcp 188.166.225.170:39306->104.36.82.5:4869: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:39306->104.36.82.5:4869: use of closed network connection
Aug 12 16:59:41.506075017 (95h33m35.937155148s) [seg_pos={0 0}, upload=99560]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 16:59:41.506137476 (95h33m35.937217597s) [upload=99560]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:59:41.506141796 (95h33m35.937221927s) [upload=99560]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:59:41.812022822 (95h33m36.243102943s) [upload=99560]: Done uploading segments...
Aug 12 16:59:41.812034574 (95h33m36.243114695s) [upload=99560]: Upload finished. err: <nil>
Duration: 4.224319865s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [.....................X..........X...........................]
duration:
2.005048748s
FAIL (2025-08-12 16:59:33 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 12 16:39:09.008146755 (95h13m3.439226887s) [upload=99194]: Starting upload
Aug 12 16:39:09.008201260 (95h13m3.439281391s) [upload=99194]: Done starting upload
Aug 12 16:39:09.008258329 (95h13m3.43933846s) [upload=99194]: Uploading segments...
Aug 12 16:39:09.008290200 (95h13m3.439370331s) [upload=99194]: Got next segment. Inline: true
Aug 12 16:39:09.008295661 (95h13m3.439375782s) [upload=99194]: Waiting for error group managing segments...
Aug 12 16:39:09.008328123 (95h13m3.439408254s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:39:09.008334585 (95h13m3.439414716s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 12 16:39:09.008337160 (95h13m3.439417281s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:39:09.337170261 (95h13m3.768250392s) [upload=99194]: Done uploading segments...
Aug 12 16:39:09.337190520 (95h13m3.768270651s) [upload=99194]: Upload finished. err: <nil>
Duration: 2.005069007s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........]
duration:
5.90286187s
FAIL (2025-08-12 16:59:24 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
Aug 12 16:51:00.342944596 (95h24m54.774024727s) [upload=99416]: Starting upload
Aug 12 16:51:00.343003058 (95h24m54.774083189s) [upload=99416]: Done starting upload
Aug 12 16:51:00.343093682 (95h24m54.774173803s) [upload=99416]: Uploading segments...
Aug 12 16:51:00.343214823 (95h24m54.774294954s) [upload=99416]: Got next segment. Inline: false
Aug 12 16:51:00.343269027 (95h24m54.774349158s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:51:00.343273756 (95h24m54.774353887s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:51:00.585349151 (95h24m55.016429282s) [seg_pos={0 0}, upload=99416]: Begin upload segment...
Aug 12 16:51:00.585396822 (95h24m55.016476973s) [seg_pos={0 0}, upload=99416]: Done begin upload segment.
Aug 12 16:51:00.585410067 (95h24m55.016490208s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585507734 (95h24m55.016587895s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585886159 (95h24m55.0169663s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586089607 (95h24m55.017169738s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586541652 (95h24m55.017621803s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587004688 (95h24m55.018084819s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587619234 (95h24m55.018699385s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587983842 (95h24m55.019063983s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588303153 (95h24m55.019383284s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588688090 (95h24m55.019768221s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.589902393 (95h24m55.020982534s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.590674450 (95h24m55.021754601s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.591296961 (95h24m55.022377092s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.592189969 (95h24m55.02327011s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.593156619 (95h24m55.02423678s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.594056290 (95h24m55.025136421s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:02.362133336 (95h24m56.793213467s) [upload=99416]: Next returned nil segment
Aug 12 16:51:02.362159547 (95h24m56.793239678s) [upload=99416]: Waiting for error group managing segments...
Aug 12 16:51:02.650293798 (95h24m57.081373929s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.663772758 (95h24m57.094852919s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.696344749 (95h24m57.12742488s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.709104884 (95h24m57.140185025s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.722233484 (95h24m57.153313625s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.727048907 (95h24m57.158129038s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.741870376 (95h24m57.172950507s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.772732365 (95h24m57.203812507s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.805755481 (95h24m57.236835612s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.878280266 (95h24m57.309360397s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.913734542 (95h24m57.344814673s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.972369120 (95h24m57.403449251s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983815812 (95h24m57.414895943s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983842733 (95h24m57.414922864s) [seg_pos={0 0}, upload=99416]: Segment reached optimal threshold of 13 pieces.
Aug 12 16:51:02.983942084 (95h24m57.415022215s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.983999583 (95h24m57.415079715s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984087211 (95h24m57.415167342s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984124363 (95h24m57.415204494s) [seg_pos={0 0}, upload=99416]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 12 16:51:02.984229683 (95h24m57.415309814s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:51:02.984234323 (95h24m57.415314454s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:51:03.289516404 (95h24m57.720596575s) [upload=99416]: Done uploading segments...
Aug 12 16:51:03.289540049 (95h24m57.7206202s) [upload=99416]: Upload finished. err: <nil>
Duration: 5.902889131s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
5 out of 60 is failed (threshold=3) [............X.X...X.............................X.X.........]
duration:
6.539179394s
FAIL (2025-08-12 16:59:16 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 16:52:09.578909030 (95h26m4.009989161s) [upload=99431]: Starting upload
Aug 12 16:52:09.578972422 (95h26m4.010052553s) [upload=99431]: Done starting upload
Aug 12 16:52:09.579277906 (95h26m4.010358037s) [upload=99431]: Uploading segments...
Aug 12 16:52:09.579324184 (95h26m4.010404315s) [upload=99431]: Got next segment. Inline: false
Aug 12 16:52:09.579372827 (95h26m4.010452958s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:52:09.579393397 (95h26m4.010473528s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:52:10.030885749 (95h26m4.46196588s) [seg_pos={0 0}, upload=99431]: Begin upload segment...
Aug 12 16:52:10.030936476 (95h26m4.462016607s) [seg_pos={0 0}, upload=99431]: Done begin upload segment.
Aug 12 16:52:10.030957215 (95h26m4.462037336s) [noise=true , address=64.49.13.170:4718    , piece_id=WBYM36PNSDZRCPVZWBKBYE6QMOB7NZGOXMTSLDD6UHBNS5JOAGYA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031415112 (95h26m4.462495243s) [noise=true , address=64.49.13.27:4967     , piece_id=VVBCNRSZV3JS62A3VP4JOVZ4KT6ISZCONBGY34ZB2HCYVBLZC4NQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031735916 (95h26m4.462816047s) [noise=true , address=104.36.82.10:4081    , piece_id=FYL67K3RULMHGI6QRYAK2NIBCPYS3BF3JSUWDSYCJDN4MAQQ5G7Q, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031792935 (95h26m4.462873056s) [noise=true , address=104.36.82.8:4004     , piece_id=YAJPTSME5WLIJ4K4ETM2XZMDW2EQWSQ65C7BEYZGWR244IFZZVWQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032336375 (95h26m4.463416506s) [noise=true , address=104.36.82.38:4689    , piece_id=RIUVUPFWBTKR37JERH6XF3VLR62KK2HIVI6S7PTZIEUQE562FTDQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032709769 (95h26m4.4637899s) [noise=true , address=79.127.201.215:4350  , piece_id=KXSPQYHU5MMQ36MWG52MTFNA5CTTACHQ5BCKQSWAT4FZVUE55CSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032913779 (95h26m4.463993901s) [noise=true , address=104.36.82.60:4355    , piece_id=M3ZBISH7DODTBQBLY7K35U6C6FFI5L2W4JIHL6464GB3IM4E7XNQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032997580 (95h26m4.464077711s) [noise=true , address=104.36.82.44:4901    , piece_id=FXAOJTQJKFQT4KWACYNCJIGNSLWZ4UNTXOQVDT4DD4N6RYD7W6CQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033176131 (95h26m4.464256262s) [noise=true , address=104.36.82.5:4867     , piece_id=ZFYYDLU2OCE4OWJONZZ6HDRXT3ZI2I3SIQKF7ROIJAMGDMTA4DSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033382095 (95h26m4.464462227s) [noise=true , address=104.36.82.7:4925     , piece_id=IE7JWJ22TWHGRRA3XSE35FE4SXEXT5UCPD4H2UYVU5K566ZM36SA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033609250 (95h26m4.464689381s) [noise=true , address=104.36.82.47:4548    , piece_id=FMAHPAXFE32RNG6AZFII3NCPPCT2A2ZSNSKPVSNJEINBCBOD5PSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033828249 (95h26m4.46490838s) [noise=true , address=104.36.82.45:4917    , piece_id=FBOFGRORXHHD2IEAYFJDJH3PSVZK5KL2WJBCCUB5WGAQJK6EBEBQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033868627 (95h26m4.464948758s) [noise=true , address=104.36.82.58:4285    , piece_id=W6QR4XNVYINMHI7KCQUUIPYVXH3BF5ICAOBIZJVIVFTJA5CN6ZIQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034241139 (95h26m4.46532127s) [noise=true , address=104.36.82.37:4657    , piece_id=RAVFTAUZF2JKQEKCXNIRHKYUEI2IKV6XEOTEWIETBLJRGUHLOLPQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034440380 (95h26m4.465520531s) [noise=true , address=104.36.82.34:4574    , piece_id=7FAHZLCZSE55KNIO6OAR35QILJUOKRKP2SM23DSSKACCC4NTBKYQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034466760 (95h26m4.465546891s) [noise=true , address=104.36.82.19:4433    , piece_id=7ACIFLYSAF6GBHQEH6XFZQUKOUX2SBAWEMUSOE2FADHAS7T55RUA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034735094 (95h26m4.465815225s) [noise=true , address=104.36.82.44:4877    , piece_id=FSTBXKKM55APNDEANGM2ITSWUIVIWRLZQBO5QLHKDAQOCXMXH5SQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034948112 (95h26m4.466028243s) [noise=true , address=104.36.82.61:4408    , piece_id=UPDG2MWQTPYHZMCUIYI3AMRBJFZBUK2VFH3XMYW5S4VDVRUZLZHA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:11.187682413 (95h26m5.618762534s) [upload=99431]: Next returned nil segment
Aug 12 16:52:11.187701179 (95h26m5.61878131s) [upload=99431]: Waiting for error group managing segments...
Aug 12 16:52:11.523406299 (95h26m5.954486471s) [noise=true , address=64.49.13.27:4967     , piece_id=VVBCNRSZV3JS62A3VP4JOVZ4KT6ISZCONBGY34ZB2HCYVBLZC4NQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:11.524659077 (95h26m5.955739208s) [noise=true , address=64.49.13.170:4718    , piece_id=WBYM36PNSDZRCPVZWBKBYE6QMOB7NZGOXMTSLDD6UHBNS5JOAGYA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:11.975786430 (95h26m6.406866561s) [noise=true , address=104.36.82.44:4901    , piece_id=FXAOJTQJKFQT4KWACYNCJIGNSLWZ4UNTXOQVDT4DD4N6RYD7W6CQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.006135960 (95h26m6.437216091s) [noise=true , address=104.36.82.8:4004     , piece_id=YAJPTSME5WLIJ4K4ETM2XZMDW2EQWSQ65C7BEYZGWR244IFZZVWQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.009210362 (95h26m6.440290493s) [noise=true , address=104.36.82.38:4689    , piece_id=RIUVUPFWBTKR37JERH6XF3VLR62KK2HIVI6S7PTZIEUQE562FTDQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.011445238 (95h26m6.442525379s) [noise=true , address=104.36.82.44:4877    , piece_id=FSTBXKKM55APNDEANGM2ITSWUIVIWRLZQBO5QLHKDAQOCXMXH5SQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.026887985 (95h26m6.457968116s) [noise=true , address=104.36.82.61:4408    , piece_id=UPDG2MWQTPYHZMCUIYI3AMRBJFZBUK2VFH3XMYW5S4VDVRUZLZHA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.058381523 (95h26m6.489461654s) [noise=true , address=104.36.82.45:4917    , piece_id=FBOFGRORXHHD2IEAYFJDJH3PSVZK5KL2WJBCCUB5WGAQJK6EBEBQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.087483616 (95h26m6.518563747s) [noise=true , address=104.36.82.7:4925     , piece_id=IE7JWJ22TWHGRRA3XSE35FE4SXEXT5UCPD4H2UYVU5K566ZM36SA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.119337293 (95h26m6.550417424s) [noise=true , address=104.36.82.58:4285    , piece_id=W6QR4XNVYINMHI7KCQUUIPYVXH3BF5ICAOBIZJVIVFTJA5CN6ZIQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.163305871 (95h26m6.594386002s) [noise=true , address=104.36.82.10:4081    , piece_id=FYL67K3RULMHGI6QRYAK2NIBCPYS3BF3JSUWDSYCJDN4MAQQ5G7Q, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.164200071 (95h26m6.595280202s) [noise=true , address=104.36.82.34:4574    , piece_id=7FAHZLCZSE55KNIO6OAR35QILJUOKRKP2SM23DSSKACCC4NTBKYQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.207407622 (95h26m6.638487763s) [noise=true , address=104.36.82.19:4433    , piece_id=7ACIFLYSAF6GBHQEH6XFZQUKOUX2SBAWEMUSOE2FADHAS7T55RUA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.572892291 (95h26m7.003972423s) [noise=true , address=104.36.82.60:4355    , piece_id=M3ZBISH7DODTBQBLY7K35U6C6FFI5L2W4JIHL6464GB3IM4E7XNQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.572948118 (95h26m7.004028249s) [seg_pos={0 0}, upload=99431]: Segment reached optimal threshold of 14 pieces.
Aug 12 16:52:12.573162088 (95h26m7.004242209s) [noise=true , address=79.127.201.215:4350  , piece_id=KXSPQYHU5MMQ36MWG52MTFNA5CTTACHQ5BCKQSWAT4FZVUE55CSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 12 16:52:12.573305692 (95h26m7.004385823s) [noise=true , address=104.36.82.37:4657    , piece_id=RAVFTAUZF2JKQEKCXNIRHKYUEI2IKV6XEOTEWIETBLJRGUHLOLPQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF
Aug 12 16:52:12.573394212 (95h26m7.004474343s) [noise=true , address=104.36.82.47:4548    , piece_id=FMAHPAXFE32RNG6AZFII3NCPPCT2A2ZSNSKPVSNJEINBCBOD5PSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P7nZqYyfKc2CT4Sf8bWjEM6zk34vVz9UMifuKRybUjWKQqekT): protocol: write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection; write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection
Aug 12 16:52:12.573460970 (95h26m7.004541111s) [noise=true , address=104.36.82.5:4867     , piece_id=ZFYYDLU2OCE4OWJONZZ6HDRXT3ZI2I3SIQKF7ROIJAMGDMTA4DSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE): protocol: write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection; write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection
Aug 12 16:52:12.573473503 (95h26m7.004553634s) [seg_pos={0 0}, upload=99431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 16:52:12.573538699 (95h26m7.00461882s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:52:12.573542666 (95h26m7.004622797s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:52:12.999339914 (95h26m7.430420035s) [upload=99431]: Done uploading segments...
Aug 12 16:52:12.999360614 (95h26m7.430440735s) [upload=99431]: Upload finished. err: <nil>
Duration: 6.539197479s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [......................X..........X..........................]
duration:
1.837511007s
FAIL (2025-08-12 16:59:16 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 12 16:39:09.008146755 (95h13m3.439226887s) [upload=99194]: Starting upload
Aug 12 16:39:09.008201260 (95h13m3.439281391s) [upload=99194]: Done starting upload
Aug 12 16:39:09.008258329 (95h13m3.43933846s) [upload=99194]: Uploading segments...
Aug 12 16:39:09.008290200 (95h13m3.439370331s) [upload=99194]: Got next segment. Inline: true
Aug 12 16:39:09.008295661 (95h13m3.439375782s) [upload=99194]: Waiting for error group managing segments...
Aug 12 16:39:09.008328123 (95h13m3.439408254s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:39:09.008334585 (95h13m3.439414716s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 12 16:39:09.008337160 (95h13m3.439417281s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:39:09.337170261 (95h13m3.768250392s) [upload=99194]: Done uploading segments...
Aug 12 16:39:09.337190520 (95h13m3.768270651s) [upload=99194]: Upload finished. err: <nil>
Duration: 1.837564639s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........]
duration:
6.072042847s
FAIL (2025-08-12 16:59:08 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
Aug 12 16:51:00.342944596 (95h24m54.774024727s) [upload=99416]: Starting upload
Aug 12 16:51:00.343003058 (95h24m54.774083189s) [upload=99416]: Done starting upload
Aug 12 16:51:00.343093682 (95h24m54.774173803s) [upload=99416]: Uploading segments...
Aug 12 16:51:00.343214823 (95h24m54.774294954s) [upload=99416]: Got next segment. Inline: false
Aug 12 16:51:00.343269027 (95h24m54.774349158s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:51:00.343273756 (95h24m54.774353887s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:51:00.585349151 (95h24m55.016429282s) [seg_pos={0 0}, upload=99416]: Begin upload segment...
Aug 12 16:51:00.585396822 (95h24m55.016476973s) [seg_pos={0 0}, upload=99416]: Done begin upload segment.
Aug 12 16:51:00.585410067 (95h24m55.016490208s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585507734 (95h24m55.016587895s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585886159 (95h24m55.0169663s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586089607 (95h24m55.017169738s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586541652 (95h24m55.017621803s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587004688 (95h24m55.018084819s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587619234 (95h24m55.018699385s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587983842 (95h24m55.019063983s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588303153 (95h24m55.019383284s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588688090 (95h24m55.019768221s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.589902393 (95h24m55.020982534s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.590674450 (95h24m55.021754601s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.591296961 (95h24m55.022377092s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.592189969 (95h24m55.02327011s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.593156619 (95h24m55.02423678s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.594056290 (95h24m55.025136421s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:02.362133336 (95h24m56.793213467s) [upload=99416]: Next returned nil segment
Aug 12 16:51:02.362159547 (95h24m56.793239678s) [upload=99416]: Waiting for error group managing segments...
Aug 12 16:51:02.650293798 (95h24m57.081373929s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.663772758 (95h24m57.094852919s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.696344749 (95h24m57.12742488s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.709104884 (95h24m57.140185025s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.722233484 (95h24m57.153313625s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.727048907 (95h24m57.158129038s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.741870376 (95h24m57.172950507s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.772732365 (95h24m57.203812507s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.805755481 (95h24m57.236835612s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.878280266 (95h24m57.309360397s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.913734542 (95h24m57.344814673s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.972369120 (95h24m57.403449251s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983815812 (95h24m57.414895943s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983842733 (95h24m57.414922864s) [seg_pos={0 0}, upload=99416]: Segment reached optimal threshold of 13 pieces.
Aug 12 16:51:02.983942084 (95h24m57.415022215s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.983999583 (95h24m57.415079715s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984087211 (95h24m57.415167342s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984124363 (95h24m57.415204494s) [seg_pos={0 0}, upload=99416]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 12 16:51:02.984229683 (95h24m57.415309814s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:51:02.984234323 (95h24m57.415314454s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:51:03.289516404 (95h24m57.720596575s) [upload=99416]: Done uploading segments...
Aug 12 16:51:03.289540049 (95h24m57.7206202s) [upload=99416]: Upload finished. err: <nil>
Duration: 6.072062745s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [.......................X..........X.........................]
duration:
1.891060398s
FAIL (2025-08-12 16:58:52 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 12 16:39:09.008146755 (95h13m3.439226887s) [upload=99194]: Starting upload
Aug 12 16:39:09.008201260 (95h13m3.439281391s) [upload=99194]: Done starting upload
Aug 12 16:39:09.008258329 (95h13m3.43933846s) [upload=99194]: Uploading segments...
Aug 12 16:39:09.008290200 (95h13m3.439370331s) [upload=99194]: Got next segment. Inline: true
Aug 12 16:39:09.008295661 (95h13m3.439375782s) [upload=99194]: Waiting for error group managing segments...
Aug 12 16:39:09.008328123 (95h13m3.439408254s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:39:09.008334585 (95h13m3.439414716s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 12 16:39:09.008337160 (95h13m3.439417281s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:39:09.337170261 (95h13m3.768250392s) [upload=99194]: Done uploading segments...
Aug 12 16:39:09.337190520 (95h13m3.768270651s) [upload=99194]: Upload finished. err: <nil>
Duration: 1.891086476s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........]
duration:
5.798595747s
FAIL (2025-08-12 16:58:33 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
Aug 12 16:51:00.342944596 (95h24m54.774024727s) [upload=99416]: Starting upload
Aug 12 16:51:00.343003058 (95h24m54.774083189s) [upload=99416]: Done starting upload
Aug 12 16:51:00.343093682 (95h24m54.774173803s) [upload=99416]: Uploading segments...
Aug 12 16:51:00.343214823 (95h24m54.774294954s) [upload=99416]: Got next segment. Inline: false
Aug 12 16:51:00.343269027 (95h24m54.774349158s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:51:00.343273756 (95h24m54.774353887s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:51:00.585349151 (95h24m55.016429282s) [seg_pos={0 0}, upload=99416]: Begin upload segment...
Aug 12 16:51:00.585396822 (95h24m55.016476973s) [seg_pos={0 0}, upload=99416]: Done begin upload segment.
Aug 12 16:51:00.585410067 (95h24m55.016490208s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585507734 (95h24m55.016587895s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585886159 (95h24m55.0169663s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586089607 (95h24m55.017169738s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586541652 (95h24m55.017621803s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587004688 (95h24m55.018084819s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587619234 (95h24m55.018699385s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587983842 (95h24m55.019063983s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588303153 (95h24m55.019383284s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588688090 (95h24m55.019768221s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.589902393 (95h24m55.020982534s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.590674450 (95h24m55.021754601s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.591296961 (95h24m55.022377092s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.592189969 (95h24m55.02327011s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.593156619 (95h24m55.02423678s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.594056290 (95h24m55.025136421s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:02.362133336 (95h24m56.793213467s) [upload=99416]: Next returned nil segment
Aug 12 16:51:02.362159547 (95h24m56.793239678s) [upload=99416]: Waiting for error group managing segments...
Aug 12 16:51:02.650293798 (95h24m57.081373929s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.663772758 (95h24m57.094852919s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.696344749 (95h24m57.12742488s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.709104884 (95h24m57.140185025s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.722233484 (95h24m57.153313625s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.727048907 (95h24m57.158129038s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.741870376 (95h24m57.172950507s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.772732365 (95h24m57.203812507s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.805755481 (95h24m57.236835612s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.878280266 (95h24m57.309360397s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.913734542 (95h24m57.344814673s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.972369120 (95h24m57.403449251s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983815812 (95h24m57.414895943s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983842733 (95h24m57.414922864s) [seg_pos={0 0}, upload=99416]: Segment reached optimal threshold of 13 pieces.
Aug 12 16:51:02.983942084 (95h24m57.415022215s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.983999583 (95h24m57.415079715s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984087211 (95h24m57.415167342s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984124363 (95h24m57.415204494s) [seg_pos={0 0}, upload=99416]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 12 16:51:02.984229683 (95h24m57.415309814s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:51:02.984234323 (95h24m57.415314454s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:51:03.289516404 (95h24m57.720596575s) [upload=99416]: Done uploading segments...
Aug 12 16:51:03.289540049 (95h24m57.7206202s) [upload=99416]: Upload finished. err: <nil>
Duration: 5.798625465s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
5 out of 60 is failed (threshold=3) [.............X.X...X.............................X.X........]
duration:
6.301226278s
FAIL (2025-08-12 16:58:02 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 16:52:09.578909030 (95h26m4.009989161s) [upload=99431]: Starting upload
Aug 12 16:52:09.578972422 (95h26m4.010052553s) [upload=99431]: Done starting upload
Aug 12 16:52:09.579277906 (95h26m4.010358037s) [upload=99431]: Uploading segments...
Aug 12 16:52:09.579324184 (95h26m4.010404315s) [upload=99431]: Got next segment. Inline: false
Aug 12 16:52:09.579372827 (95h26m4.010452958s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:52:09.579393397 (95h26m4.010473528s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:52:10.030885749 (95h26m4.46196588s) [seg_pos={0 0}, upload=99431]: Begin upload segment...
Aug 12 16:52:10.030936476 (95h26m4.462016607s) [seg_pos={0 0}, upload=99431]: Done begin upload segment.
Aug 12 16:52:10.030957215 (95h26m4.462037336s) [noise=true , address=64.49.13.170:4718    , piece_id=WBYM36PNSDZRCPVZWBKBYE6QMOB7NZGOXMTSLDD6UHBNS5JOAGYA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031415112 (95h26m4.462495243s) [noise=true , address=64.49.13.27:4967     , piece_id=VVBCNRSZV3JS62A3VP4JOVZ4KT6ISZCONBGY34ZB2HCYVBLZC4NQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031735916 (95h26m4.462816047s) [noise=true , address=104.36.82.10:4081    , piece_id=FYL67K3RULMHGI6QRYAK2NIBCPYS3BF3JSUWDSYCJDN4MAQQ5G7Q, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031792935 (95h26m4.462873056s) [noise=true , address=104.36.82.8:4004     , piece_id=YAJPTSME5WLIJ4K4ETM2XZMDW2EQWSQ65C7BEYZGWR244IFZZVWQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032336375 (95h26m4.463416506s) [noise=true , address=104.36.82.38:4689    , piece_id=RIUVUPFWBTKR37JERH6XF3VLR62KK2HIVI6S7PTZIEUQE562FTDQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032709769 (95h26m4.4637899s) [noise=true , address=79.127.201.215:4350  , piece_id=KXSPQYHU5MMQ36MWG52MTFNA5CTTACHQ5BCKQSWAT4FZVUE55CSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032913779 (95h26m4.463993901s) [noise=true , address=104.36.82.60:4355    , piece_id=M3ZBISH7DODTBQBLY7K35U6C6FFI5L2W4JIHL6464GB3IM4E7XNQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032997580 (95h26m4.464077711s) [noise=true , address=104.36.82.44:4901    , piece_id=FXAOJTQJKFQT4KWACYNCJIGNSLWZ4UNTXOQVDT4DD4N6RYD7W6CQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033176131 (95h26m4.464256262s) [noise=true , address=104.36.82.5:4867     , piece_id=ZFYYDLU2OCE4OWJONZZ6HDRXT3ZI2I3SIQKF7ROIJAMGDMTA4DSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033382095 (95h26m4.464462227s) [noise=true , address=104.36.82.7:4925     , piece_id=IE7JWJ22TWHGRRA3XSE35FE4SXEXT5UCPD4H2UYVU5K566ZM36SA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033609250 (95h26m4.464689381s) [noise=true , address=104.36.82.47:4548    , piece_id=FMAHPAXFE32RNG6AZFII3NCPPCT2A2ZSNSKPVSNJEINBCBOD5PSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033828249 (95h26m4.46490838s) [noise=true , address=104.36.82.45:4917    , piece_id=FBOFGRORXHHD2IEAYFJDJH3PSVZK5KL2WJBCCUB5WGAQJK6EBEBQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033868627 (95h26m4.464948758s) [noise=true , address=104.36.82.58:4285    , piece_id=W6QR4XNVYINMHI7KCQUUIPYVXH3BF5ICAOBIZJVIVFTJA5CN6ZIQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034241139 (95h26m4.46532127s) [noise=true , address=104.36.82.37:4657    , piece_id=RAVFTAUZF2JKQEKCXNIRHKYUEI2IKV6XEOTEWIETBLJRGUHLOLPQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034440380 (95h26m4.465520531s) [noise=true , address=104.36.82.34:4574    , piece_id=7FAHZLCZSE55KNIO6OAR35QILJUOKRKP2SM23DSSKACCC4NTBKYQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034466760 (95h26m4.465546891s) [noise=true , address=104.36.82.19:4433    , piece_id=7ACIFLYSAF6GBHQEH6XFZQUKOUX2SBAWEMUSOE2FADHAS7T55RUA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034735094 (95h26m4.465815225s) [noise=true , address=104.36.82.44:4877    , piece_id=FSTBXKKM55APNDEANGM2ITSWUIVIWRLZQBO5QLHKDAQOCXMXH5SQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034948112 (95h26m4.466028243s) [noise=true , address=104.36.82.61:4408    , piece_id=UPDG2MWQTPYHZMCUIYI3AMRBJFZBUK2VFH3XMYW5S4VDVRUZLZHA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:11.187682413 (95h26m5.618762534s) [upload=99431]: Next returned nil segment
Aug 12 16:52:11.187701179 (95h26m5.61878131s) [upload=99431]: Waiting for error group managing segments...
Aug 12 16:52:11.523406299 (95h26m5.954486471s) [noise=true , address=64.49.13.27:4967     , piece_id=VVBCNRSZV3JS62A3VP4JOVZ4KT6ISZCONBGY34ZB2HCYVBLZC4NQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:11.524659077 (95h26m5.955739208s) [noise=true , address=64.49.13.170:4718    , piece_id=WBYM36PNSDZRCPVZWBKBYE6QMOB7NZGOXMTSLDD6UHBNS5JOAGYA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:11.975786430 (95h26m6.406866561s) [noise=true , address=104.36.82.44:4901    , piece_id=FXAOJTQJKFQT4KWACYNCJIGNSLWZ4UNTXOQVDT4DD4N6RYD7W6CQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.006135960 (95h26m6.437216091s) [noise=true , address=104.36.82.8:4004     , piece_id=YAJPTSME5WLIJ4K4ETM2XZMDW2EQWSQ65C7BEYZGWR244IFZZVWQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.009210362 (95h26m6.440290493s) [noise=true , address=104.36.82.38:4689    , piece_id=RIUVUPFWBTKR37JERH6XF3VLR62KK2HIVI6S7PTZIEUQE562FTDQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.011445238 (95h26m6.442525379s) [noise=true , address=104.36.82.44:4877    , piece_id=FSTBXKKM55APNDEANGM2ITSWUIVIWRLZQBO5QLHKDAQOCXMXH5SQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.026887985 (95h26m6.457968116s) [noise=true , address=104.36.82.61:4408    , piece_id=UPDG2MWQTPYHZMCUIYI3AMRBJFZBUK2VFH3XMYW5S4VDVRUZLZHA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.058381523 (95h26m6.489461654s) [noise=true , address=104.36.82.45:4917    , piece_id=FBOFGRORXHHD2IEAYFJDJH3PSVZK5KL2WJBCCUB5WGAQJK6EBEBQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.087483616 (95h26m6.518563747s) [noise=true , address=104.36.82.7:4925     , piece_id=IE7JWJ22TWHGRRA3XSE35FE4SXEXT5UCPD4H2UYVU5K566ZM36SA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.119337293 (95h26m6.550417424s) [noise=true , address=104.36.82.58:4285    , piece_id=W6QR4XNVYINMHI7KCQUUIPYVXH3BF5ICAOBIZJVIVFTJA5CN6ZIQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.163305871 (95h26m6.594386002s) [noise=true , address=104.36.82.10:4081    , piece_id=FYL67K3RULMHGI6QRYAK2NIBCPYS3BF3JSUWDSYCJDN4MAQQ5G7Q, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.164200071 (95h26m6.595280202s) [noise=true , address=104.36.82.34:4574    , piece_id=7FAHZLCZSE55KNIO6OAR35QILJUOKRKP2SM23DSSKACCC4NTBKYQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.207407622 (95h26m6.638487763s) [noise=true , address=104.36.82.19:4433    , piece_id=7ACIFLYSAF6GBHQEH6XFZQUKOUX2SBAWEMUSOE2FADHAS7T55RUA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.572892291 (95h26m7.003972423s) [noise=true , address=104.36.82.60:4355    , piece_id=M3ZBISH7DODTBQBLY7K35U6C6FFI5L2W4JIHL6464GB3IM4E7XNQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.572948118 (95h26m7.004028249s) [seg_pos={0 0}, upload=99431]: Segment reached optimal threshold of 14 pieces.
Aug 12 16:52:12.573162088 (95h26m7.004242209s) [noise=true , address=79.127.201.215:4350  , piece_id=KXSPQYHU5MMQ36MWG52MTFNA5CTTACHQ5BCKQSWAT4FZVUE55CSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 12 16:52:12.573305692 (95h26m7.004385823s) [noise=true , address=104.36.82.37:4657    , piece_id=RAVFTAUZF2JKQEKCXNIRHKYUEI2IKV6XEOTEWIETBLJRGUHLOLPQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF
Aug 12 16:52:12.573394212 (95h26m7.004474343s) [noise=true , address=104.36.82.47:4548    , piece_id=FMAHPAXFE32RNG6AZFII3NCPPCT2A2ZSNSKPVSNJEINBCBOD5PSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P7nZqYyfKc2CT4Sf8bWjEM6zk34vVz9UMifuKRybUjWKQqekT): protocol: write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection; write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection
Aug 12 16:52:12.573460970 (95h26m7.004541111s) [noise=true , address=104.36.82.5:4867     , piece_id=ZFYYDLU2OCE4OWJONZZ6HDRXT3ZI2I3SIQKF7ROIJAMGDMTA4DSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE): protocol: write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection; write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection
Aug 12 16:52:12.573473503 (95h26m7.004553634s) [seg_pos={0 0}, upload=99431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 16:52:12.573538699 (95h26m7.00461882s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:52:12.573542666 (95h26m7.004622797s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:52:12.999339914 (95h26m7.430420035s) [upload=99431]: Done uploading segments...
Aug 12 16:52:12.999360614 (95h26m7.430440735s) [upload=99431]: Upload finished. err: <nil>
Duration: 6.301255594s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........]
duration:
5.989487394s
FAIL (2025-08-12 16:57:43 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
Aug 12 16:51:00.342944596 (95h24m54.774024727s) [upload=99416]: Starting upload
Aug 12 16:51:00.343003058 (95h24m54.774083189s) [upload=99416]: Done starting upload
Aug 12 16:51:00.343093682 (95h24m54.774173803s) [upload=99416]: Uploading segments...
Aug 12 16:51:00.343214823 (95h24m54.774294954s) [upload=99416]: Got next segment. Inline: false
Aug 12 16:51:00.343269027 (95h24m54.774349158s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:51:00.343273756 (95h24m54.774353887s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:51:00.585349151 (95h24m55.016429282s) [seg_pos={0 0}, upload=99416]: Begin upload segment...
Aug 12 16:51:00.585396822 (95h24m55.016476973s) [seg_pos={0 0}, upload=99416]: Done begin upload segment.
Aug 12 16:51:00.585410067 (95h24m55.016490208s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585507734 (95h24m55.016587895s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585886159 (95h24m55.0169663s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586089607 (95h24m55.017169738s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586541652 (95h24m55.017621803s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587004688 (95h24m55.018084819s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587619234 (95h24m55.018699385s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587983842 (95h24m55.019063983s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588303153 (95h24m55.019383284s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588688090 (95h24m55.019768221s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.589902393 (95h24m55.020982534s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.590674450 (95h24m55.021754601s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.591296961 (95h24m55.022377092s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.592189969 (95h24m55.02327011s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.593156619 (95h24m55.02423678s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.594056290 (95h24m55.025136421s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:02.362133336 (95h24m56.793213467s) [upload=99416]: Next returned nil segment
Aug 12 16:51:02.362159547 (95h24m56.793239678s) [upload=99416]: Waiting for error group managing segments...
Aug 12 16:51:02.650293798 (95h24m57.081373929s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.663772758 (95h24m57.094852919s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.696344749 (95h24m57.12742488s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.709104884 (95h24m57.140185025s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.722233484 (95h24m57.153313625s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.727048907 (95h24m57.158129038s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.741870376 (95h24m57.172950507s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.772732365 (95h24m57.203812507s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.805755481 (95h24m57.236835612s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.878280266 (95h24m57.309360397s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.913734542 (95h24m57.344814673s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.972369120 (95h24m57.403449251s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983815812 (95h24m57.414895943s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983842733 (95h24m57.414922864s) [seg_pos={0 0}, upload=99416]: Segment reached optimal threshold of 13 pieces.
Aug 12 16:51:02.983942084 (95h24m57.415022215s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.983999583 (95h24m57.415079715s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984087211 (95h24m57.415167342s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984124363 (95h24m57.415204494s) [seg_pos={0 0}, upload=99416]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 12 16:51:02.984229683 (95h24m57.415309814s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:51:02.984234323 (95h24m57.415314454s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:51:03.289516404 (95h24m57.720596575s) [upload=99416]: Done uploading segments...
Aug 12 16:51:03.289540049 (95h24m57.7206202s) [upload=99416]: Upload finished. err: <nil>
Duration: 5.989512953s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [........................X..........X........................]
duration:
1.850094574s
FAIL (2025-08-12 16:57:40 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 12 16:39:09.008146755 (95h13m3.439226887s) [upload=99194]: Starting upload
Aug 12 16:39:09.008201260 (95h13m3.439281391s) [upload=99194]: Done starting upload
Aug 12 16:39:09.008258329 (95h13m3.43933846s) [upload=99194]: Uploading segments...
Aug 12 16:39:09.008290200 (95h13m3.439370331s) [upload=99194]: Got next segment. Inline: true
Aug 12 16:39:09.008295661 (95h13m3.439375782s) [upload=99194]: Waiting for error group managing segments...
Aug 12 16:39:09.008328123 (95h13m3.439408254s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:39:09.008334585 (95h13m3.439414716s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 12 16:39:09.008337160 (95h13m3.439417281s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:39:09.337170261 (95h13m3.768250392s) [upload=99194]: Done uploading segments...
Aug 12 16:39:09.337190520 (95h13m3.768270651s) [upload=99194]: Upload finished. err: <nil>
Duration: 1.850125432s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [.........................X..........X.......................]
duration:
1.841554646s
FAIL (2025-08-12 16:56:55 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 12 16:39:09.008146755 (95h13m3.439226887s) [upload=99194]: Starting upload
Aug 12 16:39:09.008201260 (95h13m3.439281391s) [upload=99194]: Done starting upload
Aug 12 16:39:09.008258329 (95h13m3.43933846s) [upload=99194]: Uploading segments...
Aug 12 16:39:09.008290200 (95h13m3.439370331s) [upload=99194]: Got next segment. Inline: true
Aug 12 16:39:09.008295661 (95h13m3.439375782s) [upload=99194]: Waiting for error group managing segments...
Aug 12 16:39:09.008328123 (95h13m3.439408254s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:39:09.008334585 (95h13m3.439414716s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 12 16:39:09.008337160 (95h13m3.439417281s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:39:09.337170261 (95h13m3.768250392s) [upload=99194]: Done uploading segments...
Aug 12 16:39:09.337190520 (95h13m3.768270651s) [upload=99194]: Upload finished. err: <nil>
Duration: 1.841581927s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
5 out of 60 is failed (threshold=3) [..............X.X...X.............................X.X.......]
duration:
6.042886777s
FAIL (2025-08-12 16:56:49 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 16:52:09.578909030 (95h26m4.009989161s) [upload=99431]: Starting upload
Aug 12 16:52:09.578972422 (95h26m4.010052553s) [upload=99431]: Done starting upload
Aug 12 16:52:09.579277906 (95h26m4.010358037s) [upload=99431]: Uploading segments...
Aug 12 16:52:09.579324184 (95h26m4.010404315s) [upload=99431]: Got next segment. Inline: false
Aug 12 16:52:09.579372827 (95h26m4.010452958s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:52:09.579393397 (95h26m4.010473528s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:52:10.030885749 (95h26m4.46196588s) [seg_pos={0 0}, upload=99431]: Begin upload segment...
Aug 12 16:52:10.030936476 (95h26m4.462016607s) [seg_pos={0 0}, upload=99431]: Done begin upload segment.
Aug 12 16:52:10.030957215 (95h26m4.462037336s) [noise=true , address=64.49.13.170:4718    , piece_id=WBYM36PNSDZRCPVZWBKBYE6QMOB7NZGOXMTSLDD6UHBNS5JOAGYA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031415112 (95h26m4.462495243s) [noise=true , address=64.49.13.27:4967     , piece_id=VVBCNRSZV3JS62A3VP4JOVZ4KT6ISZCONBGY34ZB2HCYVBLZC4NQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031735916 (95h26m4.462816047s) [noise=true , address=104.36.82.10:4081    , piece_id=FYL67K3RULMHGI6QRYAK2NIBCPYS3BF3JSUWDSYCJDN4MAQQ5G7Q, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031792935 (95h26m4.462873056s) [noise=true , address=104.36.82.8:4004     , piece_id=YAJPTSME5WLIJ4K4ETM2XZMDW2EQWSQ65C7BEYZGWR244IFZZVWQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032336375 (95h26m4.463416506s) [noise=true , address=104.36.82.38:4689    , piece_id=RIUVUPFWBTKR37JERH6XF3VLR62KK2HIVI6S7PTZIEUQE562FTDQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032709769 (95h26m4.4637899s) [noise=true , address=79.127.201.215:4350  , piece_id=KXSPQYHU5MMQ36MWG52MTFNA5CTTACHQ5BCKQSWAT4FZVUE55CSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032913779 (95h26m4.463993901s) [noise=true , address=104.36.82.60:4355    , piece_id=M3ZBISH7DODTBQBLY7K35U6C6FFI5L2W4JIHL6464GB3IM4E7XNQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032997580 (95h26m4.464077711s) [noise=true , address=104.36.82.44:4901    , piece_id=FXAOJTQJKFQT4KWACYNCJIGNSLWZ4UNTXOQVDT4DD4N6RYD7W6CQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033176131 (95h26m4.464256262s) [noise=true , address=104.36.82.5:4867     , piece_id=ZFYYDLU2OCE4OWJONZZ6HDRXT3ZI2I3SIQKF7ROIJAMGDMTA4DSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033382095 (95h26m4.464462227s) [noise=true , address=104.36.82.7:4925     , piece_id=IE7JWJ22TWHGRRA3XSE35FE4SXEXT5UCPD4H2UYVU5K566ZM36SA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033609250 (95h26m4.464689381s) [noise=true , address=104.36.82.47:4548    , piece_id=FMAHPAXFE32RNG6AZFII3NCPPCT2A2ZSNSKPVSNJEINBCBOD5PSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033828249 (95h26m4.46490838s) [noise=true , address=104.36.82.45:4917    , piece_id=FBOFGRORXHHD2IEAYFJDJH3PSVZK5KL2WJBCCUB5WGAQJK6EBEBQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033868627 (95h26m4.464948758s) [noise=true , address=104.36.82.58:4285    , piece_id=W6QR4XNVYINMHI7KCQUUIPYVXH3BF5ICAOBIZJVIVFTJA5CN6ZIQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034241139 (95h26m4.46532127s) [noise=true , address=104.36.82.37:4657    , piece_id=RAVFTAUZF2JKQEKCXNIRHKYUEI2IKV6XEOTEWIETBLJRGUHLOLPQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034440380 (95h26m4.465520531s) [noise=true , address=104.36.82.34:4574    , piece_id=7FAHZLCZSE55KNIO6OAR35QILJUOKRKP2SM23DSSKACCC4NTBKYQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034466760 (95h26m4.465546891s) [noise=true , address=104.36.82.19:4433    , piece_id=7ACIFLYSAF6GBHQEH6XFZQUKOUX2SBAWEMUSOE2FADHAS7T55RUA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034735094 (95h26m4.465815225s) [noise=true , address=104.36.82.44:4877    , piece_id=FSTBXKKM55APNDEANGM2ITSWUIVIWRLZQBO5QLHKDAQOCXMXH5SQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034948112 (95h26m4.466028243s) [noise=true , address=104.36.82.61:4408    , piece_id=UPDG2MWQTPYHZMCUIYI3AMRBJFZBUK2VFH3XMYW5S4VDVRUZLZHA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:11.187682413 (95h26m5.618762534s) [upload=99431]: Next returned nil segment
Aug 12 16:52:11.187701179 (95h26m5.61878131s) [upload=99431]: Waiting for error group managing segments...
Aug 12 16:52:11.523406299 (95h26m5.954486471s) [noise=true , address=64.49.13.27:4967     , piece_id=VVBCNRSZV3JS62A3VP4JOVZ4KT6ISZCONBGY34ZB2HCYVBLZC4NQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:11.524659077 (95h26m5.955739208s) [noise=true , address=64.49.13.170:4718    , piece_id=WBYM36PNSDZRCPVZWBKBYE6QMOB7NZGOXMTSLDD6UHBNS5JOAGYA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:11.975786430 (95h26m6.406866561s) [noise=true , address=104.36.82.44:4901    , piece_id=FXAOJTQJKFQT4KWACYNCJIGNSLWZ4UNTXOQVDT4DD4N6RYD7W6CQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.006135960 (95h26m6.437216091s) [noise=true , address=104.36.82.8:4004     , piece_id=YAJPTSME5WLIJ4K4ETM2XZMDW2EQWSQ65C7BEYZGWR244IFZZVWQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.009210362 (95h26m6.440290493s) [noise=true , address=104.36.82.38:4689    , piece_id=RIUVUPFWBTKR37JERH6XF3VLR62KK2HIVI6S7PTZIEUQE562FTDQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.011445238 (95h26m6.442525379s) [noise=true , address=104.36.82.44:4877    , piece_id=FSTBXKKM55APNDEANGM2ITSWUIVIWRLZQBO5QLHKDAQOCXMXH5SQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.026887985 (95h26m6.457968116s) [noise=true , address=104.36.82.61:4408    , piece_id=UPDG2MWQTPYHZMCUIYI3AMRBJFZBUK2VFH3XMYW5S4VDVRUZLZHA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.058381523 (95h26m6.489461654s) [noise=true , address=104.36.82.45:4917    , piece_id=FBOFGRORXHHD2IEAYFJDJH3PSVZK5KL2WJBCCUB5WGAQJK6EBEBQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.087483616 (95h26m6.518563747s) [noise=true , address=104.36.82.7:4925     , piece_id=IE7JWJ22TWHGRRA3XSE35FE4SXEXT5UCPD4H2UYVU5K566ZM36SA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.119337293 (95h26m6.550417424s) [noise=true , address=104.36.82.58:4285    , piece_id=W6QR4XNVYINMHI7KCQUUIPYVXH3BF5ICAOBIZJVIVFTJA5CN6ZIQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.163305871 (95h26m6.594386002s) [noise=true , address=104.36.82.10:4081    , piece_id=FYL67K3RULMHGI6QRYAK2NIBCPYS3BF3JSUWDSYCJDN4MAQQ5G7Q, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.164200071 (95h26m6.595280202s) [noise=true , address=104.36.82.34:4574    , piece_id=7FAHZLCZSE55KNIO6OAR35QILJUOKRKP2SM23DSSKACCC4NTBKYQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.207407622 (95h26m6.638487763s) [noise=true , address=104.36.82.19:4433    , piece_id=7ACIFLYSAF6GBHQEH6XFZQUKOUX2SBAWEMUSOE2FADHAS7T55RUA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.572892291 (95h26m7.003972423s) [noise=true , address=104.36.82.60:4355    , piece_id=M3ZBISH7DODTBQBLY7K35U6C6FFI5L2W4JIHL6464GB3IM4E7XNQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.572948118 (95h26m7.004028249s) [seg_pos={0 0}, upload=99431]: Segment reached optimal threshold of 14 pieces.
Aug 12 16:52:12.573162088 (95h26m7.004242209s) [noise=true , address=79.127.201.215:4350  , piece_id=KXSPQYHU5MMQ36MWG52MTFNA5CTTACHQ5BCKQSWAT4FZVUE55CSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 12 16:52:12.573305692 (95h26m7.004385823s) [noise=true , address=104.36.82.37:4657    , piece_id=RAVFTAUZF2JKQEKCXNIRHKYUEI2IKV6XEOTEWIETBLJRGUHLOLPQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF
Aug 12 16:52:12.573394212 (95h26m7.004474343s) [noise=true , address=104.36.82.47:4548    , piece_id=FMAHPAXFE32RNG6AZFII3NCPPCT2A2ZSNSKPVSNJEINBCBOD5PSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P7nZqYyfKc2CT4Sf8bWjEM6zk34vVz9UMifuKRybUjWKQqekT): protocol: write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection; write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection
Aug 12 16:52:12.573460970 (95h26m7.004541111s) [noise=true , address=104.36.82.5:4867     , piece_id=ZFYYDLU2OCE4OWJONZZ6HDRXT3ZI2I3SIQKF7ROIJAMGDMTA4DSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE): protocol: write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection; write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection
Aug 12 16:52:12.573473503 (95h26m7.004553634s) [seg_pos={0 0}, upload=99431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 16:52:12.573538699 (95h26m7.00461882s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:52:12.573542666 (95h26m7.004622797s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:52:12.999339914 (95h26m7.430420035s) [upload=99431]: Done uploading segments...
Aug 12 16:52:12.999360614 (95h26m7.430440735s) [upload=99431]: Upload finished. err: <nil>
Duration: 6.042913096s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......]
duration:
6.175642742s
FAIL (2025-08-12 16:56:43 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
Aug 12 16:51:00.342944596 (95h24m54.774024727s) [upload=99416]: Starting upload
Aug 12 16:51:00.343003058 (95h24m54.774083189s) [upload=99416]: Done starting upload
Aug 12 16:51:00.343093682 (95h24m54.774173803s) [upload=99416]: Uploading segments...
Aug 12 16:51:00.343214823 (95h24m54.774294954s) [upload=99416]: Got next segment. Inline: false
Aug 12 16:51:00.343269027 (95h24m54.774349158s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:51:00.343273756 (95h24m54.774353887s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:51:00.585349151 (95h24m55.016429282s) [seg_pos={0 0}, upload=99416]: Begin upload segment...
Aug 12 16:51:00.585396822 (95h24m55.016476973s) [seg_pos={0 0}, upload=99416]: Done begin upload segment.
Aug 12 16:51:00.585410067 (95h24m55.016490208s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585507734 (95h24m55.016587895s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585886159 (95h24m55.0169663s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586089607 (95h24m55.017169738s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586541652 (95h24m55.017621803s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587004688 (95h24m55.018084819s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587619234 (95h24m55.018699385s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587983842 (95h24m55.019063983s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588303153 (95h24m55.019383284s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588688090 (95h24m55.019768221s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.589902393 (95h24m55.020982534s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.590674450 (95h24m55.021754601s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.591296961 (95h24m55.022377092s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.592189969 (95h24m55.02327011s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.593156619 (95h24m55.02423678s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.594056290 (95h24m55.025136421s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:02.362133336 (95h24m56.793213467s) [upload=99416]: Next returned nil segment
Aug 12 16:51:02.362159547 (95h24m56.793239678s) [upload=99416]: Waiting for error group managing segments...
Aug 12 16:51:02.650293798 (95h24m57.081373929s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.663772758 (95h24m57.094852919s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.696344749 (95h24m57.12742488s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.709104884 (95h24m57.140185025s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.722233484 (95h24m57.153313625s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.727048907 (95h24m57.158129038s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.741870376 (95h24m57.172950507s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.772732365 (95h24m57.203812507s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.805755481 (95h24m57.236835612s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.878280266 (95h24m57.309360397s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.913734542 (95h24m57.344814673s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.972369120 (95h24m57.403449251s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983815812 (95h24m57.414895943s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983842733 (95h24m57.414922864s) [seg_pos={0 0}, upload=99416]: Segment reached optimal threshold of 13 pieces.
Aug 12 16:51:02.983942084 (95h24m57.415022215s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.983999583 (95h24m57.415079715s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984087211 (95h24m57.415167342s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984124363 (95h24m57.415204494s) [seg_pos={0 0}, upload=99416]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 12 16:51:02.984229683 (95h24m57.415309814s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:51:02.984234323 (95h24m57.415314454s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:51:03.289516404 (95h24m57.720596575s) [upload=99416]: Done uploading segments...
Aug 12 16:51:03.289540049 (95h24m57.7206202s) [upload=99416]: Upload finished. err: <nil>
Duration: 6.175668241s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
5 out of 60 is failed (threshold=3) [...............X.X...X.............................X.X......]
duration:
5.928845753s
FAIL (2025-08-12 16:56:18 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 16:52:09.578909030 (95h26m4.009989161s) [upload=99431]: Starting upload
Aug 12 16:52:09.578972422 (95h26m4.010052553s) [upload=99431]: Done starting upload
Aug 12 16:52:09.579277906 (95h26m4.010358037s) [upload=99431]: Uploading segments...
Aug 12 16:52:09.579324184 (95h26m4.010404315s) [upload=99431]: Got next segment. Inline: false
Aug 12 16:52:09.579372827 (95h26m4.010452958s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:52:09.579393397 (95h26m4.010473528s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:52:10.030885749 (95h26m4.46196588s) [seg_pos={0 0}, upload=99431]: Begin upload segment...
Aug 12 16:52:10.030936476 (95h26m4.462016607s) [seg_pos={0 0}, upload=99431]: Done begin upload segment.
Aug 12 16:52:10.030957215 (95h26m4.462037336s) [noise=true , address=64.49.13.170:4718    , piece_id=WBYM36PNSDZRCPVZWBKBYE6QMOB7NZGOXMTSLDD6UHBNS5JOAGYA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031415112 (95h26m4.462495243s) [noise=true , address=64.49.13.27:4967     , piece_id=VVBCNRSZV3JS62A3VP4JOVZ4KT6ISZCONBGY34ZB2HCYVBLZC4NQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031735916 (95h26m4.462816047s) [noise=true , address=104.36.82.10:4081    , piece_id=FYL67K3RULMHGI6QRYAK2NIBCPYS3BF3JSUWDSYCJDN4MAQQ5G7Q, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031792935 (95h26m4.462873056s) [noise=true , address=104.36.82.8:4004     , piece_id=YAJPTSME5WLIJ4K4ETM2XZMDW2EQWSQ65C7BEYZGWR244IFZZVWQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032336375 (95h26m4.463416506s) [noise=true , address=104.36.82.38:4689    , piece_id=RIUVUPFWBTKR37JERH6XF3VLR62KK2HIVI6S7PTZIEUQE562FTDQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032709769 (95h26m4.4637899s) [noise=true , address=79.127.201.215:4350  , piece_id=KXSPQYHU5MMQ36MWG52MTFNA5CTTACHQ5BCKQSWAT4FZVUE55CSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032913779 (95h26m4.463993901s) [noise=true , address=104.36.82.60:4355    , piece_id=M3ZBISH7DODTBQBLY7K35U6C6FFI5L2W4JIHL6464GB3IM4E7XNQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032997580 (95h26m4.464077711s) [noise=true , address=104.36.82.44:4901    , piece_id=FXAOJTQJKFQT4KWACYNCJIGNSLWZ4UNTXOQVDT4DD4N6RYD7W6CQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033176131 (95h26m4.464256262s) [noise=true , address=104.36.82.5:4867     , piece_id=ZFYYDLU2OCE4OWJONZZ6HDRXT3ZI2I3SIQKF7ROIJAMGDMTA4DSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033382095 (95h26m4.464462227s) [noise=true , address=104.36.82.7:4925     , piece_id=IE7JWJ22TWHGRRA3XSE35FE4SXEXT5UCPD4H2UYVU5K566ZM36SA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033609250 (95h26m4.464689381s) [noise=true , address=104.36.82.47:4548    , piece_id=FMAHPAXFE32RNG6AZFII3NCPPCT2A2ZSNSKPVSNJEINBCBOD5PSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033828249 (95h26m4.46490838s) [noise=true , address=104.36.82.45:4917    , piece_id=FBOFGRORXHHD2IEAYFJDJH3PSVZK5KL2WJBCCUB5WGAQJK6EBEBQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033868627 (95h26m4.464948758s) [noise=true , address=104.36.82.58:4285    , piece_id=W6QR4XNVYINMHI7KCQUUIPYVXH3BF5ICAOBIZJVIVFTJA5CN6ZIQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034241139 (95h26m4.46532127s) [noise=true , address=104.36.82.37:4657    , piece_id=RAVFTAUZF2JKQEKCXNIRHKYUEI2IKV6XEOTEWIETBLJRGUHLOLPQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034440380 (95h26m4.465520531s) [noise=true , address=104.36.82.34:4574    , piece_id=7FAHZLCZSE55KNIO6OAR35QILJUOKRKP2SM23DSSKACCC4NTBKYQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034466760 (95h26m4.465546891s) [noise=true , address=104.36.82.19:4433    , piece_id=7ACIFLYSAF6GBHQEH6XFZQUKOUX2SBAWEMUSOE2FADHAS7T55RUA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034735094 (95h26m4.465815225s) [noise=true , address=104.36.82.44:4877    , piece_id=FSTBXKKM55APNDEANGM2ITSWUIVIWRLZQBO5QLHKDAQOCXMXH5SQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034948112 (95h26m4.466028243s) [noise=true , address=104.36.82.61:4408    , piece_id=UPDG2MWQTPYHZMCUIYI3AMRBJFZBUK2VFH3XMYW5S4VDVRUZLZHA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:11.187682413 (95h26m5.618762534s) [upload=99431]: Next returned nil segment
Aug 12 16:52:11.187701179 (95h26m5.61878131s) [upload=99431]: Waiting for error group managing segments...
Aug 12 16:52:11.523406299 (95h26m5.954486471s) [noise=true , address=64.49.13.27:4967     , piece_id=VVBCNRSZV3JS62A3VP4JOVZ4KT6ISZCONBGY34ZB2HCYVBLZC4NQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:11.524659077 (95h26m5.955739208s) [noise=true , address=64.49.13.170:4718    , piece_id=WBYM36PNSDZRCPVZWBKBYE6QMOB7NZGOXMTSLDD6UHBNS5JOAGYA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:11.975786430 (95h26m6.406866561s) [noise=true , address=104.36.82.44:4901    , piece_id=FXAOJTQJKFQT4KWACYNCJIGNSLWZ4UNTXOQVDT4DD4N6RYD7W6CQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.006135960 (95h26m6.437216091s) [noise=true , address=104.36.82.8:4004     , piece_id=YAJPTSME5WLIJ4K4ETM2XZMDW2EQWSQ65C7BEYZGWR244IFZZVWQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.009210362 (95h26m6.440290493s) [noise=true , address=104.36.82.38:4689    , piece_id=RIUVUPFWBTKR37JERH6XF3VLR62KK2HIVI6S7PTZIEUQE562FTDQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.011445238 (95h26m6.442525379s) [noise=true , address=104.36.82.44:4877    , piece_id=FSTBXKKM55APNDEANGM2ITSWUIVIWRLZQBO5QLHKDAQOCXMXH5SQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.026887985 (95h26m6.457968116s) [noise=true , address=104.36.82.61:4408    , piece_id=UPDG2MWQTPYHZMCUIYI3AMRBJFZBUK2VFH3XMYW5S4VDVRUZLZHA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.058381523 (95h26m6.489461654s) [noise=true , address=104.36.82.45:4917    , piece_id=FBOFGRORXHHD2IEAYFJDJH3PSVZK5KL2WJBCCUB5WGAQJK6EBEBQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.087483616 (95h26m6.518563747s) [noise=true , address=104.36.82.7:4925     , piece_id=IE7JWJ22TWHGRRA3XSE35FE4SXEXT5UCPD4H2UYVU5K566ZM36SA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.119337293 (95h26m6.550417424s) [noise=true , address=104.36.82.58:4285    , piece_id=W6QR4XNVYINMHI7KCQUUIPYVXH3BF5ICAOBIZJVIVFTJA5CN6ZIQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.163305871 (95h26m6.594386002s) [noise=true , address=104.36.82.10:4081    , piece_id=FYL67K3RULMHGI6QRYAK2NIBCPYS3BF3JSUWDSYCJDN4MAQQ5G7Q, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.164200071 (95h26m6.595280202s) [noise=true , address=104.36.82.34:4574    , piece_id=7FAHZLCZSE55KNIO6OAR35QILJUOKRKP2SM23DSSKACCC4NTBKYQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.207407622 (95h26m6.638487763s) [noise=true , address=104.36.82.19:4433    , piece_id=7ACIFLYSAF6GBHQEH6XFZQUKOUX2SBAWEMUSOE2FADHAS7T55RUA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.572892291 (95h26m7.003972423s) [noise=true , address=104.36.82.60:4355    , piece_id=M3ZBISH7DODTBQBLY7K35U6C6FFI5L2W4JIHL6464GB3IM4E7XNQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.572948118 (95h26m7.004028249s) [seg_pos={0 0}, upload=99431]: Segment reached optimal threshold of 14 pieces.
Aug 12 16:52:12.573162088 (95h26m7.004242209s) [noise=true , address=79.127.201.215:4350  , piece_id=KXSPQYHU5MMQ36MWG52MTFNA5CTTACHQ5BCKQSWAT4FZVUE55CSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 12 16:52:12.573305692 (95h26m7.004385823s) [noise=true , address=104.36.82.37:4657    , piece_id=RAVFTAUZF2JKQEKCXNIRHKYUEI2IKV6XEOTEWIETBLJRGUHLOLPQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF
Aug 12 16:52:12.573394212 (95h26m7.004474343s) [noise=true , address=104.36.82.47:4548    , piece_id=FMAHPAXFE32RNG6AZFII3NCPPCT2A2ZSNSKPVSNJEINBCBOD5PSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P7nZqYyfKc2CT4Sf8bWjEM6zk34vVz9UMifuKRybUjWKQqekT): protocol: write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection; write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection
Aug 12 16:52:12.573460970 (95h26m7.004541111s) [noise=true , address=104.36.82.5:4867     , piece_id=ZFYYDLU2OCE4OWJONZZ6HDRXT3ZI2I3SIQKF7ROIJAMGDMTA4DSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE): protocol: write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection; write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection
Aug 12 16:52:12.573473503 (95h26m7.004553634s) [seg_pos={0 0}, upload=99431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 16:52:12.573538699 (95h26m7.00461882s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:52:12.573542666 (95h26m7.004622797s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:52:12.999339914 (95h26m7.430420035s) [upload=99431]: Done uploading segments...
Aug 12 16:52:12.999360614 (95h26m7.430440735s) [upload=99431]: Upload finished. err: <nil>
Duration: 5.928868027s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......]
duration:
6.138430915s
FAIL (2025-08-12 16:55:58 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
Aug 12 16:51:00.342944596 (95h24m54.774024727s) [upload=99416]: Starting upload
Aug 12 16:51:00.343003058 (95h24m54.774083189s) [upload=99416]: Done starting upload
Aug 12 16:51:00.343093682 (95h24m54.774173803s) [upload=99416]: Uploading segments...
Aug 12 16:51:00.343214823 (95h24m54.774294954s) [upload=99416]: Got next segment. Inline: false
Aug 12 16:51:00.343269027 (95h24m54.774349158s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:51:00.343273756 (95h24m54.774353887s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:51:00.585349151 (95h24m55.016429282s) [seg_pos={0 0}, upload=99416]: Begin upload segment...
Aug 12 16:51:00.585396822 (95h24m55.016476973s) [seg_pos={0 0}, upload=99416]: Done begin upload segment.
Aug 12 16:51:00.585410067 (95h24m55.016490208s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585507734 (95h24m55.016587895s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585886159 (95h24m55.0169663s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586089607 (95h24m55.017169738s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586541652 (95h24m55.017621803s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587004688 (95h24m55.018084819s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587619234 (95h24m55.018699385s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587983842 (95h24m55.019063983s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588303153 (95h24m55.019383284s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588688090 (95h24m55.019768221s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.589902393 (95h24m55.020982534s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.590674450 (95h24m55.021754601s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.591296961 (95h24m55.022377092s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.592189969 (95h24m55.02327011s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.593156619 (95h24m55.02423678s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.594056290 (95h24m55.025136421s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:02.362133336 (95h24m56.793213467s) [upload=99416]: Next returned nil segment
Aug 12 16:51:02.362159547 (95h24m56.793239678s) [upload=99416]: Waiting for error group managing segments...
Aug 12 16:51:02.650293798 (95h24m57.081373929s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.663772758 (95h24m57.094852919s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.696344749 (95h24m57.12742488s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.709104884 (95h24m57.140185025s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.722233484 (95h24m57.153313625s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.727048907 (95h24m57.158129038s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.741870376 (95h24m57.172950507s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.772732365 (95h24m57.203812507s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.805755481 (95h24m57.236835612s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.878280266 (95h24m57.309360397s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.913734542 (95h24m57.344814673s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.972369120 (95h24m57.403449251s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983815812 (95h24m57.414895943s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983842733 (95h24m57.414922864s) [seg_pos={0 0}, upload=99416]: Segment reached optimal threshold of 13 pieces.
Aug 12 16:51:02.983942084 (95h24m57.415022215s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.983999583 (95h24m57.415079715s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984087211 (95h24m57.415167342s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984124363 (95h24m57.415204494s) [seg_pos={0 0}, upload=99416]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 12 16:51:02.984229683 (95h24m57.415309814s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:51:02.984234323 (95h24m57.415314454s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:51:03.289516404 (95h24m57.720596575s) [upload=99416]: Done uploading segments...
Aug 12 16:51:03.289540049 (95h24m57.7206202s) [upload=99416]: Upload finished. err: <nil>
Duration: 6.138455903s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [..........................X..........X......................]
duration:
1.909297469s
FAIL (2025-08-12 16:55:57 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 12 16:39:09.008146755 (95h13m3.439226887s) [upload=99194]: Starting upload
Aug 12 16:39:09.008201260 (95h13m3.439281391s) [upload=99194]: Done starting upload
Aug 12 16:39:09.008258329 (95h13m3.43933846s) [upload=99194]: Uploading segments...
Aug 12 16:39:09.008290200 (95h13m3.439370331s) [upload=99194]: Got next segment. Inline: true
Aug 12 16:39:09.008295661 (95h13m3.439375782s) [upload=99194]: Waiting for error group managing segments...
Aug 12 16:39:09.008328123 (95h13m3.439408254s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:39:09.008334585 (95h13m3.439414716s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 12 16:39:09.008337160 (95h13m3.439417281s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:39:09.337170261 (95h13m3.768250392s) [upload=99194]: Done uploading segments...
Aug 12 16:39:09.337190520 (95h13m3.768270651s) [upload=99194]: Upload finished. err: <nil>
Duration: 1.909326756s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
5 out of 60 is failed (threshold=3) [................X.X...X.............................X.X.....]
duration:
5.893617994s
FAIL (2025-08-12 16:55:21 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 16:52:09.578909030 (95h26m4.009989161s) [upload=99431]: Starting upload
Aug 12 16:52:09.578972422 (95h26m4.010052553s) [upload=99431]: Done starting upload
Aug 12 16:52:09.579277906 (95h26m4.010358037s) [upload=99431]: Uploading segments...
Aug 12 16:52:09.579324184 (95h26m4.010404315s) [upload=99431]: Got next segment. Inline: false
Aug 12 16:52:09.579372827 (95h26m4.010452958s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:52:09.579393397 (95h26m4.010473528s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:52:10.030885749 (95h26m4.46196588s) [seg_pos={0 0}, upload=99431]: Begin upload segment...
Aug 12 16:52:10.030936476 (95h26m4.462016607s) [seg_pos={0 0}, upload=99431]: Done begin upload segment.
Aug 12 16:52:10.030957215 (95h26m4.462037336s) [noise=true , address=64.49.13.170:4718    , piece_id=WBYM36PNSDZRCPVZWBKBYE6QMOB7NZGOXMTSLDD6UHBNS5JOAGYA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031415112 (95h26m4.462495243s) [noise=true , address=64.49.13.27:4967     , piece_id=VVBCNRSZV3JS62A3VP4JOVZ4KT6ISZCONBGY34ZB2HCYVBLZC4NQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031735916 (95h26m4.462816047s) [noise=true , address=104.36.82.10:4081    , piece_id=FYL67K3RULMHGI6QRYAK2NIBCPYS3BF3JSUWDSYCJDN4MAQQ5G7Q, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031792935 (95h26m4.462873056s) [noise=true , address=104.36.82.8:4004     , piece_id=YAJPTSME5WLIJ4K4ETM2XZMDW2EQWSQ65C7BEYZGWR244IFZZVWQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032336375 (95h26m4.463416506s) [noise=true , address=104.36.82.38:4689    , piece_id=RIUVUPFWBTKR37JERH6XF3VLR62KK2HIVI6S7PTZIEUQE562FTDQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032709769 (95h26m4.4637899s) [noise=true , address=79.127.201.215:4350  , piece_id=KXSPQYHU5MMQ36MWG52MTFNA5CTTACHQ5BCKQSWAT4FZVUE55CSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032913779 (95h26m4.463993901s) [noise=true , address=104.36.82.60:4355    , piece_id=M3ZBISH7DODTBQBLY7K35U6C6FFI5L2W4JIHL6464GB3IM4E7XNQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032997580 (95h26m4.464077711s) [noise=true , address=104.36.82.44:4901    , piece_id=FXAOJTQJKFQT4KWACYNCJIGNSLWZ4UNTXOQVDT4DD4N6RYD7W6CQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033176131 (95h26m4.464256262s) [noise=true , address=104.36.82.5:4867     , piece_id=ZFYYDLU2OCE4OWJONZZ6HDRXT3ZI2I3SIQKF7ROIJAMGDMTA4DSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033382095 (95h26m4.464462227s) [noise=true , address=104.36.82.7:4925     , piece_id=IE7JWJ22TWHGRRA3XSE35FE4SXEXT5UCPD4H2UYVU5K566ZM36SA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033609250 (95h26m4.464689381s) [noise=true , address=104.36.82.47:4548    , piece_id=FMAHPAXFE32RNG6AZFII3NCPPCT2A2ZSNSKPVSNJEINBCBOD5PSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033828249 (95h26m4.46490838s) [noise=true , address=104.36.82.45:4917    , piece_id=FBOFGRORXHHD2IEAYFJDJH3PSVZK5KL2WJBCCUB5WGAQJK6EBEBQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033868627 (95h26m4.464948758s) [noise=true , address=104.36.82.58:4285    , piece_id=W6QR4XNVYINMHI7KCQUUIPYVXH3BF5ICAOBIZJVIVFTJA5CN6ZIQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034241139 (95h26m4.46532127s) [noise=true , address=104.36.82.37:4657    , piece_id=RAVFTAUZF2JKQEKCXNIRHKYUEI2IKV6XEOTEWIETBLJRGUHLOLPQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034440380 (95h26m4.465520531s) [noise=true , address=104.36.82.34:4574    , piece_id=7FAHZLCZSE55KNIO6OAR35QILJUOKRKP2SM23DSSKACCC4NTBKYQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034466760 (95h26m4.465546891s) [noise=true , address=104.36.82.19:4433    , piece_id=7ACIFLYSAF6GBHQEH6XFZQUKOUX2SBAWEMUSOE2FADHAS7T55RUA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034735094 (95h26m4.465815225s) [noise=true , address=104.36.82.44:4877    , piece_id=FSTBXKKM55APNDEANGM2ITSWUIVIWRLZQBO5QLHKDAQOCXMXH5SQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034948112 (95h26m4.466028243s) [noise=true , address=104.36.82.61:4408    , piece_id=UPDG2MWQTPYHZMCUIYI3AMRBJFZBUK2VFH3XMYW5S4VDVRUZLZHA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:11.187682413 (95h26m5.618762534s) [upload=99431]: Next returned nil segment
Aug 12 16:52:11.187701179 (95h26m5.61878131s) [upload=99431]: Waiting for error group managing segments...
Aug 12 16:52:11.523406299 (95h26m5.954486471s) [noise=true , address=64.49.13.27:4967     , piece_id=VVBCNRSZV3JS62A3VP4JOVZ4KT6ISZCONBGY34ZB2HCYVBLZC4NQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:11.524659077 (95h26m5.955739208s) [noise=true , address=64.49.13.170:4718    , piece_id=WBYM36PNSDZRCPVZWBKBYE6QMOB7NZGOXMTSLDD6UHBNS5JOAGYA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:11.975786430 (95h26m6.406866561s) [noise=true , address=104.36.82.44:4901    , piece_id=FXAOJTQJKFQT4KWACYNCJIGNSLWZ4UNTXOQVDT4DD4N6RYD7W6CQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.006135960 (95h26m6.437216091s) [noise=true , address=104.36.82.8:4004     , piece_id=YAJPTSME5WLIJ4K4ETM2XZMDW2EQWSQ65C7BEYZGWR244IFZZVWQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.009210362 (95h26m6.440290493s) [noise=true , address=104.36.82.38:4689    , piece_id=RIUVUPFWBTKR37JERH6XF3VLR62KK2HIVI6S7PTZIEUQE562FTDQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.011445238 (95h26m6.442525379s) [noise=true , address=104.36.82.44:4877    , piece_id=FSTBXKKM55APNDEANGM2ITSWUIVIWRLZQBO5QLHKDAQOCXMXH5SQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.026887985 (95h26m6.457968116s) [noise=true , address=104.36.82.61:4408    , piece_id=UPDG2MWQTPYHZMCUIYI3AMRBJFZBUK2VFH3XMYW5S4VDVRUZLZHA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.058381523 (95h26m6.489461654s) [noise=true , address=104.36.82.45:4917    , piece_id=FBOFGRORXHHD2IEAYFJDJH3PSVZK5KL2WJBCCUB5WGAQJK6EBEBQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.087483616 (95h26m6.518563747s) [noise=true , address=104.36.82.7:4925     , piece_id=IE7JWJ22TWHGRRA3XSE35FE4SXEXT5UCPD4H2UYVU5K566ZM36SA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.119337293 (95h26m6.550417424s) [noise=true , address=104.36.82.58:4285    , piece_id=W6QR4XNVYINMHI7KCQUUIPYVXH3BF5ICAOBIZJVIVFTJA5CN6ZIQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.163305871 (95h26m6.594386002s) [noise=true , address=104.36.82.10:4081    , piece_id=FYL67K3RULMHGI6QRYAK2NIBCPYS3BF3JSUWDSYCJDN4MAQQ5G7Q, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.164200071 (95h26m6.595280202s) [noise=true , address=104.36.82.34:4574    , piece_id=7FAHZLCZSE55KNIO6OAR35QILJUOKRKP2SM23DSSKACCC4NTBKYQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.207407622 (95h26m6.638487763s) [noise=true , address=104.36.82.19:4433    , piece_id=7ACIFLYSAF6GBHQEH6XFZQUKOUX2SBAWEMUSOE2FADHAS7T55RUA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.572892291 (95h26m7.003972423s) [noise=true , address=104.36.82.60:4355    , piece_id=M3ZBISH7DODTBQBLY7K35U6C6FFI5L2W4JIHL6464GB3IM4E7XNQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.572948118 (95h26m7.004028249s) [seg_pos={0 0}, upload=99431]: Segment reached optimal threshold of 14 pieces.
Aug 12 16:52:12.573162088 (95h26m7.004242209s) [noise=true , address=79.127.201.215:4350  , piece_id=KXSPQYHU5MMQ36MWG52MTFNA5CTTACHQ5BCKQSWAT4FZVUE55CSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 12 16:52:12.573305692 (95h26m7.004385823s) [noise=true , address=104.36.82.37:4657    , piece_id=RAVFTAUZF2JKQEKCXNIRHKYUEI2IKV6XEOTEWIETBLJRGUHLOLPQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF
Aug 12 16:52:12.573394212 (95h26m7.004474343s) [noise=true , address=104.36.82.47:4548    , piece_id=FMAHPAXFE32RNG6AZFII3NCPPCT2A2ZSNSKPVSNJEINBCBOD5PSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P7nZqYyfKc2CT4Sf8bWjEM6zk34vVz9UMifuKRybUjWKQqekT): protocol: write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection; write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection
Aug 12 16:52:12.573460970 (95h26m7.004541111s) [noise=true , address=104.36.82.5:4867     , piece_id=ZFYYDLU2OCE4OWJONZZ6HDRXT3ZI2I3SIQKF7ROIJAMGDMTA4DSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE): protocol: write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection; write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection
Aug 12 16:52:12.573473503 (95h26m7.004553634s) [seg_pos={0 0}, upload=99431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 16:52:12.573538699 (95h26m7.00461882s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:52:12.573542666 (95h26m7.004622797s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:52:12.999339914 (95h26m7.430420035s) [upload=99431]: Done uploading segments...
Aug 12 16:52:12.999360614 (95h26m7.430440735s) [upload=99431]: Upload finished. err: <nil>
Duration: 5.893643764s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....]
duration:
6.345866762s
FAIL (2025-08-12 16:55:16 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
Aug 12 16:51:00.342944596 (95h24m54.774024727s) [upload=99416]: Starting upload
Aug 12 16:51:00.343003058 (95h24m54.774083189s) [upload=99416]: Done starting upload
Aug 12 16:51:00.343093682 (95h24m54.774173803s) [upload=99416]: Uploading segments...
Aug 12 16:51:00.343214823 (95h24m54.774294954s) [upload=99416]: Got next segment. Inline: false
Aug 12 16:51:00.343269027 (95h24m54.774349158s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:51:00.343273756 (95h24m54.774353887s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:51:00.585349151 (95h24m55.016429282s) [seg_pos={0 0}, upload=99416]: Begin upload segment...
Aug 12 16:51:00.585396822 (95h24m55.016476973s) [seg_pos={0 0}, upload=99416]: Done begin upload segment.
Aug 12 16:51:00.585410067 (95h24m55.016490208s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585507734 (95h24m55.016587895s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585886159 (95h24m55.0169663s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586089607 (95h24m55.017169738s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586541652 (95h24m55.017621803s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587004688 (95h24m55.018084819s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587619234 (95h24m55.018699385s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587983842 (95h24m55.019063983s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588303153 (95h24m55.019383284s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588688090 (95h24m55.019768221s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.589902393 (95h24m55.020982534s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.590674450 (95h24m55.021754601s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.591296961 (95h24m55.022377092s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.592189969 (95h24m55.02327011s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.593156619 (95h24m55.02423678s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.594056290 (95h24m55.025136421s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:02.362133336 (95h24m56.793213467s) [upload=99416]: Next returned nil segment
Aug 12 16:51:02.362159547 (95h24m56.793239678s) [upload=99416]: Waiting for error group managing segments...
Aug 12 16:51:02.650293798 (95h24m57.081373929s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.663772758 (95h24m57.094852919s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.696344749 (95h24m57.12742488s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.709104884 (95h24m57.140185025s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.722233484 (95h24m57.153313625s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.727048907 (95h24m57.158129038s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.741870376 (95h24m57.172950507s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.772732365 (95h24m57.203812507s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.805755481 (95h24m57.236835612s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.878280266 (95h24m57.309360397s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.913734542 (95h24m57.344814673s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.972369120 (95h24m57.403449251s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983815812 (95h24m57.414895943s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983842733 (95h24m57.414922864s) [seg_pos={0 0}, upload=99416]: Segment reached optimal threshold of 13 pieces.
Aug 12 16:51:02.983942084 (95h24m57.415022215s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.983999583 (95h24m57.415079715s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984087211 (95h24m57.415167342s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984124363 (95h24m57.415204494s) [seg_pos={0 0}, upload=99416]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 12 16:51:02.984229683 (95h24m57.415309814s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:51:02.984234323 (95h24m57.415314454s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:51:03.289516404 (95h24m57.720596575s) [upload=99416]: Done uploading segments...
Aug 12 16:51:03.289540049 (95h24m57.7206202s) [upload=99416]: Upload finished. err: <nil>
Duration: 6.34591342s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [...........................X..........X.....................]
duration:
2.000273541s
FAIL (2025-08-12 16:54:43 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 12 16:39:09.008146755 (95h13m3.439226887s) [upload=99194]: Starting upload
Aug 12 16:39:09.008201260 (95h13m3.439281391s) [upload=99194]: Done starting upload
Aug 12 16:39:09.008258329 (95h13m3.43933846s) [upload=99194]: Uploading segments...
Aug 12 16:39:09.008290200 (95h13m3.439370331s) [upload=99194]: Got next segment. Inline: true
Aug 12 16:39:09.008295661 (95h13m3.439375782s) [upload=99194]: Waiting for error group managing segments...
Aug 12 16:39:09.008328123 (95h13m3.439408254s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:39:09.008334585 (95h13m3.439414716s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 12 16:39:09.008337160 (95h13m3.439417281s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:39:09.337170261 (95h13m3.768250392s) [upload=99194]: Done uploading segments...
Aug 12 16:39:09.337190520 (95h13m3.768270651s) [upload=99194]: Upload finished. err: <nil>
Duration: 2.00029868s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
5 out of 60 is failed (threshold=3) [.................X.X...X.............................X.X....]
duration:
6.060950255s
FAIL (2025-08-12 16:54:36 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 16:52:09.578909030 (95h26m4.009989161s) [upload=99431]: Starting upload
Aug 12 16:52:09.578972422 (95h26m4.010052553s) [upload=99431]: Done starting upload
Aug 12 16:52:09.579277906 (95h26m4.010358037s) [upload=99431]: Uploading segments...
Aug 12 16:52:09.579324184 (95h26m4.010404315s) [upload=99431]: Got next segment. Inline: false
Aug 12 16:52:09.579372827 (95h26m4.010452958s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:52:09.579393397 (95h26m4.010473528s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:52:10.030885749 (95h26m4.46196588s) [seg_pos={0 0}, upload=99431]: Begin upload segment...
Aug 12 16:52:10.030936476 (95h26m4.462016607s) [seg_pos={0 0}, upload=99431]: Done begin upload segment.
Aug 12 16:52:10.030957215 (95h26m4.462037336s) [noise=true , address=64.49.13.170:4718    , piece_id=WBYM36PNSDZRCPVZWBKBYE6QMOB7NZGOXMTSLDD6UHBNS5JOAGYA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031415112 (95h26m4.462495243s) [noise=true , address=64.49.13.27:4967     , piece_id=VVBCNRSZV3JS62A3VP4JOVZ4KT6ISZCONBGY34ZB2HCYVBLZC4NQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031735916 (95h26m4.462816047s) [noise=true , address=104.36.82.10:4081    , piece_id=FYL67K3RULMHGI6QRYAK2NIBCPYS3BF3JSUWDSYCJDN4MAQQ5G7Q, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031792935 (95h26m4.462873056s) [noise=true , address=104.36.82.8:4004     , piece_id=YAJPTSME5WLIJ4K4ETM2XZMDW2EQWSQ65C7BEYZGWR244IFZZVWQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032336375 (95h26m4.463416506s) [noise=true , address=104.36.82.38:4689    , piece_id=RIUVUPFWBTKR37JERH6XF3VLR62KK2HIVI6S7PTZIEUQE562FTDQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032709769 (95h26m4.4637899s) [noise=true , address=79.127.201.215:4350  , piece_id=KXSPQYHU5MMQ36MWG52MTFNA5CTTACHQ5BCKQSWAT4FZVUE55CSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032913779 (95h26m4.463993901s) [noise=true , address=104.36.82.60:4355    , piece_id=M3ZBISH7DODTBQBLY7K35U6C6FFI5L2W4JIHL6464GB3IM4E7XNQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032997580 (95h26m4.464077711s) [noise=true , address=104.36.82.44:4901    , piece_id=FXAOJTQJKFQT4KWACYNCJIGNSLWZ4UNTXOQVDT4DD4N6RYD7W6CQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033176131 (95h26m4.464256262s) [noise=true , address=104.36.82.5:4867     , piece_id=ZFYYDLU2OCE4OWJONZZ6HDRXT3ZI2I3SIQKF7ROIJAMGDMTA4DSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033382095 (95h26m4.464462227s) [noise=true , address=104.36.82.7:4925     , piece_id=IE7JWJ22TWHGRRA3XSE35FE4SXEXT5UCPD4H2UYVU5K566ZM36SA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033609250 (95h26m4.464689381s) [noise=true , address=104.36.82.47:4548    , piece_id=FMAHPAXFE32RNG6AZFII3NCPPCT2A2ZSNSKPVSNJEINBCBOD5PSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033828249 (95h26m4.46490838s) [noise=true , address=104.36.82.45:4917    , piece_id=FBOFGRORXHHD2IEAYFJDJH3PSVZK5KL2WJBCCUB5WGAQJK6EBEBQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033868627 (95h26m4.464948758s) [noise=true , address=104.36.82.58:4285    , piece_id=W6QR4XNVYINMHI7KCQUUIPYVXH3BF5ICAOBIZJVIVFTJA5CN6ZIQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034241139 (95h26m4.46532127s) [noise=true , address=104.36.82.37:4657    , piece_id=RAVFTAUZF2JKQEKCXNIRHKYUEI2IKV6XEOTEWIETBLJRGUHLOLPQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034440380 (95h26m4.465520531s) [noise=true , address=104.36.82.34:4574    , piece_id=7FAHZLCZSE55KNIO6OAR35QILJUOKRKP2SM23DSSKACCC4NTBKYQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034466760 (95h26m4.465546891s) [noise=true , address=104.36.82.19:4433    , piece_id=7ACIFLYSAF6GBHQEH6XFZQUKOUX2SBAWEMUSOE2FADHAS7T55RUA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034735094 (95h26m4.465815225s) [noise=true , address=104.36.82.44:4877    , piece_id=FSTBXKKM55APNDEANGM2ITSWUIVIWRLZQBO5QLHKDAQOCXMXH5SQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034948112 (95h26m4.466028243s) [noise=true , address=104.36.82.61:4408    , piece_id=UPDG2MWQTPYHZMCUIYI3AMRBJFZBUK2VFH3XMYW5S4VDVRUZLZHA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:11.187682413 (95h26m5.618762534s) [upload=99431]: Next returned nil segment
Aug 12 16:52:11.187701179 (95h26m5.61878131s) [upload=99431]: Waiting for error group managing segments...
Aug 12 16:52:11.523406299 (95h26m5.954486471s) [noise=true , address=64.49.13.27:4967     , piece_id=VVBCNRSZV3JS62A3VP4JOVZ4KT6ISZCONBGY34ZB2HCYVBLZC4NQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:11.524659077 (95h26m5.955739208s) [noise=true , address=64.49.13.170:4718    , piece_id=WBYM36PNSDZRCPVZWBKBYE6QMOB7NZGOXMTSLDD6UHBNS5JOAGYA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:11.975786430 (95h26m6.406866561s) [noise=true , address=104.36.82.44:4901    , piece_id=FXAOJTQJKFQT4KWACYNCJIGNSLWZ4UNTXOQVDT4DD4N6RYD7W6CQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.006135960 (95h26m6.437216091s) [noise=true , address=104.36.82.8:4004     , piece_id=YAJPTSME5WLIJ4K4ETM2XZMDW2EQWSQ65C7BEYZGWR244IFZZVWQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.009210362 (95h26m6.440290493s) [noise=true , address=104.36.82.38:4689    , piece_id=RIUVUPFWBTKR37JERH6XF3VLR62KK2HIVI6S7PTZIEUQE562FTDQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.011445238 (95h26m6.442525379s) [noise=true , address=104.36.82.44:4877    , piece_id=FSTBXKKM55APNDEANGM2ITSWUIVIWRLZQBO5QLHKDAQOCXMXH5SQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.026887985 (95h26m6.457968116s) [noise=true , address=104.36.82.61:4408    , piece_id=UPDG2MWQTPYHZMCUIYI3AMRBJFZBUK2VFH3XMYW5S4VDVRUZLZHA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.058381523 (95h26m6.489461654s) [noise=true , address=104.36.82.45:4917    , piece_id=FBOFGRORXHHD2IEAYFJDJH3PSVZK5KL2WJBCCUB5WGAQJK6EBEBQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.087483616 (95h26m6.518563747s) [noise=true , address=104.36.82.7:4925     , piece_id=IE7JWJ22TWHGRRA3XSE35FE4SXEXT5UCPD4H2UYVU5K566ZM36SA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.119337293 (95h26m6.550417424s) [noise=true , address=104.36.82.58:4285    , piece_id=W6QR4XNVYINMHI7KCQUUIPYVXH3BF5ICAOBIZJVIVFTJA5CN6ZIQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.163305871 (95h26m6.594386002s) [noise=true , address=104.36.82.10:4081    , piece_id=FYL67K3RULMHGI6QRYAK2NIBCPYS3BF3JSUWDSYCJDN4MAQQ5G7Q, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.164200071 (95h26m6.595280202s) [noise=true , address=104.36.82.34:4574    , piece_id=7FAHZLCZSE55KNIO6OAR35QILJUOKRKP2SM23DSSKACCC4NTBKYQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.207407622 (95h26m6.638487763s) [noise=true , address=104.36.82.19:4433    , piece_id=7ACIFLYSAF6GBHQEH6XFZQUKOUX2SBAWEMUSOE2FADHAS7T55RUA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.572892291 (95h26m7.003972423s) [noise=true , address=104.36.82.60:4355    , piece_id=M3ZBISH7DODTBQBLY7K35U6C6FFI5L2W4JIHL6464GB3IM4E7XNQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.572948118 (95h26m7.004028249s) [seg_pos={0 0}, upload=99431]: Segment reached optimal threshold of 14 pieces.
Aug 12 16:52:12.573162088 (95h26m7.004242209s) [noise=true , address=79.127.201.215:4350  , piece_id=KXSPQYHU5MMQ36MWG52MTFNA5CTTACHQ5BCKQSWAT4FZVUE55CSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 12 16:52:12.573305692 (95h26m7.004385823s) [noise=true , address=104.36.82.37:4657    , piece_id=RAVFTAUZF2JKQEKCXNIRHKYUEI2IKV6XEOTEWIETBLJRGUHLOLPQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF
Aug 12 16:52:12.573394212 (95h26m7.004474343s) [noise=true , address=104.36.82.47:4548    , piece_id=FMAHPAXFE32RNG6AZFII3NCPPCT2A2ZSNSKPVSNJEINBCBOD5PSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P7nZqYyfKc2CT4Sf8bWjEM6zk34vVz9UMifuKRybUjWKQqekT): protocol: write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection; write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection
Aug 12 16:52:12.573460970 (95h26m7.004541111s) [noise=true , address=104.36.82.5:4867     , piece_id=ZFYYDLU2OCE4OWJONZZ6HDRXT3ZI2I3SIQKF7ROIJAMGDMTA4DSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE): protocol: write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection; write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection
Aug 12 16:52:12.573473503 (95h26m7.004553634s) [seg_pos={0 0}, upload=99431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 16:52:12.573538699 (95h26m7.00461882s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:52:12.573542666 (95h26m7.004622797s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:52:12.999339914 (95h26m7.430420035s) [upload=99431]: Done uploading segments...
Aug 12 16:52:12.999360614 (95h26m7.430440735s) [upload=99431]: Upload finished. err: <nil>
Duration: 6.060978148s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....]
duration:
6.138468726s
FAIL (2025-08-12 16:54:07 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
Aug 12 16:51:00.342944596 (95h24m54.774024727s) [upload=99416]: Starting upload
Aug 12 16:51:00.343003058 (95h24m54.774083189s) [upload=99416]: Done starting upload
Aug 12 16:51:00.343093682 (95h24m54.774173803s) [upload=99416]: Uploading segments...
Aug 12 16:51:00.343214823 (95h24m54.774294954s) [upload=99416]: Got next segment. Inline: false
Aug 12 16:51:00.343269027 (95h24m54.774349158s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:51:00.343273756 (95h24m54.774353887s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:51:00.585349151 (95h24m55.016429282s) [seg_pos={0 0}, upload=99416]: Begin upload segment...
Aug 12 16:51:00.585396822 (95h24m55.016476973s) [seg_pos={0 0}, upload=99416]: Done begin upload segment.
Aug 12 16:51:00.585410067 (95h24m55.016490208s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585507734 (95h24m55.016587895s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585886159 (95h24m55.0169663s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586089607 (95h24m55.017169738s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586541652 (95h24m55.017621803s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587004688 (95h24m55.018084819s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587619234 (95h24m55.018699385s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587983842 (95h24m55.019063983s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588303153 (95h24m55.019383284s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588688090 (95h24m55.019768221s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.589902393 (95h24m55.020982534s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.590674450 (95h24m55.021754601s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.591296961 (95h24m55.022377092s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.592189969 (95h24m55.02327011s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.593156619 (95h24m55.02423678s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.594056290 (95h24m55.025136421s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:02.362133336 (95h24m56.793213467s) [upload=99416]: Next returned nil segment
Aug 12 16:51:02.362159547 (95h24m56.793239678s) [upload=99416]: Waiting for error group managing segments...
Aug 12 16:51:02.650293798 (95h24m57.081373929s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.663772758 (95h24m57.094852919s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.696344749 (95h24m57.12742488s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.709104884 (95h24m57.140185025s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.722233484 (95h24m57.153313625s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.727048907 (95h24m57.158129038s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.741870376 (95h24m57.172950507s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.772732365 (95h24m57.203812507s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.805755481 (95h24m57.236835612s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.878280266 (95h24m57.309360397s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.913734542 (95h24m57.344814673s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.972369120 (95h24m57.403449251s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983815812 (95h24m57.414895943s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983842733 (95h24m57.414922864s) [seg_pos={0 0}, upload=99416]: Segment reached optimal threshold of 13 pieces.
Aug 12 16:51:02.983942084 (95h24m57.415022215s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.983999583 (95h24m57.415079715s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984087211 (95h24m57.415167342s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984124363 (95h24m57.415204494s) [seg_pos={0 0}, upload=99416]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 12 16:51:02.984229683 (95h24m57.415309814s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:51:02.984234323 (95h24m57.415314454s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:51:03.289516404 (95h24m57.720596575s) [upload=99416]: Done uploading segments...
Aug 12 16:51:03.289540049 (95h24m57.7206202s) [upload=99416]: Upload finished. err: <nil>
Duration: 6.138495156s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [............................X..........X....................]
duration:
1.944183269s
FAIL (2025-08-12 16:53:58 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 12 16:39:09.008146755 (95h13m3.439226887s) [upload=99194]: Starting upload
Aug 12 16:39:09.008201260 (95h13m3.439281391s) [upload=99194]: Done starting upload
Aug 12 16:39:09.008258329 (95h13m3.43933846s) [upload=99194]: Uploading segments...
Aug 12 16:39:09.008290200 (95h13m3.439370331s) [upload=99194]: Got next segment. Inline: true
Aug 12 16:39:09.008295661 (95h13m3.439375782s) [upload=99194]: Waiting for error group managing segments...
Aug 12 16:39:09.008328123 (95h13m3.439408254s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:39:09.008334585 (95h13m3.439414716s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 12 16:39:09.008337160 (95h13m3.439417281s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:39:09.337170261 (95h13m3.768250392s) [upload=99194]: Done uploading segments...
Aug 12 16:39:09.337190520 (95h13m3.768270651s) [upload=99194]: Upload finished. err: <nil>
Duration: 1.94421028s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
5 out of 60 is failed (threshold=3) [..................X.X...X.............................X.X...]
duration:
5.732157152s
FAIL (2025-08-12 16:53:30 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 16:52:09.578909030 (95h26m4.009989161s) [upload=99431]: Starting upload
Aug 12 16:52:09.578972422 (95h26m4.010052553s) [upload=99431]: Done starting upload
Aug 12 16:52:09.579277906 (95h26m4.010358037s) [upload=99431]: Uploading segments...
Aug 12 16:52:09.579324184 (95h26m4.010404315s) [upload=99431]: Got next segment. Inline: false
Aug 12 16:52:09.579372827 (95h26m4.010452958s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:52:09.579393397 (95h26m4.010473528s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:52:10.030885749 (95h26m4.46196588s) [seg_pos={0 0}, upload=99431]: Begin upload segment...
Aug 12 16:52:10.030936476 (95h26m4.462016607s) [seg_pos={0 0}, upload=99431]: Done begin upload segment.
Aug 12 16:52:10.030957215 (95h26m4.462037336s) [noise=true , address=64.49.13.170:4718    , piece_id=WBYM36PNSDZRCPVZWBKBYE6QMOB7NZGOXMTSLDD6UHBNS5JOAGYA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031415112 (95h26m4.462495243s) [noise=true , address=64.49.13.27:4967     , piece_id=VVBCNRSZV3JS62A3VP4JOVZ4KT6ISZCONBGY34ZB2HCYVBLZC4NQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031735916 (95h26m4.462816047s) [noise=true , address=104.36.82.10:4081    , piece_id=FYL67K3RULMHGI6QRYAK2NIBCPYS3BF3JSUWDSYCJDN4MAQQ5G7Q, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031792935 (95h26m4.462873056s) [noise=true , address=104.36.82.8:4004     , piece_id=YAJPTSME5WLIJ4K4ETM2XZMDW2EQWSQ65C7BEYZGWR244IFZZVWQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032336375 (95h26m4.463416506s) [noise=true , address=104.36.82.38:4689    , piece_id=RIUVUPFWBTKR37JERH6XF3VLR62KK2HIVI6S7PTZIEUQE562FTDQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032709769 (95h26m4.4637899s) [noise=true , address=79.127.201.215:4350  , piece_id=KXSPQYHU5MMQ36MWG52MTFNA5CTTACHQ5BCKQSWAT4FZVUE55CSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032913779 (95h26m4.463993901s) [noise=true , address=104.36.82.60:4355    , piece_id=M3ZBISH7DODTBQBLY7K35U6C6FFI5L2W4JIHL6464GB3IM4E7XNQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032997580 (95h26m4.464077711s) [noise=true , address=104.36.82.44:4901    , piece_id=FXAOJTQJKFQT4KWACYNCJIGNSLWZ4UNTXOQVDT4DD4N6RYD7W6CQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033176131 (95h26m4.464256262s) [noise=true , address=104.36.82.5:4867     , piece_id=ZFYYDLU2OCE4OWJONZZ6HDRXT3ZI2I3SIQKF7ROIJAMGDMTA4DSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033382095 (95h26m4.464462227s) [noise=true , address=104.36.82.7:4925     , piece_id=IE7JWJ22TWHGRRA3XSE35FE4SXEXT5UCPD4H2UYVU5K566ZM36SA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033609250 (95h26m4.464689381s) [noise=true , address=104.36.82.47:4548    , piece_id=FMAHPAXFE32RNG6AZFII3NCPPCT2A2ZSNSKPVSNJEINBCBOD5PSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033828249 (95h26m4.46490838s) [noise=true , address=104.36.82.45:4917    , piece_id=FBOFGRORXHHD2IEAYFJDJH3PSVZK5KL2WJBCCUB5WGAQJK6EBEBQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033868627 (95h26m4.464948758s) [noise=true , address=104.36.82.58:4285    , piece_id=W6QR4XNVYINMHI7KCQUUIPYVXH3BF5ICAOBIZJVIVFTJA5CN6ZIQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034241139 (95h26m4.46532127s) [noise=true , address=104.36.82.37:4657    , piece_id=RAVFTAUZF2JKQEKCXNIRHKYUEI2IKV6XEOTEWIETBLJRGUHLOLPQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034440380 (95h26m4.465520531s) [noise=true , address=104.36.82.34:4574    , piece_id=7FAHZLCZSE55KNIO6OAR35QILJUOKRKP2SM23DSSKACCC4NTBKYQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034466760 (95h26m4.465546891s) [noise=true , address=104.36.82.19:4433    , piece_id=7ACIFLYSAF6GBHQEH6XFZQUKOUX2SBAWEMUSOE2FADHAS7T55RUA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034735094 (95h26m4.465815225s) [noise=true , address=104.36.82.44:4877    , piece_id=FSTBXKKM55APNDEANGM2ITSWUIVIWRLZQBO5QLHKDAQOCXMXH5SQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034948112 (95h26m4.466028243s) [noise=true , address=104.36.82.61:4408    , piece_id=UPDG2MWQTPYHZMCUIYI3AMRBJFZBUK2VFH3XMYW5S4VDVRUZLZHA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:11.187682413 (95h26m5.618762534s) [upload=99431]: Next returned nil segment
Aug 12 16:52:11.187701179 (95h26m5.61878131s) [upload=99431]: Waiting for error group managing segments...
Aug 12 16:52:11.523406299 (95h26m5.954486471s) [noise=true , address=64.49.13.27:4967     , piece_id=VVBCNRSZV3JS62A3VP4JOVZ4KT6ISZCONBGY34ZB2HCYVBLZC4NQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:11.524659077 (95h26m5.955739208s) [noise=true , address=64.49.13.170:4718    , piece_id=WBYM36PNSDZRCPVZWBKBYE6QMOB7NZGOXMTSLDD6UHBNS5JOAGYA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:11.975786430 (95h26m6.406866561s) [noise=true , address=104.36.82.44:4901    , piece_id=FXAOJTQJKFQT4KWACYNCJIGNSLWZ4UNTXOQVDT4DD4N6RYD7W6CQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.006135960 (95h26m6.437216091s) [noise=true , address=104.36.82.8:4004     , piece_id=YAJPTSME5WLIJ4K4ETM2XZMDW2EQWSQ65C7BEYZGWR244IFZZVWQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.009210362 (95h26m6.440290493s) [noise=true , address=104.36.82.38:4689    , piece_id=RIUVUPFWBTKR37JERH6XF3VLR62KK2HIVI6S7PTZIEUQE562FTDQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.011445238 (95h26m6.442525379s) [noise=true , address=104.36.82.44:4877    , piece_id=FSTBXKKM55APNDEANGM2ITSWUIVIWRLZQBO5QLHKDAQOCXMXH5SQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.026887985 (95h26m6.457968116s) [noise=true , address=104.36.82.61:4408    , piece_id=UPDG2MWQTPYHZMCUIYI3AMRBJFZBUK2VFH3XMYW5S4VDVRUZLZHA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.058381523 (95h26m6.489461654s) [noise=true , address=104.36.82.45:4917    , piece_id=FBOFGRORXHHD2IEAYFJDJH3PSVZK5KL2WJBCCUB5WGAQJK6EBEBQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.087483616 (95h26m6.518563747s) [noise=true , address=104.36.82.7:4925     , piece_id=IE7JWJ22TWHGRRA3XSE35FE4SXEXT5UCPD4H2UYVU5K566ZM36SA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.119337293 (95h26m6.550417424s) [noise=true , address=104.36.82.58:4285    , piece_id=W6QR4XNVYINMHI7KCQUUIPYVXH3BF5ICAOBIZJVIVFTJA5CN6ZIQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.163305871 (95h26m6.594386002s) [noise=true , address=104.36.82.10:4081    , piece_id=FYL67K3RULMHGI6QRYAK2NIBCPYS3BF3JSUWDSYCJDN4MAQQ5G7Q, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.164200071 (95h26m6.595280202s) [noise=true , address=104.36.82.34:4574    , piece_id=7FAHZLCZSE55KNIO6OAR35QILJUOKRKP2SM23DSSKACCC4NTBKYQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.207407622 (95h26m6.638487763s) [noise=true , address=104.36.82.19:4433    , piece_id=7ACIFLYSAF6GBHQEH6XFZQUKOUX2SBAWEMUSOE2FADHAS7T55RUA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.572892291 (95h26m7.003972423s) [noise=true , address=104.36.82.60:4355    , piece_id=M3ZBISH7DODTBQBLY7K35U6C6FFI5L2W4JIHL6464GB3IM4E7XNQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.572948118 (95h26m7.004028249s) [seg_pos={0 0}, upload=99431]: Segment reached optimal threshold of 14 pieces.
Aug 12 16:52:12.573162088 (95h26m7.004242209s) [noise=true , address=79.127.201.215:4350  , piece_id=KXSPQYHU5MMQ36MWG52MTFNA5CTTACHQ5BCKQSWAT4FZVUE55CSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 12 16:52:12.573305692 (95h26m7.004385823s) [noise=true , address=104.36.82.37:4657    , piece_id=RAVFTAUZF2JKQEKCXNIRHKYUEI2IKV6XEOTEWIETBLJRGUHLOLPQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF
Aug 12 16:52:12.573394212 (95h26m7.004474343s) [noise=true , address=104.36.82.47:4548    , piece_id=FMAHPAXFE32RNG6AZFII3NCPPCT2A2ZSNSKPVSNJEINBCBOD5PSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P7nZqYyfKc2CT4Sf8bWjEM6zk34vVz9UMifuKRybUjWKQqekT): protocol: write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection; write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection
Aug 12 16:52:12.573460970 (95h26m7.004541111s) [noise=true , address=104.36.82.5:4867     , piece_id=ZFYYDLU2OCE4OWJONZZ6HDRXT3ZI2I3SIQKF7ROIJAMGDMTA4DSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE): protocol: write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection; write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection
Aug 12 16:52:12.573473503 (95h26m7.004553634s) [seg_pos={0 0}, upload=99431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 16:52:12.573538699 (95h26m7.00461882s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:52:12.573542666 (95h26m7.004622797s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:52:12.999339914 (95h26m7.430420035s) [upload=99431]: Done uploading segments...
Aug 12 16:52:12.999360614 (95h26m7.430440735s) [upload=99431]: Upload finished. err: <nil>
Duration: 5.732184003s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...]
duration:
5.981326705s
FAIL (2025-08-12 16:53:12 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
Aug 12 16:51:00.342944596 (95h24m54.774024727s) [upload=99416]: Starting upload
Aug 12 16:51:00.343003058 (95h24m54.774083189s) [upload=99416]: Done starting upload
Aug 12 16:51:00.343093682 (95h24m54.774173803s) [upload=99416]: Uploading segments...
Aug 12 16:51:00.343214823 (95h24m54.774294954s) [upload=99416]: Got next segment. Inline: false
Aug 12 16:51:00.343269027 (95h24m54.774349158s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:51:00.343273756 (95h24m54.774353887s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:51:00.585349151 (95h24m55.016429282s) [seg_pos={0 0}, upload=99416]: Begin upload segment...
Aug 12 16:51:00.585396822 (95h24m55.016476973s) [seg_pos={0 0}, upload=99416]: Done begin upload segment.
Aug 12 16:51:00.585410067 (95h24m55.016490208s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585507734 (95h24m55.016587895s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585886159 (95h24m55.0169663s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586089607 (95h24m55.017169738s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586541652 (95h24m55.017621803s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587004688 (95h24m55.018084819s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587619234 (95h24m55.018699385s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587983842 (95h24m55.019063983s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588303153 (95h24m55.019383284s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588688090 (95h24m55.019768221s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.589902393 (95h24m55.020982534s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.590674450 (95h24m55.021754601s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.591296961 (95h24m55.022377092s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.592189969 (95h24m55.02327011s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.593156619 (95h24m55.02423678s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.594056290 (95h24m55.025136421s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:02.362133336 (95h24m56.793213467s) [upload=99416]: Next returned nil segment
Aug 12 16:51:02.362159547 (95h24m56.793239678s) [upload=99416]: Waiting for error group managing segments...
Aug 12 16:51:02.650293798 (95h24m57.081373929s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.663772758 (95h24m57.094852919s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.696344749 (95h24m57.12742488s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.709104884 (95h24m57.140185025s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.722233484 (95h24m57.153313625s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.727048907 (95h24m57.158129038s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.741870376 (95h24m57.172950507s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.772732365 (95h24m57.203812507s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.805755481 (95h24m57.236835612s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.878280266 (95h24m57.309360397s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.913734542 (95h24m57.344814673s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.972369120 (95h24m57.403449251s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983815812 (95h24m57.414895943s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983842733 (95h24m57.414922864s) [seg_pos={0 0}, upload=99416]: Segment reached optimal threshold of 13 pieces.
Aug 12 16:51:02.983942084 (95h24m57.415022215s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.983999583 (95h24m57.415079715s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984087211 (95h24m57.415167342s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984124363 (95h24m57.415204494s) [seg_pos={0 0}, upload=99416]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 12 16:51:02.984229683 (95h24m57.415309814s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:51:02.984234323 (95h24m57.415314454s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:51:03.289516404 (95h24m57.720596575s) [upload=99416]: Done uploading segments...
Aug 12 16:51:03.289540049 (95h24m57.7206202s) [upload=99416]: Upload finished. err: <nil>
Duration: 5.98135584s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [.............................X..........X...................]
duration:
1.871484823s
FAIL (2025-08-12 16:53:07 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 12 16:39:09.008146755 (95h13m3.439226887s) [upload=99194]: Starting upload
Aug 12 16:39:09.008201260 (95h13m3.439281391s) [upload=99194]: Done starting upload
Aug 12 16:39:09.008258329 (95h13m3.43933846s) [upload=99194]: Uploading segments...
Aug 12 16:39:09.008290200 (95h13m3.439370331s) [upload=99194]: Got next segment. Inline: true
Aug 12 16:39:09.008295661 (95h13m3.439375782s) [upload=99194]: Waiting for error group managing segments...
Aug 12 16:39:09.008328123 (95h13m3.439408254s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:39:09.008334585 (95h13m3.439414716s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 12 16:39:09.008337160 (95h13m3.439417281s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:39:09.337170261 (95h13m3.768250392s) [upload=99194]: Done uploading segments...
Aug 12 16:39:09.337190520 (95h13m3.768270651s) [upload=99194]: Upload finished. err: <nil>
Duration: 1.871521161s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
5 out of 60 is failed (threshold=3) [...................X.X...X.............................X.X..]
duration:
5.889041315s
FAIL (2025-08-12 16:52:55 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 16:52:09.578909030 (95h26m4.009989161s) [upload=99431]: Starting upload
Aug 12 16:52:09.578972422 (95h26m4.010052553s) [upload=99431]: Done starting upload
Aug 12 16:52:09.579277906 (95h26m4.010358037s) [upload=99431]: Uploading segments...
Aug 12 16:52:09.579324184 (95h26m4.010404315s) [upload=99431]: Got next segment. Inline: false
Aug 12 16:52:09.579372827 (95h26m4.010452958s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:52:09.579393397 (95h26m4.010473528s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:52:10.030885749 (95h26m4.46196588s) [seg_pos={0 0}, upload=99431]: Begin upload segment...
Aug 12 16:52:10.030936476 (95h26m4.462016607s) [seg_pos={0 0}, upload=99431]: Done begin upload segment.
Aug 12 16:52:10.030957215 (95h26m4.462037336s) [noise=true , address=64.49.13.170:4718    , piece_id=WBYM36PNSDZRCPVZWBKBYE6QMOB7NZGOXMTSLDD6UHBNS5JOAGYA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031415112 (95h26m4.462495243s) [noise=true , address=64.49.13.27:4967     , piece_id=VVBCNRSZV3JS62A3VP4JOVZ4KT6ISZCONBGY34ZB2HCYVBLZC4NQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031735916 (95h26m4.462816047s) [noise=true , address=104.36.82.10:4081    , piece_id=FYL67K3RULMHGI6QRYAK2NIBCPYS3BF3JSUWDSYCJDN4MAQQ5G7Q, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031792935 (95h26m4.462873056s) [noise=true , address=104.36.82.8:4004     , piece_id=YAJPTSME5WLIJ4K4ETM2XZMDW2EQWSQ65C7BEYZGWR244IFZZVWQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032336375 (95h26m4.463416506s) [noise=true , address=104.36.82.38:4689    , piece_id=RIUVUPFWBTKR37JERH6XF3VLR62KK2HIVI6S7PTZIEUQE562FTDQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032709769 (95h26m4.4637899s) [noise=true , address=79.127.201.215:4350  , piece_id=KXSPQYHU5MMQ36MWG52MTFNA5CTTACHQ5BCKQSWAT4FZVUE55CSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032913779 (95h26m4.463993901s) [noise=true , address=104.36.82.60:4355    , piece_id=M3ZBISH7DODTBQBLY7K35U6C6FFI5L2W4JIHL6464GB3IM4E7XNQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032997580 (95h26m4.464077711s) [noise=true , address=104.36.82.44:4901    , piece_id=FXAOJTQJKFQT4KWACYNCJIGNSLWZ4UNTXOQVDT4DD4N6RYD7W6CQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033176131 (95h26m4.464256262s) [noise=true , address=104.36.82.5:4867     , piece_id=ZFYYDLU2OCE4OWJONZZ6HDRXT3ZI2I3SIQKF7ROIJAMGDMTA4DSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033382095 (95h26m4.464462227s) [noise=true , address=104.36.82.7:4925     , piece_id=IE7JWJ22TWHGRRA3XSE35FE4SXEXT5UCPD4H2UYVU5K566ZM36SA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033609250 (95h26m4.464689381s) [noise=true , address=104.36.82.47:4548    , piece_id=FMAHPAXFE32RNG6AZFII3NCPPCT2A2ZSNSKPVSNJEINBCBOD5PSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033828249 (95h26m4.46490838s) [noise=true , address=104.36.82.45:4917    , piece_id=FBOFGRORXHHD2IEAYFJDJH3PSVZK5KL2WJBCCUB5WGAQJK6EBEBQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033868627 (95h26m4.464948758s) [noise=true , address=104.36.82.58:4285    , piece_id=W6QR4XNVYINMHI7KCQUUIPYVXH3BF5ICAOBIZJVIVFTJA5CN6ZIQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034241139 (95h26m4.46532127s) [noise=true , address=104.36.82.37:4657    , piece_id=RAVFTAUZF2JKQEKCXNIRHKYUEI2IKV6XEOTEWIETBLJRGUHLOLPQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034440380 (95h26m4.465520531s) [noise=true , address=104.36.82.34:4574    , piece_id=7FAHZLCZSE55KNIO6OAR35QILJUOKRKP2SM23DSSKACCC4NTBKYQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034466760 (95h26m4.465546891s) [noise=true , address=104.36.82.19:4433    , piece_id=7ACIFLYSAF6GBHQEH6XFZQUKOUX2SBAWEMUSOE2FADHAS7T55RUA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034735094 (95h26m4.465815225s) [noise=true , address=104.36.82.44:4877    , piece_id=FSTBXKKM55APNDEANGM2ITSWUIVIWRLZQBO5QLHKDAQOCXMXH5SQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034948112 (95h26m4.466028243s) [noise=true , address=104.36.82.61:4408    , piece_id=UPDG2MWQTPYHZMCUIYI3AMRBJFZBUK2VFH3XMYW5S4VDVRUZLZHA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:11.187682413 (95h26m5.618762534s) [upload=99431]: Next returned nil segment
Aug 12 16:52:11.187701179 (95h26m5.61878131s) [upload=99431]: Waiting for error group managing segments...
Aug 12 16:52:11.523406299 (95h26m5.954486471s) [noise=true , address=64.49.13.27:4967     , piece_id=VVBCNRSZV3JS62A3VP4JOVZ4KT6ISZCONBGY34ZB2HCYVBLZC4NQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:11.524659077 (95h26m5.955739208s) [noise=true , address=64.49.13.170:4718    , piece_id=WBYM36PNSDZRCPVZWBKBYE6QMOB7NZGOXMTSLDD6UHBNS5JOAGYA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:11.975786430 (95h26m6.406866561s) [noise=true , address=104.36.82.44:4901    , piece_id=FXAOJTQJKFQT4KWACYNCJIGNSLWZ4UNTXOQVDT4DD4N6RYD7W6CQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.006135960 (95h26m6.437216091s) [noise=true , address=104.36.82.8:4004     , piece_id=YAJPTSME5WLIJ4K4ETM2XZMDW2EQWSQ65C7BEYZGWR244IFZZVWQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.009210362 (95h26m6.440290493s) [noise=true , address=104.36.82.38:4689    , piece_id=RIUVUPFWBTKR37JERH6XF3VLR62KK2HIVI6S7PTZIEUQE562FTDQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.011445238 (95h26m6.442525379s) [noise=true , address=104.36.82.44:4877    , piece_id=FSTBXKKM55APNDEANGM2ITSWUIVIWRLZQBO5QLHKDAQOCXMXH5SQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.026887985 (95h26m6.457968116s) [noise=true , address=104.36.82.61:4408    , piece_id=UPDG2MWQTPYHZMCUIYI3AMRBJFZBUK2VFH3XMYW5S4VDVRUZLZHA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.058381523 (95h26m6.489461654s) [noise=true , address=104.36.82.45:4917    , piece_id=FBOFGRORXHHD2IEAYFJDJH3PSVZK5KL2WJBCCUB5WGAQJK6EBEBQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.087483616 (95h26m6.518563747s) [noise=true , address=104.36.82.7:4925     , piece_id=IE7JWJ22TWHGRRA3XSE35FE4SXEXT5UCPD4H2UYVU5K566ZM36SA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.119337293 (95h26m6.550417424s) [noise=true , address=104.36.82.58:4285    , piece_id=W6QR4XNVYINMHI7KCQUUIPYVXH3BF5ICAOBIZJVIVFTJA5CN6ZIQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.163305871 (95h26m6.594386002s) [noise=true , address=104.36.82.10:4081    , piece_id=FYL67K3RULMHGI6QRYAK2NIBCPYS3BF3JSUWDSYCJDN4MAQQ5G7Q, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.164200071 (95h26m6.595280202s) [noise=true , address=104.36.82.34:4574    , piece_id=7FAHZLCZSE55KNIO6OAR35QILJUOKRKP2SM23DSSKACCC4NTBKYQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.207407622 (95h26m6.638487763s) [noise=true , address=104.36.82.19:4433    , piece_id=7ACIFLYSAF6GBHQEH6XFZQUKOUX2SBAWEMUSOE2FADHAS7T55RUA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.572892291 (95h26m7.003972423s) [noise=true , address=104.36.82.60:4355    , piece_id=M3ZBISH7DODTBQBLY7K35U6C6FFI5L2W4JIHL6464GB3IM4E7XNQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.572948118 (95h26m7.004028249s) [seg_pos={0 0}, upload=99431]: Segment reached optimal threshold of 14 pieces.
Aug 12 16:52:12.573162088 (95h26m7.004242209s) [noise=true , address=79.127.201.215:4350  , piece_id=KXSPQYHU5MMQ36MWG52MTFNA5CTTACHQ5BCKQSWAT4FZVUE55CSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 12 16:52:12.573305692 (95h26m7.004385823s) [noise=true , address=104.36.82.37:4657    , piece_id=RAVFTAUZF2JKQEKCXNIRHKYUEI2IKV6XEOTEWIETBLJRGUHLOLPQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF
Aug 12 16:52:12.573394212 (95h26m7.004474343s) [noise=true , address=104.36.82.47:4548    , piece_id=FMAHPAXFE32RNG6AZFII3NCPPCT2A2ZSNSKPVSNJEINBCBOD5PSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P7nZqYyfKc2CT4Sf8bWjEM6zk34vVz9UMifuKRybUjWKQqekT): protocol: write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection; write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection
Aug 12 16:52:12.573460970 (95h26m7.004541111s) [noise=true , address=104.36.82.5:4867     , piece_id=ZFYYDLU2OCE4OWJONZZ6HDRXT3ZI2I3SIQKF7ROIJAMGDMTA4DSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE): protocol: write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection; write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection
Aug 12 16:52:12.573473503 (95h26m7.004553634s) [seg_pos={0 0}, upload=99431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 16:52:12.573538699 (95h26m7.00461882s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:52:12.573542666 (95h26m7.004622797s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:52:12.999339914 (95h26m7.430420035s) [upload=99431]: Done uploading segments...
Aug 12 16:52:12.999360614 (95h26m7.430440735s) [upload=99431]: Upload finished. err: <nil>
Duration: 5.889069619s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..]
duration:
5.984158911s
FAIL (2025-08-12 16:52:44 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
Aug 12 16:51:00.342944596 (95h24m54.774024727s) [upload=99416]: Starting upload
Aug 12 16:51:00.343003058 (95h24m54.774083189s) [upload=99416]: Done starting upload
Aug 12 16:51:00.343093682 (95h24m54.774173803s) [upload=99416]: Uploading segments...
Aug 12 16:51:00.343214823 (95h24m54.774294954s) [upload=99416]: Got next segment. Inline: false
Aug 12 16:51:00.343269027 (95h24m54.774349158s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:51:00.343273756 (95h24m54.774353887s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:51:00.585349151 (95h24m55.016429282s) [seg_pos={0 0}, upload=99416]: Begin upload segment...
Aug 12 16:51:00.585396822 (95h24m55.016476973s) [seg_pos={0 0}, upload=99416]: Done begin upload segment.
Aug 12 16:51:00.585410067 (95h24m55.016490208s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585507734 (95h24m55.016587895s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585886159 (95h24m55.0169663s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586089607 (95h24m55.017169738s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586541652 (95h24m55.017621803s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587004688 (95h24m55.018084819s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587619234 (95h24m55.018699385s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587983842 (95h24m55.019063983s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588303153 (95h24m55.019383284s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588688090 (95h24m55.019768221s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.589902393 (95h24m55.020982534s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.590674450 (95h24m55.021754601s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.591296961 (95h24m55.022377092s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.592189969 (95h24m55.02327011s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.593156619 (95h24m55.02423678s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.594056290 (95h24m55.025136421s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:02.362133336 (95h24m56.793213467s) [upload=99416]: Next returned nil segment
Aug 12 16:51:02.362159547 (95h24m56.793239678s) [upload=99416]: Waiting for error group managing segments...
Aug 12 16:51:02.650293798 (95h24m57.081373929s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.663772758 (95h24m57.094852919s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.696344749 (95h24m57.12742488s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.709104884 (95h24m57.140185025s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.722233484 (95h24m57.153313625s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.727048907 (95h24m57.158129038s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.741870376 (95h24m57.172950507s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.772732365 (95h24m57.203812507s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.805755481 (95h24m57.236835612s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.878280266 (95h24m57.309360397s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.913734542 (95h24m57.344814673s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.972369120 (95h24m57.403449251s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983815812 (95h24m57.414895943s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983842733 (95h24m57.414922864s) [seg_pos={0 0}, upload=99416]: Segment reached optimal threshold of 13 pieces.
Aug 12 16:51:02.983942084 (95h24m57.415022215s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.983999583 (95h24m57.415079715s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984087211 (95h24m57.415167342s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984124363 (95h24m57.415204494s) [seg_pos={0 0}, upload=99416]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 12 16:51:02.984229683 (95h24m57.415309814s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:51:02.984234323 (95h24m57.415314454s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:51:03.289516404 (95h24m57.720596575s) [upload=99416]: Done uploading segments...
Aug 12 16:51:03.289540049 (95h24m57.7206202s) [upload=99416]: Upload finished. err: <nil>
Duration: 5.984182747s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
5 out of 60 is failed (threshold=3) [....................X.X...X.............................X.X.]
duration:
5.7297628s
FAIL (2025-08-12 16:52:38 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 16:52:09.578909030 (95h26m4.009989161s) [upload=99431]: Starting upload
Aug 12 16:52:09.578972422 (95h26m4.010052553s) [upload=99431]: Done starting upload
Aug 12 16:52:09.579277906 (95h26m4.010358037s) [upload=99431]: Uploading segments...
Aug 12 16:52:09.579324184 (95h26m4.010404315s) [upload=99431]: Got next segment. Inline: false
Aug 12 16:52:09.579372827 (95h26m4.010452958s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:52:09.579393397 (95h26m4.010473528s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:52:10.030885749 (95h26m4.46196588s) [seg_pos={0 0}, upload=99431]: Begin upload segment...
Aug 12 16:52:10.030936476 (95h26m4.462016607s) [seg_pos={0 0}, upload=99431]: Done begin upload segment.
Aug 12 16:52:10.030957215 (95h26m4.462037336s) [noise=true , address=64.49.13.170:4718    , piece_id=WBYM36PNSDZRCPVZWBKBYE6QMOB7NZGOXMTSLDD6UHBNS5JOAGYA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031415112 (95h26m4.462495243s) [noise=true , address=64.49.13.27:4967     , piece_id=VVBCNRSZV3JS62A3VP4JOVZ4KT6ISZCONBGY34ZB2HCYVBLZC4NQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031735916 (95h26m4.462816047s) [noise=true , address=104.36.82.10:4081    , piece_id=FYL67K3RULMHGI6QRYAK2NIBCPYS3BF3JSUWDSYCJDN4MAQQ5G7Q, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031792935 (95h26m4.462873056s) [noise=true , address=104.36.82.8:4004     , piece_id=YAJPTSME5WLIJ4K4ETM2XZMDW2EQWSQ65C7BEYZGWR244IFZZVWQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032336375 (95h26m4.463416506s) [noise=true , address=104.36.82.38:4689    , piece_id=RIUVUPFWBTKR37JERH6XF3VLR62KK2HIVI6S7PTZIEUQE562FTDQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032709769 (95h26m4.4637899s) [noise=true , address=79.127.201.215:4350  , piece_id=KXSPQYHU5MMQ36MWG52MTFNA5CTTACHQ5BCKQSWAT4FZVUE55CSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032913779 (95h26m4.463993901s) [noise=true , address=104.36.82.60:4355    , piece_id=M3ZBISH7DODTBQBLY7K35U6C6FFI5L2W4JIHL6464GB3IM4E7XNQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032997580 (95h26m4.464077711s) [noise=true , address=104.36.82.44:4901    , piece_id=FXAOJTQJKFQT4KWACYNCJIGNSLWZ4UNTXOQVDT4DD4N6RYD7W6CQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033176131 (95h26m4.464256262s) [noise=true , address=104.36.82.5:4867     , piece_id=ZFYYDLU2OCE4OWJONZZ6HDRXT3ZI2I3SIQKF7ROIJAMGDMTA4DSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033382095 (95h26m4.464462227s) [noise=true , address=104.36.82.7:4925     , piece_id=IE7JWJ22TWHGRRA3XSE35FE4SXEXT5UCPD4H2UYVU5K566ZM36SA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033609250 (95h26m4.464689381s) [noise=true , address=104.36.82.47:4548    , piece_id=FMAHPAXFE32RNG6AZFII3NCPPCT2A2ZSNSKPVSNJEINBCBOD5PSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033828249 (95h26m4.46490838s) [noise=true , address=104.36.82.45:4917    , piece_id=FBOFGRORXHHD2IEAYFJDJH3PSVZK5KL2WJBCCUB5WGAQJK6EBEBQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033868627 (95h26m4.464948758s) [noise=true , address=104.36.82.58:4285    , piece_id=W6QR4XNVYINMHI7KCQUUIPYVXH3BF5ICAOBIZJVIVFTJA5CN6ZIQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034241139 (95h26m4.46532127s) [noise=true , address=104.36.82.37:4657    , piece_id=RAVFTAUZF2JKQEKCXNIRHKYUEI2IKV6XEOTEWIETBLJRGUHLOLPQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034440380 (95h26m4.465520531s) [noise=true , address=104.36.82.34:4574    , piece_id=7FAHZLCZSE55KNIO6OAR35QILJUOKRKP2SM23DSSKACCC4NTBKYQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034466760 (95h26m4.465546891s) [noise=true , address=104.36.82.19:4433    , piece_id=7ACIFLYSAF6GBHQEH6XFZQUKOUX2SBAWEMUSOE2FADHAS7T55RUA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034735094 (95h26m4.465815225s) [noise=true , address=104.36.82.44:4877    , piece_id=FSTBXKKM55APNDEANGM2ITSWUIVIWRLZQBO5QLHKDAQOCXMXH5SQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034948112 (95h26m4.466028243s) [noise=true , address=104.36.82.61:4408    , piece_id=UPDG2MWQTPYHZMCUIYI3AMRBJFZBUK2VFH3XMYW5S4VDVRUZLZHA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:11.187682413 (95h26m5.618762534s) [upload=99431]: Next returned nil segment
Aug 12 16:52:11.187701179 (95h26m5.61878131s) [upload=99431]: Waiting for error group managing segments...
Aug 12 16:52:11.523406299 (95h26m5.954486471s) [noise=true , address=64.49.13.27:4967     , piece_id=VVBCNRSZV3JS62A3VP4JOVZ4KT6ISZCONBGY34ZB2HCYVBLZC4NQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:11.524659077 (95h26m5.955739208s) [noise=true , address=64.49.13.170:4718    , piece_id=WBYM36PNSDZRCPVZWBKBYE6QMOB7NZGOXMTSLDD6UHBNS5JOAGYA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:11.975786430 (95h26m6.406866561s) [noise=true , address=104.36.82.44:4901    , piece_id=FXAOJTQJKFQT4KWACYNCJIGNSLWZ4UNTXOQVDT4DD4N6RYD7W6CQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.006135960 (95h26m6.437216091s) [noise=true , address=104.36.82.8:4004     , piece_id=YAJPTSME5WLIJ4K4ETM2XZMDW2EQWSQ65C7BEYZGWR244IFZZVWQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.009210362 (95h26m6.440290493s) [noise=true , address=104.36.82.38:4689    , piece_id=RIUVUPFWBTKR37JERH6XF3VLR62KK2HIVI6S7PTZIEUQE562FTDQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.011445238 (95h26m6.442525379s) [noise=true , address=104.36.82.44:4877    , piece_id=FSTBXKKM55APNDEANGM2ITSWUIVIWRLZQBO5QLHKDAQOCXMXH5SQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.026887985 (95h26m6.457968116s) [noise=true , address=104.36.82.61:4408    , piece_id=UPDG2MWQTPYHZMCUIYI3AMRBJFZBUK2VFH3XMYW5S4VDVRUZLZHA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.058381523 (95h26m6.489461654s) [noise=true , address=104.36.82.45:4917    , piece_id=FBOFGRORXHHD2IEAYFJDJH3PSVZK5KL2WJBCCUB5WGAQJK6EBEBQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.087483616 (95h26m6.518563747s) [noise=true , address=104.36.82.7:4925     , piece_id=IE7JWJ22TWHGRRA3XSE35FE4SXEXT5UCPD4H2UYVU5K566ZM36SA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.119337293 (95h26m6.550417424s) [noise=true , address=104.36.82.58:4285    , piece_id=W6QR4XNVYINMHI7KCQUUIPYVXH3BF5ICAOBIZJVIVFTJA5CN6ZIQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.163305871 (95h26m6.594386002s) [noise=true , address=104.36.82.10:4081    , piece_id=FYL67K3RULMHGI6QRYAK2NIBCPYS3BF3JSUWDSYCJDN4MAQQ5G7Q, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.164200071 (95h26m6.595280202s) [noise=true , address=104.36.82.34:4574    , piece_id=7FAHZLCZSE55KNIO6OAR35QILJUOKRKP2SM23DSSKACCC4NTBKYQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.207407622 (95h26m6.638487763s) [noise=true , address=104.36.82.19:4433    , piece_id=7ACIFLYSAF6GBHQEH6XFZQUKOUX2SBAWEMUSOE2FADHAS7T55RUA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.572892291 (95h26m7.003972423s) [noise=true , address=104.36.82.60:4355    , piece_id=M3ZBISH7DODTBQBLY7K35U6C6FFI5L2W4JIHL6464GB3IM4E7XNQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.572948118 (95h26m7.004028249s) [seg_pos={0 0}, upload=99431]: Segment reached optimal threshold of 14 pieces.
Aug 12 16:52:12.573162088 (95h26m7.004242209s) [noise=true , address=79.127.201.215:4350  , piece_id=KXSPQYHU5MMQ36MWG52MTFNA5CTTACHQ5BCKQSWAT4FZVUE55CSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 12 16:52:12.573305692 (95h26m7.004385823s) [noise=true , address=104.36.82.37:4657    , piece_id=RAVFTAUZF2JKQEKCXNIRHKYUEI2IKV6XEOTEWIETBLJRGUHLOLPQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF
Aug 12 16:52:12.573394212 (95h26m7.004474343s) [noise=true , address=104.36.82.47:4548    , piece_id=FMAHPAXFE32RNG6AZFII3NCPPCT2A2ZSNSKPVSNJEINBCBOD5PSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P7nZqYyfKc2CT4Sf8bWjEM6zk34vVz9UMifuKRybUjWKQqekT): protocol: write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection; write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection
Aug 12 16:52:12.573460970 (95h26m7.004541111s) [noise=true , address=104.36.82.5:4867     , piece_id=ZFYYDLU2OCE4OWJONZZ6HDRXT3ZI2I3SIQKF7ROIJAMGDMTA4DSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE): protocol: write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection; write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection
Aug 12 16:52:12.573473503 (95h26m7.004553634s) [seg_pos={0 0}, upload=99431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 16:52:12.573538699 (95h26m7.00461882s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:52:12.573542666 (95h26m7.004622797s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:52:12.999339914 (95h26m7.430420035s) [upload=99431]: Done uploading segments...
Aug 12 16:52:12.999360614 (95h26m7.430440735s) [upload=99431]: Upload finished. err: <nil>
Duration: 5.729783531s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [..............................X..........X..................]
duration:
1.896196756s
FAIL (2025-08-12 16:52:27 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 12 16:39:09.008146755 (95h13m3.439226887s) [upload=99194]: Starting upload
Aug 12 16:39:09.008201260 (95h13m3.439281391s) [upload=99194]: Done starting upload
Aug 12 16:39:09.008258329 (95h13m3.43933846s) [upload=99194]: Uploading segments...
Aug 12 16:39:09.008290200 (95h13m3.439370331s) [upload=99194]: Got next segment. Inline: true
Aug 12 16:39:09.008295661 (95h13m3.439375782s) [upload=99194]: Waiting for error group managing segments...
Aug 12 16:39:09.008328123 (95h13m3.439408254s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:39:09.008334585 (95h13m3.439414716s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 12 16:39:09.008337160 (95h13m3.439417281s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:39:09.337170261 (95h13m3.768250392s) [upload=99194]: Done uploading segments...
Aug 12 16:39:09.337190520 (95h13m3.768270651s) [upload=99194]: Upload finished. err: <nil>
Duration: 1.89622489s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.]
duration:
6.343476785s
FAIL (2025-08-12 16:52:19 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
Aug 12 16:51:00.342944596 (95h24m54.774024727s) [upload=99416]: Starting upload
Aug 12 16:51:00.343003058 (95h24m54.774083189s) [upload=99416]: Done starting upload
Aug 12 16:51:00.343093682 (95h24m54.774173803s) [upload=99416]: Uploading segments...
Aug 12 16:51:00.343214823 (95h24m54.774294954s) [upload=99416]: Got next segment. Inline: false
Aug 12 16:51:00.343269027 (95h24m54.774349158s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:51:00.343273756 (95h24m54.774353887s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:51:00.585349151 (95h24m55.016429282s) [seg_pos={0 0}, upload=99416]: Begin upload segment...
Aug 12 16:51:00.585396822 (95h24m55.016476973s) [seg_pos={0 0}, upload=99416]: Done begin upload segment.
Aug 12 16:51:00.585410067 (95h24m55.016490208s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585507734 (95h24m55.016587895s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585886159 (95h24m55.0169663s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586089607 (95h24m55.017169738s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586541652 (95h24m55.017621803s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587004688 (95h24m55.018084819s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587619234 (95h24m55.018699385s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587983842 (95h24m55.019063983s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588303153 (95h24m55.019383284s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588688090 (95h24m55.019768221s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.589902393 (95h24m55.020982534s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.590674450 (95h24m55.021754601s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.591296961 (95h24m55.022377092s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.592189969 (95h24m55.02327011s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.593156619 (95h24m55.02423678s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.594056290 (95h24m55.025136421s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:02.362133336 (95h24m56.793213467s) [upload=99416]: Next returned nil segment
Aug 12 16:51:02.362159547 (95h24m56.793239678s) [upload=99416]: Waiting for error group managing segments...
Aug 12 16:51:02.650293798 (95h24m57.081373929s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.663772758 (95h24m57.094852919s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.696344749 (95h24m57.12742488s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.709104884 (95h24m57.140185025s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.722233484 (95h24m57.153313625s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.727048907 (95h24m57.158129038s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.741870376 (95h24m57.172950507s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.772732365 (95h24m57.203812507s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.805755481 (95h24m57.236835612s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.878280266 (95h24m57.309360397s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.913734542 (95h24m57.344814673s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.972369120 (95h24m57.403449251s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983815812 (95h24m57.414895943s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983842733 (95h24m57.414922864s) [seg_pos={0 0}, upload=99416]: Segment reached optimal threshold of 13 pieces.
Aug 12 16:51:02.983942084 (95h24m57.415022215s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.983999583 (95h24m57.415079715s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984087211 (95h24m57.415167342s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984124363 (95h24m57.415204494s) [seg_pos={0 0}, upload=99416]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 12 16:51:02.984229683 (95h24m57.415309814s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:51:02.984234323 (95h24m57.415314454s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:51:03.289516404 (95h24m57.720596575s) [upload=99416]: Done uploading segments...
Aug 12 16:51:03.289540049 (95h24m57.7206202s) [upload=99416]: Upload finished. err: <nil>
Duration: 6.343495541s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
5 out of 60 is failed (threshold=3) [.....................X.X...X.............................X.X]
duration:
4.753790848s
FAIL (2025-08-12 16:52:13 UTC)
orbiter warning: 
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 12 16:52:09.578909030 (95h26m4.009989161s) [upload=99431]: Starting upload
Aug 12 16:52:09.578972422 (95h26m4.010052553s) [upload=99431]: Done starting upload
Aug 12 16:52:09.579277906 (95h26m4.010358037s) [upload=99431]: Uploading segments...
Aug 12 16:52:09.579324184 (95h26m4.010404315s) [upload=99431]: Got next segment. Inline: false
Aug 12 16:52:09.579372827 (95h26m4.010452958s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:52:09.579393397 (95h26m4.010473528s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:52:10.030885749 (95h26m4.46196588s) [seg_pos={0 0}, upload=99431]: Begin upload segment...
Aug 12 16:52:10.030936476 (95h26m4.462016607s) [seg_pos={0 0}, upload=99431]: Done begin upload segment.
Aug 12 16:52:10.030957215 (95h26m4.462037336s) [noise=true , address=64.49.13.170:4718    , piece_id=WBYM36PNSDZRCPVZWBKBYE6QMOB7NZGOXMTSLDD6UHBNS5JOAGYA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031415112 (95h26m4.462495243s) [noise=true , address=64.49.13.27:4967     , piece_id=VVBCNRSZV3JS62A3VP4JOVZ4KT6ISZCONBGY34ZB2HCYVBLZC4NQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031735916 (95h26m4.462816047s) [noise=true , address=104.36.82.10:4081    , piece_id=FYL67K3RULMHGI6QRYAK2NIBCPYS3BF3JSUWDSYCJDN4MAQQ5G7Q, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.031792935 (95h26m4.462873056s) [noise=true , address=104.36.82.8:4004     , piece_id=YAJPTSME5WLIJ4K4ETM2XZMDW2EQWSQ65C7BEYZGWR244IFZZVWQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032336375 (95h26m4.463416506s) [noise=true , address=104.36.82.38:4689    , piece_id=RIUVUPFWBTKR37JERH6XF3VLR62KK2HIVI6S7PTZIEUQE562FTDQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032709769 (95h26m4.4637899s) [noise=true , address=79.127.201.215:4350  , piece_id=KXSPQYHU5MMQ36MWG52MTFNA5CTTACHQ5BCKQSWAT4FZVUE55CSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032913779 (95h26m4.463993901s) [noise=true , address=104.36.82.60:4355    , piece_id=M3ZBISH7DODTBQBLY7K35U6C6FFI5L2W4JIHL6464GB3IM4E7XNQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.032997580 (95h26m4.464077711s) [noise=true , address=104.36.82.44:4901    , piece_id=FXAOJTQJKFQT4KWACYNCJIGNSLWZ4UNTXOQVDT4DD4N6RYD7W6CQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033176131 (95h26m4.464256262s) [noise=true , address=104.36.82.5:4867     , piece_id=ZFYYDLU2OCE4OWJONZZ6HDRXT3ZI2I3SIQKF7ROIJAMGDMTA4DSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033382095 (95h26m4.464462227s) [noise=true , address=104.36.82.7:4925     , piece_id=IE7JWJ22TWHGRRA3XSE35FE4SXEXT5UCPD4H2UYVU5K566ZM36SA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033609250 (95h26m4.464689381s) [noise=true , address=104.36.82.47:4548    , piece_id=FMAHPAXFE32RNG6AZFII3NCPPCT2A2ZSNSKPVSNJEINBCBOD5PSQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033828249 (95h26m4.46490838s) [noise=true , address=104.36.82.45:4917    , piece_id=FBOFGRORXHHD2IEAYFJDJH3PSVZK5KL2WJBCCUB5WGAQJK6EBEBQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.033868627 (95h26m4.464948758s) [noise=true , address=104.36.82.58:4285    , piece_id=W6QR4XNVYINMHI7KCQUUIPYVXH3BF5ICAOBIZJVIVFTJA5CN6ZIQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034241139 (95h26m4.46532127s) [noise=true , address=104.36.82.37:4657    , piece_id=RAVFTAUZF2JKQEKCXNIRHKYUEI2IKV6XEOTEWIETBLJRGUHLOLPQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034440380 (95h26m4.465520531s) [noise=true , address=104.36.82.34:4574    , piece_id=7FAHZLCZSE55KNIO6OAR35QILJUOKRKP2SM23DSSKACCC4NTBKYQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034466760 (95h26m4.465546891s) [noise=true , address=104.36.82.19:4433    , piece_id=7ACIFLYSAF6GBHQEH6XFZQUKOUX2SBAWEMUSOE2FADHAS7T55RUA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034735094 (95h26m4.465815225s) [noise=true , address=104.36.82.44:4877    , piece_id=FSTBXKKM55APNDEANGM2ITSWUIVIWRLZQBO5QLHKDAQOCXMXH5SQ, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:10.034948112 (95h26m4.466028243s) [noise=true , address=104.36.82.61:4408    , piece_id=UPDG2MWQTPYHZMCUIYI3AMRBJFZBUK2VFH3XMYW5S4VDVRUZLZHA, seg_pos={0 0}, upload=99431]: Uploading piece...
Aug 12 16:52:11.187682413 (95h26m5.618762534s) [upload=99431]: Next returned nil segment
Aug 12 16:52:11.187701179 (95h26m5.61878131s) [upload=99431]: Waiting for error group managing segments...
Aug 12 16:52:11.523406299 (95h26m5.954486471s) [noise=true , address=64.49.13.27:4967     , piece_id=VVBCNRSZV3JS62A3VP4JOVZ4KT6ISZCONBGY34ZB2HCYVBLZC4NQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:11.524659077 (95h26m5.955739208s) [noise=true , address=64.49.13.170:4718    , piece_id=WBYM36PNSDZRCPVZWBKBYE6QMOB7NZGOXMTSLDD6UHBNS5JOAGYA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:11.975786430 (95h26m6.406866561s) [noise=true , address=104.36.82.44:4901    , piece_id=FXAOJTQJKFQT4KWACYNCJIGNSLWZ4UNTXOQVDT4DD4N6RYD7W6CQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.006135960 (95h26m6.437216091s) [noise=true , address=104.36.82.8:4004     , piece_id=YAJPTSME5WLIJ4K4ETM2XZMDW2EQWSQ65C7BEYZGWR244IFZZVWQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.009210362 (95h26m6.440290493s) [noise=true , address=104.36.82.38:4689    , piece_id=RIUVUPFWBTKR37JERH6XF3VLR62KK2HIVI6S7PTZIEUQE562FTDQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.011445238 (95h26m6.442525379s) [noise=true , address=104.36.82.44:4877    , piece_id=FSTBXKKM55APNDEANGM2ITSWUIVIWRLZQBO5QLHKDAQOCXMXH5SQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.026887985 (95h26m6.457968116s) [noise=true , address=104.36.82.61:4408    , piece_id=UPDG2MWQTPYHZMCUIYI3AMRBJFZBUK2VFH3XMYW5S4VDVRUZLZHA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.058381523 (95h26m6.489461654s) [noise=true , address=104.36.82.45:4917    , piece_id=FBOFGRORXHHD2IEAYFJDJH3PSVZK5KL2WJBCCUB5WGAQJK6EBEBQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.087483616 (95h26m6.518563747s) [noise=true , address=104.36.82.7:4925     , piece_id=IE7JWJ22TWHGRRA3XSE35FE4SXEXT5UCPD4H2UYVU5K566ZM36SA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.119337293 (95h26m6.550417424s) [noise=true , address=104.36.82.58:4285    , piece_id=W6QR4XNVYINMHI7KCQUUIPYVXH3BF5ICAOBIZJVIVFTJA5CN6ZIQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.163305871 (95h26m6.594386002s) [noise=true , address=104.36.82.10:4081    , piece_id=FYL67K3RULMHGI6QRYAK2NIBCPYS3BF3JSUWDSYCJDN4MAQQ5G7Q, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.164200071 (95h26m6.595280202s) [noise=true , address=104.36.82.34:4574    , piece_id=7FAHZLCZSE55KNIO6OAR35QILJUOKRKP2SM23DSSKACCC4NTBKYQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.207407622 (95h26m6.638487763s) [noise=true , address=104.36.82.19:4433    , piece_id=7ACIFLYSAF6GBHQEH6XFZQUKOUX2SBAWEMUSOE2FADHAS7T55RUA, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.572892291 (95h26m7.003972423s) [noise=true , address=104.36.82.60:4355    , piece_id=M3ZBISH7DODTBQBLY7K35U6C6FFI5L2W4JIHL6464GB3IM4E7XNQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: <nil>
Aug 12 16:52:12.572948118 (95h26m7.004028249s) [seg_pos={0 0}, upload=99431]: Segment reached optimal threshold of 14 pieces.
Aug 12 16:52:12.573162088 (95h26m7.004242209s) [noise=true , address=79.127.201.215:4350  , piece_id=KXSPQYHU5MMQ36MWG52MTFNA5CTTACHQ5BCKQSWAT4FZVUE55CSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1WhZAWvHCTj5xVkUuVZtgkFB1dhFKpBPq18YMKkepFx5qxkUAr): protocol: expected piece hash; context canceled; EOF
Aug 12 16:52:12.573305692 (95h26m7.004385823s) [noise=true , address=104.36.82.37:4657    , piece_id=RAVFTAUZF2JKQEKCXNIRHKYUEI2IKV6XEOTEWIETBLJRGUHLOLPQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129MyUjh5Nw3NhQxefnBzxYUK3mSXqwpW3nLa3KerYrjpuJiUfq): protocol: expected piece hash; context canceled; EOF
Aug 12 16:52:12.573394212 (95h26m7.004474343s) [noise=true , address=104.36.82.47:4548    , piece_id=FMAHPAXFE32RNG6AZFII3NCPPCT2A2ZSNSKPVSNJEINBCBOD5PSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1P7nZqYyfKc2CT4Sf8bWjEM6zk34vVz9UMifuKRybUjWKQqekT): protocol: write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection; write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:55176->104.36.82.47:4548: use of closed network connection
Aug 12 16:52:12.573460970 (95h26m7.004541111s) [noise=true , address=104.36.82.5:4867     , piece_id=ZFYYDLU2OCE4OWJONZZ6HDRXT3ZI2I3SIQKF7ROIJAMGDMTA4DSQ, seg_pos={0 0}, upload=99431]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Sz7PyMo81CmAAkiCwpZ3M3JaM9HMHJLwAAM5M5kv6nnKktpKE): protocol: write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection; write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44608->104.36.82.5:4867: use of closed network connection
Aug 12 16:52:12.573473503 (95h26m7.004553634s) [seg_pos={0 0}, upload=99431]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 16:52:12.573538699 (95h26m7.00461882s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:52:12.573542666 (95h26m7.004622797s) [upload=99431]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:52:12.999339914 (95h26m7.430420035s) [upload=99431]: Done uploading segments...
Aug 12 16:52:12.999360614 (95h26m7.430440735s) [upload=99431]: Upload finished. err: <nil>
Duration: 4.753893674s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)
antiblip:
2 out of 60 is failed (threshold=3) [...............................X..........X.................]
duration:
2.098215056s
FAIL (2025-08-12 16:51:49 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K
======LOGS======
Aug 12 16:39:09.008146755 (95h13m3.439226887s) [upload=99194]: Starting upload
Aug 12 16:39:09.008201260 (95h13m3.439281391s) [upload=99194]: Done starting upload
Aug 12 16:39:09.008258329 (95h13m3.43933846s) [upload=99194]: Uploading segments...
Aug 12 16:39:09.008290200 (95h13m3.439370331s) [upload=99194]: Got next segment. Inline: true
Aug 12 16:39:09.008295661 (95h13m3.439375782s) [upload=99194]: Waiting for error group managing segments...
Aug 12 16:39:09.008328123 (95h13m3.439408254s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:39:09.008334585 (95h13m3.439414716s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline
Aug 12 16:39:09.008337160 (95h13m3.439417281s) [upload=99194]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:39:09.337170261 (95h13m3.768250392s) [upload=99194]: Done uploading segments...
Aug 12 16:39:09.337190520 (95h13m3.768270651s) [upload=99194]: Upload finished. err: <nil>
Duration: 2.098239333s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)
antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X]
duration:
30.002201426s
FAIL (2025-08-12 16:51:29 UTC)
orbiter warning: 
operation: sync2.Copy
======ERROR======
uplink: context deadline exceeded
======LOGS======
Aug 12 16:51:00.342944596 (95h24m54.774024727s) [upload=99416]: Starting upload
Aug 12 16:51:00.343003058 (95h24m54.774083189s) [upload=99416]: Done starting upload
Aug 12 16:51:00.343093682 (95h24m54.774173803s) [upload=99416]: Uploading segments...
Aug 12 16:51:00.343214823 (95h24m54.774294954s) [upload=99416]: Got next segment. Inline: false
Aug 12 16:51:00.343269027 (95h24m54.774349158s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:51:00.343273756 (95h24m54.774353887s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:51:00.585349151 (95h24m55.016429282s) [seg_pos={0 0}, upload=99416]: Begin upload segment...
Aug 12 16:51:00.585396822 (95h24m55.016476973s) [seg_pos={0 0}, upload=99416]: Done begin upload segment.
Aug 12 16:51:00.585410067 (95h24m55.016490208s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585507734 (95h24m55.016587895s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.585886159 (95h24m55.0169663s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586089607 (95h24m55.017169738s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.586541652 (95h24m55.017621803s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587004688 (95h24m55.018084819s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587619234 (95h24m55.018699385s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.587983842 (95h24m55.019063983s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588303153 (95h24m55.019383284s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.588688090 (95h24m55.019768221s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.589902393 (95h24m55.020982534s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.590674450 (95h24m55.021754601s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.591296961 (95h24m55.022377092s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.592189969 (95h24m55.02327011s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.593156619 (95h24m55.02423678s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:00.594056290 (95h24m55.025136421s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Uploading piece...
Aug 12 16:51:02.362133336 (95h24m56.793213467s) [upload=99416]: Next returned nil segment
Aug 12 16:51:02.362159547 (95h24m56.793239678s) [upload=99416]: Waiting for error group managing segments...
Aug 12 16:51:02.650293798 (95h24m57.081373929s) [noise=true , address=77.90.31.18:4805     , piece_id=NW27AB2XE452YUWKJOSPZXQQ3O5THGJQZWPFNCYYTTD5KSM4LUIQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.663772758 (95h24m57.094852919s) [noise=true , address=77.90.31.12:4592     , piece_id=D5DIBKFCLXZCN5WGTVASSOPLLGWXBY42VRDRT4GERYQEN7TE7OQQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.696344749 (95h24m57.12742488s) [noise=true , address=77.90.31.17:4772     , piece_id=F335TOCUX6EOQEL3B6CRYVSNT3K3VPQKUIO4OQCKLUOYDPITGCRQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.709104884 (95h24m57.140185025s) [noise=true , address=104.36.82.12:4150    , piece_id=2URQGYBRQFL4GRLQTARGPS5OHFKAIMQ5LK4TBQJKEHWATWJQUIYA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.722233484 (95h24m57.153313625s) [noise=true , address=45.91.116.5:4299     , piece_id=KKS2MUX4QFJSJLZB6FQ7QUSIXNDXG5V666IDIXCZTVLIARPB5OOQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.727048907 (95h24m57.158129038s) [noise=true , address=77.90.31.16:4734     , piece_id=UDY6JVB3TPS2HOLPTX4ILBUJXC6IQC3BOZNVHKANKWELCBZ4O24A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.741870376 (95h24m57.172950507s) [noise=true , address=45.91.116.7:4009     , piece_id=74F32XPA5Z3DQY36ATNSVLFQSIAHA6EHL3T5W2HO2547GFJXWG7A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.772732365 (95h24m57.203812507s) [noise=true , address=104.36.82.14:4222    , piece_id=ZNU7RTT5A4ZIX23ERO2NKXX4QVNKLJB4R3VJRZVQ5SRRI5OWGC2A, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.805755481 (95h24m57.236835612s) [noise=true , address=104.36.82.4:4801     , piece_id=AZNJYD5EDG7BFS35RJP3MLEJCMPM6J7UKQIBA2RIXTXARTJ4FXGQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.878280266 (95h24m57.309360397s) [noise=true , address=77.90.31.10:4520     , piece_id=LQC7NVJGKRVXL34UQO7TDTRE3VAKZ5CENKPKM7JUSW4I4TQ3MZCQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.913734542 (95h24m57.344814673s) [noise=true , address=45.91.116.6:4975     , piece_id=MO7KK43ZBCOIDIQGWFRHNFWG5WZL77ZESIW4U24DXCC5BB57R52Q, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.972369120 (95h24m57.403449251s) [noise=true , address=104.36.82.10:4079    , piece_id=URAOYRC7A52G7O5TOAEPHJHT3G6GBDJZN3GTA37BQ5TBRSW4OYFQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983815812 (95h24m57.414895943s) [noise=true , address=104.36.82.2:4732     , piece_id=N4DXFGAMG72X2ER6AY53WWXX5KKUPAVCOVFWAFQ57KEHHFUXE2GQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: <nil>
Aug 12 16:51:02.983842733 (95h24m57.414922864s) [seg_pos={0 0}, upload=99416]: Segment reached optimal threshold of 13 pieces.
Aug 12 16:51:02.983942084 (95h24m57.415022215s) [noise=true , address=77.90.31.11:4554     , piece_id=HEXD7AOVOJTK37LL4SCH43UN4VN7EI7G7WFSPOPGHIGBPKTGV3DA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.983999583 (95h24m57.415079715s) [noise=true , address=45.91.116.7:4010     , piece_id=4UT6Y2N3KF4HO6YHIBQVF46Q5JNHLDJYBLLCFXFDOURAH4EVMBKA, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1XXhhMfCnZi1QRQeyH9L7xq346Y4bLR4m6VPAfz8fBdAtcc7w): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984087211 (95h24m57.415167342s) [noise=true , address=45.91.116.5:4298     , piece_id=FMRPFGWGVYKSC67IBWY5UFDVPN7KKRNOWZ5K66XRL4BSOXM6PVKQ, seg_pos={0 0}, upload=99416]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF
Aug 12 16:51:02.984124363 (95h24m57.415204494s) [seg_pos={0 0}, upload=99416]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Aug 12 16:51:02.984229683 (95h24m57.415309814s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:51:02.984234323 (95h24m57.415314454s) [upload=99416]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:51:03.289516404 (95h24m57.720596575s) [upload=99416]: Done uploading segments...
Aug 12 16:51:03.289540049 (95h24m57.7206202s) [upload=99416]: Upload finished. err: <nil>
Duration: 30.002220922s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
4 out of 60 is failed (threshold=3) [......................X.X...X.............................X.]
duration:
6.521525347s
FAIL (2025-08-12 16:51:17 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 16:50:56.296083714 (95h24m50.727163845s) [upload=99414]: Starting upload
Aug 12 16:50:56.296133259 (95h24m50.72721339s) [upload=99414]: Done starting upload
Aug 12 16:50:56.296238100 (95h24m50.727318271s) [upload=99414]: Uploading segments...
Aug 12 16:50:56.296332931 (95h24m50.727413062s) [upload=99414]: Got next segment. Inline: false
Aug 12 16:50:56.296369691 (95h24m50.727449822s) [upload=99414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:50:56.296374040 (95h24m50.727454171s) [upload=99414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:50:56.744593149 (95h24m51.17567328s) [seg_pos={0 0}, upload=99414]: Begin upload segment...
Aug 12 16:50:56.744641170 (95h24m51.175721301s) [seg_pos={0 0}, upload=99414]: Done begin upload segment.
Aug 12 16:50:56.744679764 (95h24m51.175759895s) [noise=true , address=104.36.82.11:4129    , piece_id=6G7JK2EV7SUZSQX6RKALRPSHSYQOJCPEUQSUVTSPF2LBWYYPZF6Q, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.744693380 (95h24m51.175773521s) [noise=true , address=104.36.82.17:4337    , piece_id=2WXVQL5YG3VUO6LALBL3KJ5PHPGI6EDHLN7G7LOITNJ3O4KL2K5Q, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.745073026 (95h24m51.176153157s) [noise=true , address=104.36.82.23:4453    , piece_id=YIAUALSNQQUHHEMRETPFHX3UTOGH72TFUILK4LZXAWWWACSCBLTA, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.745179590 (95h24m51.176259711s) [noise=true , address=104.36.82.8:4982     , piece_id=NSX43CJ3WG4HG4WXNUWWRRU5Z6JZZFFIY2LOKZRRWRT554N2TGLQ, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.745354795 (95h24m51.176434926s) [noise=true , address=104.36.82.16:4307    , piece_id=65QC6LVYZEZGJN7RLNTMXEIXPLKPLUFJD72TGSVFNFN74FZGHXGQ, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.745451942 (95h24m51.176532073s) [noise=true , address=104.36.82.62:4441    , piece_id=TI7HJMXSGBFWZPDLDY6GKW73ZGIPICPKZ5C7DFXRQLJMVSAOXQVQ, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.745629060 (95h24m51.176709191s) [noise=true , address=104.36.82.5:4843     , piece_id=XR3YA2NRMC7E2Y62FBEN3H6BPV4XHYYRSJWDAJXWH77HWIZWOGKQ, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.745696500 (95h24m51.176776631s) [noise=true , address=104.36.82.4:4833     , piece_id=SNUEZ7QAZN6KBAJQMSDXUKI4S3RSZIZJVBPR5G5YZP3VN2RSAG6Q, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.745912433 (95h24m51.176992564s) [noise=true , address=104.36.82.18:4377    , piece_id=OHK345LD473E2I525O6DDAW3ZDYEKOCEOT3TS44PRDXEAAHKD5NA, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.745937110 (95h24m51.177017231s) [noise=true , address=104.36.82.47:4529    , piece_id=DA5NO2BFHTG6QY5SAILHS2RD2FFBNWEBPKRKKYZWSKOR5R4UFZCQ, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.746153123 (95h24m51.177233254s) [noise=true , address=45.91.116.7:4026     , piece_id=FC2PMDJCQG7ZSRVBUZIKLSA4DBIFP4WEG3D7MJS2I27QZPVVUYBQ, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.746158774 (95h24m51.177238895s) [noise=true , address=104.36.82.35:4608    , piece_id=YNRJ6YYAHIFJDSWJBU54DVD5BIZATIP6AJLJMQM46KNTRIQY4ZLQ, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.746369857 (95h24m51.177449989s) [noise=true , address=104.36.82.59:4306    , piece_id=ZIOXDRF6XLJYQWVXC55D4DRNYPNZYMED4YIZOLINOUQ6AWY5GXQQ, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.746399404 (95h24m51.177479525s) [noise=true , address=79.127.219.38:4034   , piece_id=COHYXZ6EPUBNAYRJTAQBCMVICXKLE32OAVD4VNPJVWSMRBN2UONA, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.746584208 (95h24m51.177664339s) [noise=true , address=104.36.82.37:4673    , piece_id=523WCZNOTIMHF5M2D3KWWJX3OEOO6L7CHSPZEU456N3EBUBUPVZQ, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.746766417 (95h24m51.177846548s) [noise=true , address=45.91.116.8:4064     , piece_id=GTVDBE5DCFNMMK2HHUXXR6AHC6GUISL4ZN7VQY5B3BI35APD7FPA, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.746966620 (95h24m51.178046751s) [noise=true , address=104.36.82.60:4342    , piece_id=JLBQYZ7ETQBJ7RMVOS5QFCUAFKOFYRAGVZOOP5SQGIZOA2SFM6GA, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.749185405 (95h24m51.180265536s) [noise=true , address=104.36.82.6:4889     , piece_id=WIOCDHPKF7W7LDNEZLKIMAY7DLC3WSTHUGFYYQVN22VFIRP6R6HQ, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:58.288780044 (95h24m52.719860175s) [upload=99414]: Next returned nil segment
Aug 12 16:50:58.288798188 (95h24m52.719878309s) [upload=99414]: Waiting for error group managing segments...
Aug 12 16:50:58.695213904 (95h24m53.126294025s) [noise=true , address=104.36.82.47:4529    , piece_id=DA5NO2BFHTG6QY5SAILHS2RD2FFBNWEBPKRKKYZWSKOR5R4UFZCQ, seg_pos={0 0}, upload=99414]: Done uploading piece. err: <nil>
Aug 12 16:50:58.713211970 (95h24m53.144292101s) [noise=true , address=104.36.82.18:4377    , piece_id=OHK345LD473E2I525O6DDAW3ZDYEKOCEOT3TS44PRDXEAAHKD5NA, seg_pos={0 0}, upload=99414]: Done uploading piece. err: <nil>
Aug 12 16:50:58.731814313 (95h24m53.162894444s) [noise=true , address=104.36.82.37:4673    , piece_id=523WCZNOTIMHF5M2D3KWWJX3OEOO6L7CHSPZEU456N3EBUBUPVZQ, seg_pos={0 0}, upload=99414]: Done uploading piece. err: <nil>
Aug 12 16:50:58.736072060 (95h24m53.167152181s) [noise=true , address=104.36.82.6:4889     , piece_id=WIOCDHPKF7W7LDNEZLKIMAY7DLC3WSTHUGFYYQVN22VFIRP6R6HQ, seg_pos={0 0}, upload=99414]: Done uploading piece. err: <nil>
Aug 12 16:50:58.769636901 (95h24m53.200717032s) [noise=true , address=45.91.116.8:4064     , piece_id=GTVDBE5DCFNMMK2HHUXXR6AHC6GUISL4ZN7VQY5B3BI35APD7FPA, seg_pos={0 0}, upload=99414]: Done uploading piece. err: <nil>
Aug 12 16:50:58.799465453 (95h24m53.230545584s) [noise=true , address=104.36.82.5:4843     , piece_id=XR3YA2NRMC7E2Y62FBEN3H6BPV4XHYYRSJWDAJXWH77HWIZWOGKQ, seg_pos={0 0}, upload=99414]: Done uploading piece. err: <nil>
Aug 12 16:50:58.801049604 (95h24m53.232129735s) [noise=true , address=104.36.82.59:4306    , piece_id=ZIOXDRF6XLJYQWVXC55D4DRNYPNZYMED4YIZOLINOUQ6AWY5GXQQ, seg_pos={0 0}, upload=99414]: Done uploading piece. err: <nil>
Aug 12 16:50:58.826716083 (95h24m53.257796214s) [noise=true , address=104.36.82.4:4833     , piece_id=SNUEZ7QAZN6KBAJQMSDXUKI4S3RSZIZJVBPR5G5YZP3VN2RSAG6Q, seg_pos={0 0}, upload=99414]: Done uploading piece. err: <nil>
Aug 12 16:50:58.827341539 (95h24m53.25842166s) [noise=true , address=104.36.82.16:4307    , piece_id=65QC6LVYZEZGJN7RLNTMXEIXPLKPLUFJD72TGSVFNFN74FZGHXGQ, seg_pos={0 0}, upload=99414]: Done uploading piece. err: <nil>
Aug 12 16:50:58.842517536 (95h24m53.273597668s) [noise=true , address=45.91.116.7:4026     , piece_id=FC2PMDJCQG7ZSRVBUZIKLSA4DBIFP4WEG3D7MJS2I27QZPVVUYBQ, seg_pos={0 0}, upload=99414]: Done uploading piece. err: <nil>
Aug 12 16:50:58.906830299 (95h24m53.33791043s) [noise=true , address=104.36.82.23:4453    , piece_id=YIAUALSNQQUHHEMRETPFHX3UTOGH72TFUILK4LZXAWWWACSCBLTA, seg_pos={0 0}, upload=99414]: Done uploading piece. err: <nil>
Aug 12 16:50:58.911858931 (95h24m53.342939052s) [noise=true , address=104.36.82.11:4129    , piece_id=6G7JK2EV7SUZSQX6RKALRPSHSYQOJCPEUQSUVTSPF2LBWYYPZF6Q, seg_pos={0 0}, upload=99414]: Done uploading piece. err: <nil>
Aug 12 16:50:58.991869960 (95h24m53.422950091s) [noise=true , address=104.36.82.62:4441    , piece_id=TI7HJMXSGBFWZPDLDY6GKW73ZGIPICPKZ5C7DFXRQLJMVSAOXQVQ, seg_pos={0 0}, upload=99414]: Done uploading piece. err: <nil>
Aug 12 16:50:59.023484369 (95h24m53.4545645s) [noise=true , address=104.36.82.17:4337    , piece_id=2WXVQL5YG3VUO6LALBL3KJ5PHPGI6EDHLN7G7LOITNJ3O4KL2K5Q, seg_pos={0 0}, upload=99414]: Done uploading piece. err: <nil>
Aug 12 16:50:59.023509096 (95h24m53.454589227s) [seg_pos={0 0}, upload=99414]: Segment reached optimal threshold of 14 pieces.
Aug 12 16:50:59.023628054 (95h24m53.454708186s) [noise=true , address=79.127.219.38:4034   , piece_id=COHYXZ6EPUBNAYRJTAQBCMVICXKLE32OAVD4VNPJVWSMRBN2UONA, seg_pos={0 0}, upload=99414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18ZAwnyCoAZozc5f18LwC3SbzW96kT1qW5oxnCyYEZwZpRoGxJ): protocol: expected piece hash; context canceled; EOF
Aug 12 16:50:59.023700783 (95h24m53.454780904s) [noise=true , address=104.36.82.8:4982     , piece_id=NSX43CJ3WG4HG4WXNUWWRRU5Z6JZZFFIY2LOKZRRWRT554N2TGLQ, seg_pos={0 0}, upload=99414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EBpouVrJJDho24tucF5w43aFMqjeMviU3VoRCoL2b2Ho8WNU): protocol: expected piece hash; context canceled; EOF
Aug 12 16:50:59.023716614 (95h24m53.454796745s) [noise=true , address=104.36.82.60:4342    , piece_id=JLBQYZ7ETQBJ7RMVOS5QFCUAFKOFYRAGVZOOP5SQGIZOA2SFM6GA, seg_pos={0 0}, upload=99414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF
Aug 12 16:50:59.023779844 (95h24m53.454859975s) [noise=true , address=104.36.82.35:4608    , piece_id=YNRJ6YYAHIFJDSWJBU54DVD5BIZATIP6AJLJMQM46KNTRIQY4ZLQ, seg_pos={0 0}, upload=99414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orioD7aiZFeKv757scT1HRMFVpHiUufNSk2XpEP8mW4KNPwMg): protocol: expected piece hash; context canceled; EOF
Aug 12 16:50:59.023795725 (95h24m53.454875846s) [seg_pos={0 0}, upload=99414]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 16:50:59.023855259 (95h24m53.45493539s) [upload=99414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:50:59.023859236 (95h24m53.454939367s) [upload=99414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:50:59.905835934 (95h24m54.336916065s) [upload=99414]: Done uploading segments...
Aug 12 16:50:59.905860090 (95h24m54.336940221s) [upload=99414]: Upload finished. err: <nil>
Duration: 6.521551758s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)
antiblip:
4 out of 60 is failed (threshold=3) [.......................X.X...X.............................X]
duration:
4.725118655s
FAIL (2025-08-12 16:51:00 UTC)
orbiter warning: 
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 12 16:50:56.296083714 (95h24m50.727163845s) [upload=99414]: Starting upload
Aug 12 16:50:56.296133259 (95h24m50.72721339s) [upload=99414]: Done starting upload
Aug 12 16:50:56.296238100 (95h24m50.727318271s) [upload=99414]: Uploading segments...
Aug 12 16:50:56.296332931 (95h24m50.727413062s) [upload=99414]: Got next segment. Inline: false
Aug 12 16:50:56.296369691 (95h24m50.727449822s) [upload=99414]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 12 16:50:56.296374040 (95h24m50.727454171s) [upload=99414]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 12 16:50:56.744593149 (95h24m51.17567328s) [seg_pos={0 0}, upload=99414]: Begin upload segment...
Aug 12 16:50:56.744641170 (95h24m51.175721301s) [seg_pos={0 0}, upload=99414]: Done begin upload segment.
Aug 12 16:50:56.744679764 (95h24m51.175759895s) [noise=true , address=104.36.82.11:4129    , piece_id=6G7JK2EV7SUZSQX6RKALRPSHSYQOJCPEUQSUVTSPF2LBWYYPZF6Q, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.744693380 (95h24m51.175773521s) [noise=true , address=104.36.82.17:4337    , piece_id=2WXVQL5YG3VUO6LALBL3KJ5PHPGI6EDHLN7G7LOITNJ3O4KL2K5Q, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.745073026 (95h24m51.176153157s) [noise=true , address=104.36.82.23:4453    , piece_id=YIAUALSNQQUHHEMRETPFHX3UTOGH72TFUILK4LZXAWWWACSCBLTA, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.745179590 (95h24m51.176259711s) [noise=true , address=104.36.82.8:4982     , piece_id=NSX43CJ3WG4HG4WXNUWWRRU5Z6JZZFFIY2LOKZRRWRT554N2TGLQ, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.745354795 (95h24m51.176434926s) [noise=true , address=104.36.82.16:4307    , piece_id=65QC6LVYZEZGJN7RLNTMXEIXPLKPLUFJD72TGSVFNFN74FZGHXGQ, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.745451942 (95h24m51.176532073s) [noise=true , address=104.36.82.62:4441    , piece_id=TI7HJMXSGBFWZPDLDY6GKW73ZGIPICPKZ5C7DFXRQLJMVSAOXQVQ, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.745629060 (95h24m51.176709191s) [noise=true , address=104.36.82.5:4843     , piece_id=XR3YA2NRMC7E2Y62FBEN3H6BPV4XHYYRSJWDAJXWH77HWIZWOGKQ, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.745696500 (95h24m51.176776631s) [noise=true , address=104.36.82.4:4833     , piece_id=SNUEZ7QAZN6KBAJQMSDXUKI4S3RSZIZJVBPR5G5YZP3VN2RSAG6Q, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.745912433 (95h24m51.176992564s) [noise=true , address=104.36.82.18:4377    , piece_id=OHK345LD473E2I525O6DDAW3ZDYEKOCEOT3TS44PRDXEAAHKD5NA, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.745937110 (95h24m51.177017231s) [noise=true , address=104.36.82.47:4529    , piece_id=DA5NO2BFHTG6QY5SAILHS2RD2FFBNWEBPKRKKYZWSKOR5R4UFZCQ, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.746153123 (95h24m51.177233254s) [noise=true , address=45.91.116.7:4026     , piece_id=FC2PMDJCQG7ZSRVBUZIKLSA4DBIFP4WEG3D7MJS2I27QZPVVUYBQ, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.746158774 (95h24m51.177238895s) [noise=true , address=104.36.82.35:4608    , piece_id=YNRJ6YYAHIFJDSWJBU54DVD5BIZATIP6AJLJMQM46KNTRIQY4ZLQ, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.746369857 (95h24m51.177449989s) [noise=true , address=104.36.82.59:4306    , piece_id=ZIOXDRF6XLJYQWVXC55D4DRNYPNZYMED4YIZOLINOUQ6AWY5GXQQ, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.746399404 (95h24m51.177479525s) [noise=true , address=79.127.219.38:4034   , piece_id=COHYXZ6EPUBNAYRJTAQBCMVICXKLE32OAVD4VNPJVWSMRBN2UONA, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.746584208 (95h24m51.177664339s) [noise=true , address=104.36.82.37:4673    , piece_id=523WCZNOTIMHF5M2D3KWWJX3OEOO6L7CHSPZEU456N3EBUBUPVZQ, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.746766417 (95h24m51.177846548s) [noise=true , address=45.91.116.8:4064     , piece_id=GTVDBE5DCFNMMK2HHUXXR6AHC6GUISL4ZN7VQY5B3BI35APD7FPA, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.746966620 (95h24m51.178046751s) [noise=true , address=104.36.82.60:4342    , piece_id=JLBQYZ7ETQBJ7RMVOS5QFCUAFKOFYRAGVZOOP5SQGIZOA2SFM6GA, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:56.749185405 (95h24m51.180265536s) [noise=true , address=104.36.82.6:4889     , piece_id=WIOCDHPKF7W7LDNEZLKIMAY7DLC3WSTHUGFYYQVN22VFIRP6R6HQ, seg_pos={0 0}, upload=99414]: Uploading piece...
Aug 12 16:50:58.288780044 (95h24m52.719860175s) [upload=99414]: Next returned nil segment
Aug 12 16:50:58.288798188 (95h24m52.719878309s) [upload=99414]: Waiting for error group managing segments...
Aug 12 16:50:58.695213904 (95h24m53.126294025s) [noise=true , address=104.36.82.47:4529    , piece_id=DA5NO2BFHTG6QY5SAILHS2RD2FFBNWEBPKRKKYZWSKOR5R4UFZCQ, seg_pos={0 0}, upload=99414]: Done uploading piece. err: <nil>
Aug 12 16:50:58.713211970 (95h24m53.144292101s) [noise=true , address=104.36.82.18:4377    , piece_id=OHK345LD473E2I525O6DDAW3ZDYEKOCEOT3TS44PRDXEAAHKD5NA, seg_pos={0 0}, upload=99414]: Done uploading piece. err: <nil>
Aug 12 16:50:58.731814313 (95h24m53.162894444s) [noise=true , address=104.36.82.37:4673    , piece_id=523WCZNOTIMHF5M2D3KWWJX3OEOO6L7CHSPZEU456N3EBUBUPVZQ, seg_pos={0 0}, upload=99414]: Done uploading piece. err: <nil>
Aug 12 16:50:58.736072060 (95h24m53.167152181s) [noise=true , address=104.36.82.6:4889     , piece_id=WIOCDHPKF7W7LDNEZLKIMAY7DLC3WSTHUGFYYQVN22VFIRP6R6HQ, seg_pos={0 0}, upload=99414]: Done uploading piece. err: <nil>
Aug 12 16:50:58.769636901 (95h24m53.200717032s) [noise=true , address=45.91.116.8:4064     , piece_id=GTVDBE5DCFNMMK2HHUXXR6AHC6GUISL4ZN7VQY5B3BI35APD7FPA, seg_pos={0 0}, upload=99414]: Done uploading piece. err: <nil>
Aug 12 16:50:58.799465453 (95h24m53.230545584s) [noise=true , address=104.36.82.5:4843     , piece_id=XR3YA2NRMC7E2Y62FBEN3H6BPV4XHYYRSJWDAJXWH77HWIZWOGKQ, seg_pos={0 0}, upload=99414]: Done uploading piece. err: <nil>
Aug 12 16:50:58.801049604 (95h24m53.232129735s) [noise=true , address=104.36.82.59:4306    , piece_id=ZIOXDRF6XLJYQWVXC55D4DRNYPNZYMED4YIZOLINOUQ6AWY5GXQQ, seg_pos={0 0}, upload=99414]: Done uploading piece. err: <nil>
Aug 12 16:50:58.826716083 (95h24m53.257796214s) [noise=true , address=104.36.82.4:4833     , piece_id=SNUEZ7QAZN6KBAJQMSDXUKI4S3RSZIZJVBPR5G5YZP3VN2RSAG6Q, seg_pos={0 0}, upload=99414]: Done uploading piece. err: <nil>
Aug 12 16:50:58.827341539 (95h24m53.25842166s) [noise=true , address=104.36.82.16:4307    , piece_id=65QC6LVYZEZGJN7RLNTMXEIXPLKPLUFJD72TGSVFNFN74FZGHXGQ, seg_pos={0 0}, upload=99414]: Done uploading piece. err: <nil>
Aug 12 16:50:58.842517536 (95h24m53.273597668s) [noise=true , address=45.91.116.7:4026     , piece_id=FC2PMDJCQG7ZSRVBUZIKLSA4DBIFP4WEG3D7MJS2I27QZPVVUYBQ, seg_pos={0 0}, upload=99414]: Done uploading piece. err: <nil>
Aug 12 16:50:58.906830299 (95h24m53.33791043s) [noise=true , address=104.36.82.23:4453    , piece_id=YIAUALSNQQUHHEMRETPFHX3UTOGH72TFUILK4LZXAWWWACSCBLTA, seg_pos={0 0}, upload=99414]: Done uploading piece. err: <nil>
Aug 12 16:50:58.911858931 (95h24m53.342939052s) [noise=true , address=104.36.82.11:4129    , piece_id=6G7JK2EV7SUZSQX6RKALRPSHSYQOJCPEUQSUVTSPF2LBWYYPZF6Q, seg_pos={0 0}, upload=99414]: Done uploading piece. err: <nil>
Aug 12 16:50:58.991869960 (95h24m53.422950091s) [noise=true , address=104.36.82.62:4441    , piece_id=TI7HJMXSGBFWZPDLDY6GKW73ZGIPICPKZ5C7DFXRQLJMVSAOXQVQ, seg_pos={0 0}, upload=99414]: Done uploading piece. err: <nil>
Aug 12 16:50:59.023484369 (95h24m53.4545645s) [noise=true , address=104.36.82.17:4337    , piece_id=2WXVQL5YG3VUO6LALBL3KJ5PHPGI6EDHLN7G7LOITNJ3O4KL2K5Q, seg_pos={0 0}, upload=99414]: Done uploading piece. err: <nil>
Aug 12 16:50:59.023509096 (95h24m53.454589227s) [seg_pos={0 0}, upload=99414]: Segment reached optimal threshold of 14 pieces.
Aug 12 16:50:59.023628054 (95h24m53.454708186s) [noise=true , address=79.127.219.38:4034   , piece_id=COHYXZ6EPUBNAYRJTAQBCMVICXKLE32OAVD4VNPJVWSMRBN2UONA, seg_pos={0 0}, upload=99414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18ZAwnyCoAZozc5f18LwC3SbzW96kT1qW5oxnCyYEZwZpRoGxJ): protocol: expected piece hash; context canceled; EOF
Aug 12 16:50:59.023700783 (95h24m53.454780904s) [noise=true , address=104.36.82.8:4982     , piece_id=NSX43CJ3WG4HG4WXNUWWRRU5Z6JZZFFIY2LOKZRRWRT554N2TGLQ, seg_pos={0 0}, upload=99414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:17EBpouVrJJDho24tucF5w43aFMqjeMviU3VoRCoL2b2Ho8WNU): protocol: expected piece hash; context canceled; EOF
Aug 12 16:50:59.023716614 (95h24m53.454796745s) [noise=true , address=104.36.82.60:4342    , piece_id=JLBQYZ7ETQBJ7RMVOS5QFCUAFKOFYRAGVZOOP5SQGIZOA2SFM6GA, seg_pos={0 0}, upload=99414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pYxAYKuf8jtEBtsH5cvx8hmTfqrMv5Z4c6taF9hVgRDmx8KoB): protocol: expected piece hash; context canceled; EOF
Aug 12 16:50:59.023779844 (95h24m53.454859975s) [noise=true , address=104.36.82.35:4608    , piece_id=YNRJ6YYAHIFJDSWJBU54DVD5BIZATIP6AJLJMQM46KNTRIQY4ZLQ, seg_pos={0 0}, upload=99414]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12orioD7aiZFeKv757scT1HRMFVpHiUufNSk2XpEP8mW4KNPwMg): protocol: expected piece hash; context canceled; EOF
Aug 12 16:50:59.023795725 (95h24m53.454875846s) [seg_pos={0 0}, upload=99414]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 12 16:50:59.023855259 (95h24m53.45493539s) [upload=99414]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 12 16:50:59.023859236 (95h24m53.454939367s) [upload=99414]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 12 16:50:59.905835934 (95h24m54.336916065s) [upload=99414]: Done uploading segments...
Aug 12 16:50:59.905860090 (95h24m54.336940221s) [upload=99414]: Upload finished. err: <nil>
Duration: 4.725147071s core uplink us-select-1 us1-placement-20 metainfo-projects