Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.827433929s trace: https://jaeger.dev.storj.io/trace/64a70b063120f6ff FAIL (2025-12-24 17:50:07 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 24 17:41:34.817232055 (458h12m34.68831509s) [upload=402229]: Starting upload Dec 24 17:41:34.817285716 (458h12m34.688368751s) [upload=402229]: Done starting upload Dec 24 17:41:34.817371771 (458h12m34.688454806s) [upload=402229]: Uploading segments... Dec 24 17:41:34.817473855 (458h12m34.68855689s) [upload=402229]: Got next segment. Inline: false Dec 24 17:41:34.817508080 (458h12m34.688591115s) [upload=402229]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 24 17:41:34.817512659 (458h12m34.688595694s) [upload=402229]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 24 17:41:35.067154038 (458h12m34.938237083s) [seg_pos={0 0}, upload=402229]: Begin upload segment... Dec 24 17:41:35.067209534 (458h12m34.938292579s) [seg_pos={0 0}, upload=402229]: Done begin upload segment. Dec 24 17:41:35.067237456 (458h12m34.938320491s) [noise=true , address=145.79.227.45:4231 , piece_id=O2RJOW4SBW2XC3PJ5XJ5NLPCTUZXQQBYZDGOBX3YZTW6FDVTOFMA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.067270990 (458h12m34.938354025s) [noise=true , address=145.79.227.51:4411 , piece_id=3RKCEBKZSY2MSVPVE7CBSF32WX7APWEIGNX6QRZ6KEN3NYGIMBCQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.067737579 (458h12m34.938820624s) [noise=true , address=145.79.227.37:4566 , piece_id=JMK6ZS4UFM3ETIID532YYHTAO2CIYHEJBEU4Z3LLT32J6QL5VY5A, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068069410 (458h12m34.939152455s) [noise=true , address=145.79.227.11:4730 , piece_id=BNYY6GVOVFYX6YSQR7F23ASYKM5SJWHGK5NQIYTDMO3SGIXU6TNQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068471236 (458h12m34.939554281s) [noise=true , address=145.79.227.32:4834 , piece_id=OI4HEZS66F5LGW33SYDOAD4CDE47KP3MZ3C53BLTJWTV7D6AYK6Q, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068826392 (458h12m34.939909437s) [noise=true , address=145.79.227.29:4941 , piece_id=T3QBPFJWPSOCGUJ6C4RC3YGRTTVIDHCUKKL6GYAJRNREPIUM2OCA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069118318 (458h12m34.940201353s) [noise=true , address=145.79.227.4:4187 , piece_id=IAJZIMUQQETQWLVZX6J2UU6RBBHHL5IZNOEBRLV5ZDE6A5MOPEYQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069520844 (458h12m34.94060389s) [noise=true , address=45.91.116.11:4117 , piece_id=IMHTEB3WAFAO6554DFSOVOLTOIU65TI6KQSBEJNVP4W3M6STQYDA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069964640 (458h12m34.941047675s) [noise=true , address=145.79.227.49:4339 , piece_id=HBGK2U2V2OIPYUOBXJPV7O7FCP2TB2MAB44WRQSO4R7FYOHV3ROA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.070342990 (458h12m34.941426035s) [noise=true , address=145.79.227.7:4294 , piece_id=RAWBIZM3YPIHZ64SK7KXOXTL4GPVK3JGRGDINJN57USLVX53T6TA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.071430701 (458h12m34.942513736s) [noise=true , address=45.91.116.14:4191 , piece_id=PZSZV2XFKZOJ5W5HP22PWW776L4ATWJZBEEQTJV6JEHYSIKBS35Q, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.071491077 (458h12m34.942574112s) [noise=true , address=145.79.227.50:4374 , piece_id=MA5VLFQAK6U245SGQR5UODBBIQD7CPICYCYTM5SL3GMCLXURWZ7A, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.072542138 (458h12m34.943625183s) [noise=true , address=145.79.227.52:4446 , piece_id=NJF5KORJX4IZ2VFF3I7GTKELUFDRCZMZK2GZOUNFPURAPUDT47YQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.072669880 (458h12m34.943752925s) [noise=true , address=145.79.227.33:4869 , piece_id=VVRKB2PIP4RRW4DZ3OA67MRRVCKPTACQPY633LHHLLZBUNVPKJGQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.073725251 (458h12m34.944808286s) [noise=true , address=145.79.227.38:4979 , piece_id=3SSLNJ545M7DSFJWO2V7K4AOQMXIXQUAXOAOQIX6NP757T22VWGA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.075362869 (458h12m34.946445904s) [noise=true , address=145.79.227.46:4603 , piece_id=ILEBQVEFNXVBYTGLFBMG4BRO3HNAJ5GYPH53IQF2V7RRSOLHFIQQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:36.870712973 (458h12m36.741796018s) [upload=402229]: Next returned nil segment Dec 24 17:41:36.870729545 (458h12m36.74181258s) [upload=402229]: Waiting for error group managing segments... Dec 24 17:41:37.160017607 (458h12m37.031100642s) [noise=true , address=145.79.227.32:4834 , piece_id=OI4HEZS66F5LGW33SYDOAD4CDE47KP3MZ3C53BLTJWTV7D6AYK6Q, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.172949711 (458h12m37.044032757s) [noise=true , address=145.79.227.45:4231 , piece_id=O2RJOW4SBW2XC3PJ5XJ5NLPCTUZXQQBYZDGOBX3YZTW6FDVTOFMA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.183665827 (458h12m37.054748862s) [noise=true , address=145.79.227.50:4374 , piece_id=MA5VLFQAK6U245SGQR5UODBBIQD7CPICYCYTM5SL3GMCLXURWZ7A, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.245183227 (458h12m37.116266262s) [noise=true , address=145.79.227.7:4294 , piece_id=RAWBIZM3YPIHZ64SK7KXOXTL4GPVK3JGRGDINJN57USLVX53T6TA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.324356015 (458h12m37.19543905s) [noise=true , address=45.91.116.14:4191 , piece_id=PZSZV2XFKZOJ5W5HP22PWW776L4ATWJZBEEQTJV6JEHYSIKBS35Q, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.442771707 (458h12m37.313854752s) [noise=true , address=45.91.116.11:4117 , piece_id=IMHTEB3WAFAO6554DFSOVOLTOIU65TI6KQSBEJNVP4W3M6STQYDA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.478430989 (458h12m37.349514054s) [noise=true , address=145.79.227.51:4411 , piece_id=3RKCEBKZSY2MSVPVE7CBSF32WX7APWEIGNX6QRZ6KEN3NYGIMBCQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.926537889 (458h12m37.797620924s) [noise=true , address=145.79.227.33:4869 , piece_id=VVRKB2PIP4RRW4DZ3OA67MRRVCKPTACQPY633LHHLLZBUNVPKJGQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.187478223 (458h12m38.058561268s) [noise=true , address=145.79.227.52:4446 , piece_id=NJF5KORJX4IZ2VFF3I7GTKELUFDRCZMZK2GZOUNFPURAPUDT47YQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.189416954 (458h12m38.060499999s) [noise=true , address=145.79.227.46:4603 , piece_id=ILEBQVEFNXVBYTGLFBMG4BRO3HNAJ5GYPH53IQF2V7RRSOLHFIQQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.202496650 (458h12m38.073579685s) [noise=true , address=145.79.227.38:4979 , piece_id=3SSLNJ545M7DSFJWO2V7K4AOQMXIXQUAXOAOQIX6NP757T22VWGA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.237024437 (458h12m38.108107492s) [noise=true , address=145.79.227.4:4187 , piece_id=IAJZIMUQQETQWLVZX6J2UU6RBBHHL5IZNOEBRLV5ZDE6A5MOPEYQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:42:04.130206679 (458h13m4.001289724s) [noise=true , address=145.79.227.49:4339 , piece_id=HBGK2U2V2OIPYUOBXJPV7O7FCP2TB2MAB44WRQSO4R7FYOHV3ROA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection; write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection Dec 24 17:42:04.130319203 (458h13m4.001402248s) [noise=true , address=145.79.227.11:4730 , piece_id=BNYY6GVOVFYX6YSQR7F23ASYKM5SJWHGK5NQIYTDMO3SGIXU6TNQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection Dec 24 17:42:04.130411048 (458h13m4.001494083s) [noise=true , address=145.79.227.37:4566 , piece_id=JMK6ZS4UFM3ETIID532YYHTAO2CIYHEJBEU4Z3LLT32J6QL5VY5A, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:1SaNJZaVix7BSbEWhu2Vmt3XjDDWCsQ8wTSiFR7MQ8oGwD9N2F, address:145.79.227.37:4566): protocol: write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection; write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection Dec 24 17:42:04.130495238 (458h13m4.001578283s) [noise=true , address=145.79.227.29:4941 , piece_id=T3QBPFJWPSOCGUJ6C4RC3YGRTTVIDHCUKKL6GYAJRNREPIUM2OCA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:125fn3wMJUNjsKTgsssLJkZAobCbaAS9jC2VyxXxbUA2ei4Gjni, address:145.79.227.29:4941): protocol: write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection; write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection Dec 24 17:42:04.130522550 (458h13m4.001605595s) [seg_pos={0 0}, upload=402229]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 24 17:42:04.370980973 (458h13m4.242064028s) [upload=402229]: Done uploading segments... Dec 24 17:42:04.371031650 (458h13m4.242114695s) [upload=402229]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.827467733s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.975071338s trace: https://jaeger.dev.storj.io/trace/64a70b063120f6ff FAIL (2025-12-24 17:49:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 24 17:41:34.817232055 (458h12m34.68831509s) [upload=402229]: Starting upload Dec 24 17:41:34.817285716 (458h12m34.688368751s) [upload=402229]: Done starting upload Dec 24 17:41:34.817371771 (458h12m34.688454806s) [upload=402229]: Uploading segments... Dec 24 17:41:34.817473855 (458h12m34.68855689s) [upload=402229]: Got next segment. Inline: false Dec 24 17:41:34.817508080 (458h12m34.688591115s) [upload=402229]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 24 17:41:34.817512659 (458h12m34.688595694s) [upload=402229]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 24 17:41:35.067154038 (458h12m34.938237083s) [seg_pos={0 0}, upload=402229]: Begin upload segment... Dec 24 17:41:35.067209534 (458h12m34.938292579s) [seg_pos={0 0}, upload=402229]: Done begin upload segment. Dec 24 17:41:35.067237456 (458h12m34.938320491s) [noise=true , address=145.79.227.45:4231 , piece_id=O2RJOW4SBW2XC3PJ5XJ5NLPCTUZXQQBYZDGOBX3YZTW6FDVTOFMA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.067270990 (458h12m34.938354025s) [noise=true , address=145.79.227.51:4411 , piece_id=3RKCEBKZSY2MSVPVE7CBSF32WX7APWEIGNX6QRZ6KEN3NYGIMBCQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.067737579 (458h12m34.938820624s) [noise=true , address=145.79.227.37:4566 , piece_id=JMK6ZS4UFM3ETIID532YYHTAO2CIYHEJBEU4Z3LLT32J6QL5VY5A, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068069410 (458h12m34.939152455s) [noise=true , address=145.79.227.11:4730 , piece_id=BNYY6GVOVFYX6YSQR7F23ASYKM5SJWHGK5NQIYTDMO3SGIXU6TNQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068471236 (458h12m34.939554281s) [noise=true , address=145.79.227.32:4834 , piece_id=OI4HEZS66F5LGW33SYDOAD4CDE47KP3MZ3C53BLTJWTV7D6AYK6Q, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068826392 (458h12m34.939909437s) [noise=true , address=145.79.227.29:4941 , piece_id=T3QBPFJWPSOCGUJ6C4RC3YGRTTVIDHCUKKL6GYAJRNREPIUM2OCA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069118318 (458h12m34.940201353s) [noise=true , address=145.79.227.4:4187 , piece_id=IAJZIMUQQETQWLVZX6J2UU6RBBHHL5IZNOEBRLV5ZDE6A5MOPEYQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069520844 (458h12m34.94060389s) [noise=true , address=45.91.116.11:4117 , piece_id=IMHTEB3WAFAO6554DFSOVOLTOIU65TI6KQSBEJNVP4W3M6STQYDA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069964640 (458h12m34.941047675s) [noise=true , address=145.79.227.49:4339 , piece_id=HBGK2U2V2OIPYUOBXJPV7O7FCP2TB2MAB44WRQSO4R7FYOHV3ROA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.070342990 (458h12m34.941426035s) [noise=true , address=145.79.227.7:4294 , piece_id=RAWBIZM3YPIHZ64SK7KXOXTL4GPVK3JGRGDINJN57USLVX53T6TA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.071430701 (458h12m34.942513736s) [noise=true , address=45.91.116.14:4191 , piece_id=PZSZV2XFKZOJ5W5HP22PWW776L4ATWJZBEEQTJV6JEHYSIKBS35Q, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.071491077 (458h12m34.942574112s) [noise=true , address=145.79.227.50:4374 , piece_id=MA5VLFQAK6U245SGQR5UODBBIQD7CPICYCYTM5SL3GMCLXURWZ7A, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.072542138 (458h12m34.943625183s) [noise=true , address=145.79.227.52:4446 , piece_id=NJF5KORJX4IZ2VFF3I7GTKELUFDRCZMZK2GZOUNFPURAPUDT47YQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.072669880 (458h12m34.943752925s) [noise=true , address=145.79.227.33:4869 , piece_id=VVRKB2PIP4RRW4DZ3OA67MRRVCKPTACQPY633LHHLLZBUNVPKJGQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.073725251 (458h12m34.944808286s) [noise=true , address=145.79.227.38:4979 , piece_id=3SSLNJ545M7DSFJWO2V7K4AOQMXIXQUAXOAOQIX6NP757T22VWGA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.075362869 (458h12m34.946445904s) [noise=true , address=145.79.227.46:4603 , piece_id=ILEBQVEFNXVBYTGLFBMG4BRO3HNAJ5GYPH53IQF2V7RRSOLHFIQQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:36.870712973 (458h12m36.741796018s) [upload=402229]: Next returned nil segment Dec 24 17:41:36.870729545 (458h12m36.74181258s) [upload=402229]: Waiting for error group managing segments... Dec 24 17:41:37.160017607 (458h12m37.031100642s) [noise=true , address=145.79.227.32:4834 , piece_id=OI4HEZS66F5LGW33SYDOAD4CDE47KP3MZ3C53BLTJWTV7D6AYK6Q, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.172949711 (458h12m37.044032757s) [noise=true , address=145.79.227.45:4231 , piece_id=O2RJOW4SBW2XC3PJ5XJ5NLPCTUZXQQBYZDGOBX3YZTW6FDVTOFMA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.183665827 (458h12m37.054748862s) [noise=true , address=145.79.227.50:4374 , piece_id=MA5VLFQAK6U245SGQR5UODBBIQD7CPICYCYTM5SL3GMCLXURWZ7A, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.245183227 (458h12m37.116266262s) [noise=true , address=145.79.227.7:4294 , piece_id=RAWBIZM3YPIHZ64SK7KXOXTL4GPVK3JGRGDINJN57USLVX53T6TA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.324356015 (458h12m37.19543905s) [noise=true , address=45.91.116.14:4191 , piece_id=PZSZV2XFKZOJ5W5HP22PWW776L4ATWJZBEEQTJV6JEHYSIKBS35Q, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.442771707 (458h12m37.313854752s) [noise=true , address=45.91.116.11:4117 , piece_id=IMHTEB3WAFAO6554DFSOVOLTOIU65TI6KQSBEJNVP4W3M6STQYDA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.478430989 (458h12m37.349514054s) [noise=true , address=145.79.227.51:4411 , piece_id=3RKCEBKZSY2MSVPVE7CBSF32WX7APWEIGNX6QRZ6KEN3NYGIMBCQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.926537889 (458h12m37.797620924s) [noise=true , address=145.79.227.33:4869 , piece_id=VVRKB2PIP4RRW4DZ3OA67MRRVCKPTACQPY633LHHLLZBUNVPKJGQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.187478223 (458h12m38.058561268s) [noise=true , address=145.79.227.52:4446 , piece_id=NJF5KORJX4IZ2VFF3I7GTKELUFDRCZMZK2GZOUNFPURAPUDT47YQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.189416954 (458h12m38.060499999s) [noise=true , address=145.79.227.46:4603 , piece_id=ILEBQVEFNXVBYTGLFBMG4BRO3HNAJ5GYPH53IQF2V7RRSOLHFIQQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.202496650 (458h12m38.073579685s) [noise=true , address=145.79.227.38:4979 , piece_id=3SSLNJ545M7DSFJWO2V7K4AOQMXIXQUAXOAOQIX6NP757T22VWGA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.237024437 (458h12m38.108107492s) [noise=true , address=145.79.227.4:4187 , piece_id=IAJZIMUQQETQWLVZX6J2UU6RBBHHL5IZNOEBRLV5ZDE6A5MOPEYQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:42:04.130206679 (458h13m4.001289724s) [noise=true , address=145.79.227.49:4339 , piece_id=HBGK2U2V2OIPYUOBXJPV7O7FCP2TB2MAB44WRQSO4R7FYOHV3ROA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection; write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection Dec 24 17:42:04.130319203 (458h13m4.001402248s) [noise=true , address=145.79.227.11:4730 , piece_id=BNYY6GVOVFYX6YSQR7F23ASYKM5SJWHGK5NQIYTDMO3SGIXU6TNQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection Dec 24 17:42:04.130411048 (458h13m4.001494083s) [noise=true , address=145.79.227.37:4566 , piece_id=JMK6ZS4UFM3ETIID532YYHTAO2CIYHEJBEU4Z3LLT32J6QL5VY5A, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:1SaNJZaVix7BSbEWhu2Vmt3XjDDWCsQ8wTSiFR7MQ8oGwD9N2F, address:145.79.227.37:4566): protocol: write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection; write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection Dec 24 17:42:04.130495238 (458h13m4.001578283s) [noise=true , address=145.79.227.29:4941 , piece_id=T3QBPFJWPSOCGUJ6C4RC3YGRTTVIDHCUKKL6GYAJRNREPIUM2OCA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:125fn3wMJUNjsKTgsssLJkZAobCbaAS9jC2VyxXxbUA2ei4Gjni, address:145.79.227.29:4941): protocol: write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection; write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection Dec 24 17:42:04.130522550 (458h13m4.001605595s) [seg_pos={0 0}, upload=402229]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 24 17:42:04.370980973 (458h13m4.242064028s) [upload=402229]: Done uploading segments... Dec 24 17:42:04.371031650 (458h13m4.242114695s) [upload=402229]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.975098391s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 6.39732545s trace: https://jaeger.dev.storj.io/trace/64a70b063120f6ff FAIL (2025-12-24 17:48:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 24 17:41:34.817232055 (458h12m34.68831509s) [upload=402229]: Starting upload Dec 24 17:41:34.817285716 (458h12m34.688368751s) [upload=402229]: Done starting upload Dec 24 17:41:34.817371771 (458h12m34.688454806s) [upload=402229]: Uploading segments... Dec 24 17:41:34.817473855 (458h12m34.68855689s) [upload=402229]: Got next segment. Inline: false Dec 24 17:41:34.817508080 (458h12m34.688591115s) [upload=402229]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 24 17:41:34.817512659 (458h12m34.688595694s) [upload=402229]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 24 17:41:35.067154038 (458h12m34.938237083s) [seg_pos={0 0}, upload=402229]: Begin upload segment... Dec 24 17:41:35.067209534 (458h12m34.938292579s) [seg_pos={0 0}, upload=402229]: Done begin upload segment. Dec 24 17:41:35.067237456 (458h12m34.938320491s) [noise=true , address=145.79.227.45:4231 , piece_id=O2RJOW4SBW2XC3PJ5XJ5NLPCTUZXQQBYZDGOBX3YZTW6FDVTOFMA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.067270990 (458h12m34.938354025s) [noise=true , address=145.79.227.51:4411 , piece_id=3RKCEBKZSY2MSVPVE7CBSF32WX7APWEIGNX6QRZ6KEN3NYGIMBCQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.067737579 (458h12m34.938820624s) [noise=true , address=145.79.227.37:4566 , piece_id=JMK6ZS4UFM3ETIID532YYHTAO2CIYHEJBEU4Z3LLT32J6QL5VY5A, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068069410 (458h12m34.939152455s) [noise=true , address=145.79.227.11:4730 , piece_id=BNYY6GVOVFYX6YSQR7F23ASYKM5SJWHGK5NQIYTDMO3SGIXU6TNQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068471236 (458h12m34.939554281s) [noise=true , address=145.79.227.32:4834 , piece_id=OI4HEZS66F5LGW33SYDOAD4CDE47KP3MZ3C53BLTJWTV7D6AYK6Q, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068826392 (458h12m34.939909437s) [noise=true , address=145.79.227.29:4941 , piece_id=T3QBPFJWPSOCGUJ6C4RC3YGRTTVIDHCUKKL6GYAJRNREPIUM2OCA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069118318 (458h12m34.940201353s) [noise=true , address=145.79.227.4:4187 , piece_id=IAJZIMUQQETQWLVZX6J2UU6RBBHHL5IZNOEBRLV5ZDE6A5MOPEYQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069520844 (458h12m34.94060389s) [noise=true , address=45.91.116.11:4117 , piece_id=IMHTEB3WAFAO6554DFSOVOLTOIU65TI6KQSBEJNVP4W3M6STQYDA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069964640 (458h12m34.941047675s) [noise=true , address=145.79.227.49:4339 , piece_id=HBGK2U2V2OIPYUOBXJPV7O7FCP2TB2MAB44WRQSO4R7FYOHV3ROA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.070342990 (458h12m34.941426035s) [noise=true , address=145.79.227.7:4294 , piece_id=RAWBIZM3YPIHZ64SK7KXOXTL4GPVK3JGRGDINJN57USLVX53T6TA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.071430701 (458h12m34.942513736s) [noise=true , address=45.91.116.14:4191 , piece_id=PZSZV2XFKZOJ5W5HP22PWW776L4ATWJZBEEQTJV6JEHYSIKBS35Q, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.071491077 (458h12m34.942574112s) [noise=true , address=145.79.227.50:4374 , piece_id=MA5VLFQAK6U245SGQR5UODBBIQD7CPICYCYTM5SL3GMCLXURWZ7A, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.072542138 (458h12m34.943625183s) [noise=true , address=145.79.227.52:4446 , piece_id=NJF5KORJX4IZ2VFF3I7GTKELUFDRCZMZK2GZOUNFPURAPUDT47YQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.072669880 (458h12m34.943752925s) [noise=true , address=145.79.227.33:4869 , piece_id=VVRKB2PIP4RRW4DZ3OA67MRRVCKPTACQPY633LHHLLZBUNVPKJGQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.073725251 (458h12m34.944808286s) [noise=true , address=145.79.227.38:4979 , piece_id=3SSLNJ545M7DSFJWO2V7K4AOQMXIXQUAXOAOQIX6NP757T22VWGA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.075362869 (458h12m34.946445904s) [noise=true , address=145.79.227.46:4603 , piece_id=ILEBQVEFNXVBYTGLFBMG4BRO3HNAJ5GYPH53IQF2V7RRSOLHFIQQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:36.870712973 (458h12m36.741796018s) [upload=402229]: Next returned nil segment Dec 24 17:41:36.870729545 (458h12m36.74181258s) [upload=402229]: Waiting for error group managing segments... Dec 24 17:41:37.160017607 (458h12m37.031100642s) [noise=true , address=145.79.227.32:4834 , piece_id=OI4HEZS66F5LGW33SYDOAD4CDE47KP3MZ3C53BLTJWTV7D6AYK6Q, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.172949711 (458h12m37.044032757s) [noise=true , address=145.79.227.45:4231 , piece_id=O2RJOW4SBW2XC3PJ5XJ5NLPCTUZXQQBYZDGOBX3YZTW6FDVTOFMA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.183665827 (458h12m37.054748862s) [noise=true , address=145.79.227.50:4374 , piece_id=MA5VLFQAK6U245SGQR5UODBBIQD7CPICYCYTM5SL3GMCLXURWZ7A, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.245183227 (458h12m37.116266262s) [noise=true , address=145.79.227.7:4294 , piece_id=RAWBIZM3YPIHZ64SK7KXOXTL4GPVK3JGRGDINJN57USLVX53T6TA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.324356015 (458h12m37.19543905s) [noise=true , address=45.91.116.14:4191 , piece_id=PZSZV2XFKZOJ5W5HP22PWW776L4ATWJZBEEQTJV6JEHYSIKBS35Q, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.442771707 (458h12m37.313854752s) [noise=true , address=45.91.116.11:4117 , piece_id=IMHTEB3WAFAO6554DFSOVOLTOIU65TI6KQSBEJNVP4W3M6STQYDA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.478430989 (458h12m37.349514054s) [noise=true , address=145.79.227.51:4411 , piece_id=3RKCEBKZSY2MSVPVE7CBSF32WX7APWEIGNX6QRZ6KEN3NYGIMBCQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.926537889 (458h12m37.797620924s) [noise=true , address=145.79.227.33:4869 , piece_id=VVRKB2PIP4RRW4DZ3OA67MRRVCKPTACQPY633LHHLLZBUNVPKJGQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.187478223 (458h12m38.058561268s) [noise=true , address=145.79.227.52:4446 , piece_id=NJF5KORJX4IZ2VFF3I7GTKELUFDRCZMZK2GZOUNFPURAPUDT47YQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.189416954 (458h12m38.060499999s) [noise=true , address=145.79.227.46:4603 , piece_id=ILEBQVEFNXVBYTGLFBMG4BRO3HNAJ5GYPH53IQF2V7RRSOLHFIQQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.202496650 (458h12m38.073579685s) [noise=true , address=145.79.227.38:4979 , piece_id=3SSLNJ545M7DSFJWO2V7K4AOQMXIXQUAXOAOQIX6NP757T22VWGA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.237024437 (458h12m38.108107492s) [noise=true , address=145.79.227.4:4187 , piece_id=IAJZIMUQQETQWLVZX6J2UU6RBBHHL5IZNOEBRLV5ZDE6A5MOPEYQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:42:04.130206679 (458h13m4.001289724s) [noise=true , address=145.79.227.49:4339 , piece_id=HBGK2U2V2OIPYUOBXJPV7O7FCP2TB2MAB44WRQSO4R7FYOHV3ROA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection; write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection Dec 24 17:42:04.130319203 (458h13m4.001402248s) [noise=true , address=145.79.227.11:4730 , piece_id=BNYY6GVOVFYX6YSQR7F23ASYKM5SJWHGK5NQIYTDMO3SGIXU6TNQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection Dec 24 17:42:04.130411048 (458h13m4.001494083s) [noise=true , address=145.79.227.37:4566 , piece_id=JMK6ZS4UFM3ETIID532YYHTAO2CIYHEJBEU4Z3LLT32J6QL5VY5A, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:1SaNJZaVix7BSbEWhu2Vmt3XjDDWCsQ8wTSiFR7MQ8oGwD9N2F, address:145.79.227.37:4566): protocol: write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection; write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection Dec 24 17:42:04.130495238 (458h13m4.001578283s) [noise=true , address=145.79.227.29:4941 , piece_id=T3QBPFJWPSOCGUJ6C4RC3YGRTTVIDHCUKKL6GYAJRNREPIUM2OCA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:125fn3wMJUNjsKTgsssLJkZAobCbaAS9jC2VyxXxbUA2ei4Gjni, address:145.79.227.29:4941): protocol: write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection; write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection Dec 24 17:42:04.130522550 (458h13m4.001605595s) [seg_pos={0 0}, upload=402229]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 24 17:42:04.370980973 (458h13m4.242064028s) [upload=402229]: Done uploading segments... Dec 24 17:42:04.371031650 (458h13m4.242114695s) [upload=402229]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.397358172s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.763474041s trace: https://jaeger.dev.storj.io/trace/64a70b063120f6ff FAIL (2025-12-24 17:47:16 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 24 17:41:34.817232055 (458h12m34.68831509s) [upload=402229]: Starting upload Dec 24 17:41:34.817285716 (458h12m34.688368751s) [upload=402229]: Done starting upload Dec 24 17:41:34.817371771 (458h12m34.688454806s) [upload=402229]: Uploading segments... Dec 24 17:41:34.817473855 (458h12m34.68855689s) [upload=402229]: Got next segment. Inline: false Dec 24 17:41:34.817508080 (458h12m34.688591115s) [upload=402229]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 24 17:41:34.817512659 (458h12m34.688595694s) [upload=402229]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 24 17:41:35.067154038 (458h12m34.938237083s) [seg_pos={0 0}, upload=402229]: Begin upload segment... Dec 24 17:41:35.067209534 (458h12m34.938292579s) [seg_pos={0 0}, upload=402229]: Done begin upload segment. Dec 24 17:41:35.067237456 (458h12m34.938320491s) [noise=true , address=145.79.227.45:4231 , piece_id=O2RJOW4SBW2XC3PJ5XJ5NLPCTUZXQQBYZDGOBX3YZTW6FDVTOFMA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.067270990 (458h12m34.938354025s) [noise=true , address=145.79.227.51:4411 , piece_id=3RKCEBKZSY2MSVPVE7CBSF32WX7APWEIGNX6QRZ6KEN3NYGIMBCQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.067737579 (458h12m34.938820624s) [noise=true , address=145.79.227.37:4566 , piece_id=JMK6ZS4UFM3ETIID532YYHTAO2CIYHEJBEU4Z3LLT32J6QL5VY5A, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068069410 (458h12m34.939152455s) [noise=true , address=145.79.227.11:4730 , piece_id=BNYY6GVOVFYX6YSQR7F23ASYKM5SJWHGK5NQIYTDMO3SGIXU6TNQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068471236 (458h12m34.939554281s) [noise=true , address=145.79.227.32:4834 , piece_id=OI4HEZS66F5LGW33SYDOAD4CDE47KP3MZ3C53BLTJWTV7D6AYK6Q, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068826392 (458h12m34.939909437s) [noise=true , address=145.79.227.29:4941 , piece_id=T3QBPFJWPSOCGUJ6C4RC3YGRTTVIDHCUKKL6GYAJRNREPIUM2OCA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069118318 (458h12m34.940201353s) [noise=true , address=145.79.227.4:4187 , piece_id=IAJZIMUQQETQWLVZX6J2UU6RBBHHL5IZNOEBRLV5ZDE6A5MOPEYQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069520844 (458h12m34.94060389s) [noise=true , address=45.91.116.11:4117 , piece_id=IMHTEB3WAFAO6554DFSOVOLTOIU65TI6KQSBEJNVP4W3M6STQYDA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069964640 (458h12m34.941047675s) [noise=true , address=145.79.227.49:4339 , piece_id=HBGK2U2V2OIPYUOBXJPV7O7FCP2TB2MAB44WRQSO4R7FYOHV3ROA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.070342990 (458h12m34.941426035s) [noise=true , address=145.79.227.7:4294 , piece_id=RAWBIZM3YPIHZ64SK7KXOXTL4GPVK3JGRGDINJN57USLVX53T6TA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.071430701 (458h12m34.942513736s) [noise=true , address=45.91.116.14:4191 , piece_id=PZSZV2XFKZOJ5W5HP22PWW776L4ATWJZBEEQTJV6JEHYSIKBS35Q, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.071491077 (458h12m34.942574112s) [noise=true , address=145.79.227.50:4374 , piece_id=MA5VLFQAK6U245SGQR5UODBBIQD7CPICYCYTM5SL3GMCLXURWZ7A, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.072542138 (458h12m34.943625183s) [noise=true , address=145.79.227.52:4446 , piece_id=NJF5KORJX4IZ2VFF3I7GTKELUFDRCZMZK2GZOUNFPURAPUDT47YQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.072669880 (458h12m34.943752925s) [noise=true , address=145.79.227.33:4869 , piece_id=VVRKB2PIP4RRW4DZ3OA67MRRVCKPTACQPY633LHHLLZBUNVPKJGQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.073725251 (458h12m34.944808286s) [noise=true , address=145.79.227.38:4979 , piece_id=3SSLNJ545M7DSFJWO2V7K4AOQMXIXQUAXOAOQIX6NP757T22VWGA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.075362869 (458h12m34.946445904s) [noise=true , address=145.79.227.46:4603 , piece_id=ILEBQVEFNXVBYTGLFBMG4BRO3HNAJ5GYPH53IQF2V7RRSOLHFIQQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:36.870712973 (458h12m36.741796018s) [upload=402229]: Next returned nil segment Dec 24 17:41:36.870729545 (458h12m36.74181258s) [upload=402229]: Waiting for error group managing segments... Dec 24 17:41:37.160017607 (458h12m37.031100642s) [noise=true , address=145.79.227.32:4834 , piece_id=OI4HEZS66F5LGW33SYDOAD4CDE47KP3MZ3C53BLTJWTV7D6AYK6Q, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.172949711 (458h12m37.044032757s) [noise=true , address=145.79.227.45:4231 , piece_id=O2RJOW4SBW2XC3PJ5XJ5NLPCTUZXQQBYZDGOBX3YZTW6FDVTOFMA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.183665827 (458h12m37.054748862s) [noise=true , address=145.79.227.50:4374 , piece_id=MA5VLFQAK6U245SGQR5UODBBIQD7CPICYCYTM5SL3GMCLXURWZ7A, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.245183227 (458h12m37.116266262s) [noise=true , address=145.79.227.7:4294 , piece_id=RAWBIZM3YPIHZ64SK7KXOXTL4GPVK3JGRGDINJN57USLVX53T6TA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.324356015 (458h12m37.19543905s) [noise=true , address=45.91.116.14:4191 , piece_id=PZSZV2XFKZOJ5W5HP22PWW776L4ATWJZBEEQTJV6JEHYSIKBS35Q, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.442771707 (458h12m37.313854752s) [noise=true , address=45.91.116.11:4117 , piece_id=IMHTEB3WAFAO6554DFSOVOLTOIU65TI6KQSBEJNVP4W3M6STQYDA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.478430989 (458h12m37.349514054s) [noise=true , address=145.79.227.51:4411 , piece_id=3RKCEBKZSY2MSVPVE7CBSF32WX7APWEIGNX6QRZ6KEN3NYGIMBCQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.926537889 (458h12m37.797620924s) [noise=true , address=145.79.227.33:4869 , piece_id=VVRKB2PIP4RRW4DZ3OA67MRRVCKPTACQPY633LHHLLZBUNVPKJGQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.187478223 (458h12m38.058561268s) [noise=true , address=145.79.227.52:4446 , piece_id=NJF5KORJX4IZ2VFF3I7GTKELUFDRCZMZK2GZOUNFPURAPUDT47YQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.189416954 (458h12m38.060499999s) [noise=true , address=145.79.227.46:4603 , piece_id=ILEBQVEFNXVBYTGLFBMG4BRO3HNAJ5GYPH53IQF2V7RRSOLHFIQQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.202496650 (458h12m38.073579685s) [noise=true , address=145.79.227.38:4979 , piece_id=3SSLNJ545M7DSFJWO2V7K4AOQMXIXQUAXOAOQIX6NP757T22VWGA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.237024437 (458h12m38.108107492s) [noise=true , address=145.79.227.4:4187 , piece_id=IAJZIMUQQETQWLVZX6J2UU6RBBHHL5IZNOEBRLV5ZDE6A5MOPEYQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:42:04.130206679 (458h13m4.001289724s) [noise=true , address=145.79.227.49:4339 , piece_id=HBGK2U2V2OIPYUOBXJPV7O7FCP2TB2MAB44WRQSO4R7FYOHV3ROA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection; write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection Dec 24 17:42:04.130319203 (458h13m4.001402248s) [noise=true , address=145.79.227.11:4730 , piece_id=BNYY6GVOVFYX6YSQR7F23ASYKM5SJWHGK5NQIYTDMO3SGIXU6TNQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection Dec 24 17:42:04.130411048 (458h13m4.001494083s) [noise=true , address=145.79.227.37:4566 , piece_id=JMK6ZS4UFM3ETIID532YYHTAO2CIYHEJBEU4Z3LLT32J6QL5VY5A, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:1SaNJZaVix7BSbEWhu2Vmt3XjDDWCsQ8wTSiFR7MQ8oGwD9N2F, address:145.79.227.37:4566): protocol: write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection; write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection Dec 24 17:42:04.130495238 (458h13m4.001578283s) [noise=true , address=145.79.227.29:4941 , piece_id=T3QBPFJWPSOCGUJ6C4RC3YGRTTVIDHCUKKL6GYAJRNREPIUM2OCA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:125fn3wMJUNjsKTgsssLJkZAobCbaAS9jC2VyxXxbUA2ei4Gjni, address:145.79.227.29:4941): protocol: write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection; write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection Dec 24 17:42:04.130522550 (458h13m4.001605595s) [seg_pos={0 0}, upload=402229]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 24 17:42:04.370980973 (458h13m4.242064028s) [upload=402229]: Done uploading segments... Dec 24 17:42:04.371031650 (458h13m4.242114695s) [upload=402229]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.763498688s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 6.067789841s trace: https://jaeger.dev.storj.io/trace/64a70b063120f6ff FAIL (2025-12-24 17:46:51 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 24 17:41:34.817232055 (458h12m34.68831509s) [upload=402229]: Starting upload Dec 24 17:41:34.817285716 (458h12m34.688368751s) [upload=402229]: Done starting upload Dec 24 17:41:34.817371771 (458h12m34.688454806s) [upload=402229]: Uploading segments... Dec 24 17:41:34.817473855 (458h12m34.68855689s) [upload=402229]: Got next segment. Inline: false Dec 24 17:41:34.817508080 (458h12m34.688591115s) [upload=402229]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 24 17:41:34.817512659 (458h12m34.688595694s) [upload=402229]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 24 17:41:35.067154038 (458h12m34.938237083s) [seg_pos={0 0}, upload=402229]: Begin upload segment... Dec 24 17:41:35.067209534 (458h12m34.938292579s) [seg_pos={0 0}, upload=402229]: Done begin upload segment. Dec 24 17:41:35.067237456 (458h12m34.938320491s) [noise=true , address=145.79.227.45:4231 , piece_id=O2RJOW4SBW2XC3PJ5XJ5NLPCTUZXQQBYZDGOBX3YZTW6FDVTOFMA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.067270990 (458h12m34.938354025s) [noise=true , address=145.79.227.51:4411 , piece_id=3RKCEBKZSY2MSVPVE7CBSF32WX7APWEIGNX6QRZ6KEN3NYGIMBCQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.067737579 (458h12m34.938820624s) [noise=true , address=145.79.227.37:4566 , piece_id=JMK6ZS4UFM3ETIID532YYHTAO2CIYHEJBEU4Z3LLT32J6QL5VY5A, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068069410 (458h12m34.939152455s) [noise=true , address=145.79.227.11:4730 , piece_id=BNYY6GVOVFYX6YSQR7F23ASYKM5SJWHGK5NQIYTDMO3SGIXU6TNQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068471236 (458h12m34.939554281s) [noise=true , address=145.79.227.32:4834 , piece_id=OI4HEZS66F5LGW33SYDOAD4CDE47KP3MZ3C53BLTJWTV7D6AYK6Q, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068826392 (458h12m34.939909437s) [noise=true , address=145.79.227.29:4941 , piece_id=T3QBPFJWPSOCGUJ6C4RC3YGRTTVIDHCUKKL6GYAJRNREPIUM2OCA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069118318 (458h12m34.940201353s) [noise=true , address=145.79.227.4:4187 , piece_id=IAJZIMUQQETQWLVZX6J2UU6RBBHHL5IZNOEBRLV5ZDE6A5MOPEYQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069520844 (458h12m34.94060389s) [noise=true , address=45.91.116.11:4117 , piece_id=IMHTEB3WAFAO6554DFSOVOLTOIU65TI6KQSBEJNVP4W3M6STQYDA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069964640 (458h12m34.941047675s) [noise=true , address=145.79.227.49:4339 , piece_id=HBGK2U2V2OIPYUOBXJPV7O7FCP2TB2MAB44WRQSO4R7FYOHV3ROA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.070342990 (458h12m34.941426035s) [noise=true , address=145.79.227.7:4294 , piece_id=RAWBIZM3YPIHZ64SK7KXOXTL4GPVK3JGRGDINJN57USLVX53T6TA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.071430701 (458h12m34.942513736s) [noise=true , address=45.91.116.14:4191 , piece_id=PZSZV2XFKZOJ5W5HP22PWW776L4ATWJZBEEQTJV6JEHYSIKBS35Q, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.071491077 (458h12m34.942574112s) [noise=true , address=145.79.227.50:4374 , piece_id=MA5VLFQAK6U245SGQR5UODBBIQD7CPICYCYTM5SL3GMCLXURWZ7A, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.072542138 (458h12m34.943625183s) [noise=true , address=145.79.227.52:4446 , piece_id=NJF5KORJX4IZ2VFF3I7GTKELUFDRCZMZK2GZOUNFPURAPUDT47YQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.072669880 (458h12m34.943752925s) [noise=true , address=145.79.227.33:4869 , piece_id=VVRKB2PIP4RRW4DZ3OA67MRRVCKPTACQPY633LHHLLZBUNVPKJGQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.073725251 (458h12m34.944808286s) [noise=true , address=145.79.227.38:4979 , piece_id=3SSLNJ545M7DSFJWO2V7K4AOQMXIXQUAXOAOQIX6NP757T22VWGA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.075362869 (458h12m34.946445904s) [noise=true , address=145.79.227.46:4603 , piece_id=ILEBQVEFNXVBYTGLFBMG4BRO3HNAJ5GYPH53IQF2V7RRSOLHFIQQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:36.870712973 (458h12m36.741796018s) [upload=402229]: Next returned nil segment Dec 24 17:41:36.870729545 (458h12m36.74181258s) [upload=402229]: Waiting for error group managing segments... Dec 24 17:41:37.160017607 (458h12m37.031100642s) [noise=true , address=145.79.227.32:4834 , piece_id=OI4HEZS66F5LGW33SYDOAD4CDE47KP3MZ3C53BLTJWTV7D6AYK6Q, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.172949711 (458h12m37.044032757s) [noise=true , address=145.79.227.45:4231 , piece_id=O2RJOW4SBW2XC3PJ5XJ5NLPCTUZXQQBYZDGOBX3YZTW6FDVTOFMA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.183665827 (458h12m37.054748862s) [noise=true , address=145.79.227.50:4374 , piece_id=MA5VLFQAK6U245SGQR5UODBBIQD7CPICYCYTM5SL3GMCLXURWZ7A, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.245183227 (458h12m37.116266262s) [noise=true , address=145.79.227.7:4294 , piece_id=RAWBIZM3YPIHZ64SK7KXOXTL4GPVK3JGRGDINJN57USLVX53T6TA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.324356015 (458h12m37.19543905s) [noise=true , address=45.91.116.14:4191 , piece_id=PZSZV2XFKZOJ5W5HP22PWW776L4ATWJZBEEQTJV6JEHYSIKBS35Q, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.442771707 (458h12m37.313854752s) [noise=true , address=45.91.116.11:4117 , piece_id=IMHTEB3WAFAO6554DFSOVOLTOIU65TI6KQSBEJNVP4W3M6STQYDA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.478430989 (458h12m37.349514054s) [noise=true , address=145.79.227.51:4411 , piece_id=3RKCEBKZSY2MSVPVE7CBSF32WX7APWEIGNX6QRZ6KEN3NYGIMBCQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.926537889 (458h12m37.797620924s) [noise=true , address=145.79.227.33:4869 , piece_id=VVRKB2PIP4RRW4DZ3OA67MRRVCKPTACQPY633LHHLLZBUNVPKJGQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.187478223 (458h12m38.058561268s) [noise=true , address=145.79.227.52:4446 , piece_id=NJF5KORJX4IZ2VFF3I7GTKELUFDRCZMZK2GZOUNFPURAPUDT47YQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.189416954 (458h12m38.060499999s) [noise=true , address=145.79.227.46:4603 , piece_id=ILEBQVEFNXVBYTGLFBMG4BRO3HNAJ5GYPH53IQF2V7RRSOLHFIQQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.202496650 (458h12m38.073579685s) [noise=true , address=145.79.227.38:4979 , piece_id=3SSLNJ545M7DSFJWO2V7K4AOQMXIXQUAXOAOQIX6NP757T22VWGA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.237024437 (458h12m38.108107492s) [noise=true , address=145.79.227.4:4187 , piece_id=IAJZIMUQQETQWLVZX6J2UU6RBBHHL5IZNOEBRLV5ZDE6A5MOPEYQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:42:04.130206679 (458h13m4.001289724s) [noise=true , address=145.79.227.49:4339 , piece_id=HBGK2U2V2OIPYUOBXJPV7O7FCP2TB2MAB44WRQSO4R7FYOHV3ROA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection; write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection Dec 24 17:42:04.130319203 (458h13m4.001402248s) [noise=true , address=145.79.227.11:4730 , piece_id=BNYY6GVOVFYX6YSQR7F23ASYKM5SJWHGK5NQIYTDMO3SGIXU6TNQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection Dec 24 17:42:04.130411048 (458h13m4.001494083s) [noise=true , address=145.79.227.37:4566 , piece_id=JMK6ZS4UFM3ETIID532YYHTAO2CIYHEJBEU4Z3LLT32J6QL5VY5A, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:1SaNJZaVix7BSbEWhu2Vmt3XjDDWCsQ8wTSiFR7MQ8oGwD9N2F, address:145.79.227.37:4566): protocol: write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection; write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection Dec 24 17:42:04.130495238 (458h13m4.001578283s) [noise=true , address=145.79.227.29:4941 , piece_id=T3QBPFJWPSOCGUJ6C4RC3YGRTTVIDHCUKKL6GYAJRNREPIUM2OCA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:125fn3wMJUNjsKTgsssLJkZAobCbaAS9jC2VyxXxbUA2ei4Gjni, address:145.79.227.29:4941): protocol: write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection; write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection Dec 24 17:42:04.130522550 (458h13m4.001605595s) [seg_pos={0 0}, upload=402229]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 24 17:42:04.370980973 (458h13m4.242064028s) [upload=402229]: Done uploading segments... Dec 24 17:42:04.371031650 (458h13m4.242114695s) [upload=402229]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.067806352s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 6.000096631s trace: https://jaeger.dev.storj.io/trace/64a70b063120f6ff FAIL (2025-12-24 17:45:42 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 24 17:41:34.817232055 (458h12m34.68831509s) [upload=402229]: Starting upload Dec 24 17:41:34.817285716 (458h12m34.688368751s) [upload=402229]: Done starting upload Dec 24 17:41:34.817371771 (458h12m34.688454806s) [upload=402229]: Uploading segments... Dec 24 17:41:34.817473855 (458h12m34.68855689s) [upload=402229]: Got next segment. Inline: false Dec 24 17:41:34.817508080 (458h12m34.688591115s) [upload=402229]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 24 17:41:34.817512659 (458h12m34.688595694s) [upload=402229]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 24 17:41:35.067154038 (458h12m34.938237083s) [seg_pos={0 0}, upload=402229]: Begin upload segment... Dec 24 17:41:35.067209534 (458h12m34.938292579s) [seg_pos={0 0}, upload=402229]: Done begin upload segment. Dec 24 17:41:35.067237456 (458h12m34.938320491s) [noise=true , address=145.79.227.45:4231 , piece_id=O2RJOW4SBW2XC3PJ5XJ5NLPCTUZXQQBYZDGOBX3YZTW6FDVTOFMA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.067270990 (458h12m34.938354025s) [noise=true , address=145.79.227.51:4411 , piece_id=3RKCEBKZSY2MSVPVE7CBSF32WX7APWEIGNX6QRZ6KEN3NYGIMBCQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.067737579 (458h12m34.938820624s) [noise=true , address=145.79.227.37:4566 , piece_id=JMK6ZS4UFM3ETIID532YYHTAO2CIYHEJBEU4Z3LLT32J6QL5VY5A, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068069410 (458h12m34.939152455s) [noise=true , address=145.79.227.11:4730 , piece_id=BNYY6GVOVFYX6YSQR7F23ASYKM5SJWHGK5NQIYTDMO3SGIXU6TNQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068471236 (458h12m34.939554281s) [noise=true , address=145.79.227.32:4834 , piece_id=OI4HEZS66F5LGW33SYDOAD4CDE47KP3MZ3C53BLTJWTV7D6AYK6Q, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068826392 (458h12m34.939909437s) [noise=true , address=145.79.227.29:4941 , piece_id=T3QBPFJWPSOCGUJ6C4RC3YGRTTVIDHCUKKL6GYAJRNREPIUM2OCA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069118318 (458h12m34.940201353s) [noise=true , address=145.79.227.4:4187 , piece_id=IAJZIMUQQETQWLVZX6J2UU6RBBHHL5IZNOEBRLV5ZDE6A5MOPEYQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069520844 (458h12m34.94060389s) [noise=true , address=45.91.116.11:4117 , piece_id=IMHTEB3WAFAO6554DFSOVOLTOIU65TI6KQSBEJNVP4W3M6STQYDA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069964640 (458h12m34.941047675s) [noise=true , address=145.79.227.49:4339 , piece_id=HBGK2U2V2OIPYUOBXJPV7O7FCP2TB2MAB44WRQSO4R7FYOHV3ROA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.070342990 (458h12m34.941426035s) [noise=true , address=145.79.227.7:4294 , piece_id=RAWBIZM3YPIHZ64SK7KXOXTL4GPVK3JGRGDINJN57USLVX53T6TA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.071430701 (458h12m34.942513736s) [noise=true , address=45.91.116.14:4191 , piece_id=PZSZV2XFKZOJ5W5HP22PWW776L4ATWJZBEEQTJV6JEHYSIKBS35Q, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.071491077 (458h12m34.942574112s) [noise=true , address=145.79.227.50:4374 , piece_id=MA5VLFQAK6U245SGQR5UODBBIQD7CPICYCYTM5SL3GMCLXURWZ7A, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.072542138 (458h12m34.943625183s) [noise=true , address=145.79.227.52:4446 , piece_id=NJF5KORJX4IZ2VFF3I7GTKELUFDRCZMZK2GZOUNFPURAPUDT47YQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.072669880 (458h12m34.943752925s) [noise=true , address=145.79.227.33:4869 , piece_id=VVRKB2PIP4RRW4DZ3OA67MRRVCKPTACQPY633LHHLLZBUNVPKJGQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.073725251 (458h12m34.944808286s) [noise=true , address=145.79.227.38:4979 , piece_id=3SSLNJ545M7DSFJWO2V7K4AOQMXIXQUAXOAOQIX6NP757T22VWGA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.075362869 (458h12m34.946445904s) [noise=true , address=145.79.227.46:4603 , piece_id=ILEBQVEFNXVBYTGLFBMG4BRO3HNAJ5GYPH53IQF2V7RRSOLHFIQQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:36.870712973 (458h12m36.741796018s) [upload=402229]: Next returned nil segment Dec 24 17:41:36.870729545 (458h12m36.74181258s) [upload=402229]: Waiting for error group managing segments... Dec 24 17:41:37.160017607 (458h12m37.031100642s) [noise=true , address=145.79.227.32:4834 , piece_id=OI4HEZS66F5LGW33SYDOAD4CDE47KP3MZ3C53BLTJWTV7D6AYK6Q, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.172949711 (458h12m37.044032757s) [noise=true , address=145.79.227.45:4231 , piece_id=O2RJOW4SBW2XC3PJ5XJ5NLPCTUZXQQBYZDGOBX3YZTW6FDVTOFMA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.183665827 (458h12m37.054748862s) [noise=true , address=145.79.227.50:4374 , piece_id=MA5VLFQAK6U245SGQR5UODBBIQD7CPICYCYTM5SL3GMCLXURWZ7A, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.245183227 (458h12m37.116266262s) [noise=true , address=145.79.227.7:4294 , piece_id=RAWBIZM3YPIHZ64SK7KXOXTL4GPVK3JGRGDINJN57USLVX53T6TA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.324356015 (458h12m37.19543905s) [noise=true , address=45.91.116.14:4191 , piece_id=PZSZV2XFKZOJ5W5HP22PWW776L4ATWJZBEEQTJV6JEHYSIKBS35Q, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.442771707 (458h12m37.313854752s) [noise=true , address=45.91.116.11:4117 , piece_id=IMHTEB3WAFAO6554DFSOVOLTOIU65TI6KQSBEJNVP4W3M6STQYDA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.478430989 (458h12m37.349514054s) [noise=true , address=145.79.227.51:4411 , piece_id=3RKCEBKZSY2MSVPVE7CBSF32WX7APWEIGNX6QRZ6KEN3NYGIMBCQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.926537889 (458h12m37.797620924s) [noise=true , address=145.79.227.33:4869 , piece_id=VVRKB2PIP4RRW4DZ3OA67MRRVCKPTACQPY633LHHLLZBUNVPKJGQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.187478223 (458h12m38.058561268s) [noise=true , address=145.79.227.52:4446 , piece_id=NJF5KORJX4IZ2VFF3I7GTKELUFDRCZMZK2GZOUNFPURAPUDT47YQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.189416954 (458h12m38.060499999s) [noise=true , address=145.79.227.46:4603 , piece_id=ILEBQVEFNXVBYTGLFBMG4BRO3HNAJ5GYPH53IQF2V7RRSOLHFIQQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.202496650 (458h12m38.073579685s) [noise=true , address=145.79.227.38:4979 , piece_id=3SSLNJ545M7DSFJWO2V7K4AOQMXIXQUAXOAOQIX6NP757T22VWGA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.237024437 (458h12m38.108107492s) [noise=true , address=145.79.227.4:4187 , piece_id=IAJZIMUQQETQWLVZX6J2UU6RBBHHL5IZNOEBRLV5ZDE6A5MOPEYQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:42:04.130206679 (458h13m4.001289724s) [noise=true , address=145.79.227.49:4339 , piece_id=HBGK2U2V2OIPYUOBXJPV7O7FCP2TB2MAB44WRQSO4R7FYOHV3ROA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection; write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection Dec 24 17:42:04.130319203 (458h13m4.001402248s) [noise=true , address=145.79.227.11:4730 , piece_id=BNYY6GVOVFYX6YSQR7F23ASYKM5SJWHGK5NQIYTDMO3SGIXU6TNQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection Dec 24 17:42:04.130411048 (458h13m4.001494083s) [noise=true , address=145.79.227.37:4566 , piece_id=JMK6ZS4UFM3ETIID532YYHTAO2CIYHEJBEU4Z3LLT32J6QL5VY5A, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:1SaNJZaVix7BSbEWhu2Vmt3XjDDWCsQ8wTSiFR7MQ8oGwD9N2F, address:145.79.227.37:4566): protocol: write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection; write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection Dec 24 17:42:04.130495238 (458h13m4.001578283s) [noise=true , address=145.79.227.29:4941 , piece_id=T3QBPFJWPSOCGUJ6C4RC3YGRTTVIDHCUKKL6GYAJRNREPIUM2OCA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:125fn3wMJUNjsKTgsssLJkZAobCbaAS9jC2VyxXxbUA2ei4Gjni, address:145.79.227.29:4941): protocol: write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection; write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection Dec 24 17:42:04.130522550 (458h13m4.001605595s) [seg_pos={0 0}, upload=402229]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 24 17:42:04.370980973 (458h13m4.242064028s) [upload=402229]: Done uploading segments... Dec 24 17:42:04.371031650 (458h13m4.242114695s) [upload=402229]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 6.000126828s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 11.66284874s trace: https://jaeger.dev.storj.io/trace/64a70b063120f6ff FAIL (2025-12-24 17:44:45 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 24 17:41:34.817232055 (458h12m34.68831509s) [upload=402229]: Starting upload Dec 24 17:41:34.817285716 (458h12m34.688368751s) [upload=402229]: Done starting upload Dec 24 17:41:34.817371771 (458h12m34.688454806s) [upload=402229]: Uploading segments... Dec 24 17:41:34.817473855 (458h12m34.68855689s) [upload=402229]: Got next segment. Inline: false Dec 24 17:41:34.817508080 (458h12m34.688591115s) [upload=402229]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 24 17:41:34.817512659 (458h12m34.688595694s) [upload=402229]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 24 17:41:35.067154038 (458h12m34.938237083s) [seg_pos={0 0}, upload=402229]: Begin upload segment... Dec 24 17:41:35.067209534 (458h12m34.938292579s) [seg_pos={0 0}, upload=402229]: Done begin upload segment. Dec 24 17:41:35.067237456 (458h12m34.938320491s) [noise=true , address=145.79.227.45:4231 , piece_id=O2RJOW4SBW2XC3PJ5XJ5NLPCTUZXQQBYZDGOBX3YZTW6FDVTOFMA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.067270990 (458h12m34.938354025s) [noise=true , address=145.79.227.51:4411 , piece_id=3RKCEBKZSY2MSVPVE7CBSF32WX7APWEIGNX6QRZ6KEN3NYGIMBCQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.067737579 (458h12m34.938820624s) [noise=true , address=145.79.227.37:4566 , piece_id=JMK6ZS4UFM3ETIID532YYHTAO2CIYHEJBEU4Z3LLT32J6QL5VY5A, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068069410 (458h12m34.939152455s) [noise=true , address=145.79.227.11:4730 , piece_id=BNYY6GVOVFYX6YSQR7F23ASYKM5SJWHGK5NQIYTDMO3SGIXU6TNQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068471236 (458h12m34.939554281s) [noise=true , address=145.79.227.32:4834 , piece_id=OI4HEZS66F5LGW33SYDOAD4CDE47KP3MZ3C53BLTJWTV7D6AYK6Q, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068826392 (458h12m34.939909437s) [noise=true , address=145.79.227.29:4941 , piece_id=T3QBPFJWPSOCGUJ6C4RC3YGRTTVIDHCUKKL6GYAJRNREPIUM2OCA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069118318 (458h12m34.940201353s) [noise=true , address=145.79.227.4:4187 , piece_id=IAJZIMUQQETQWLVZX6J2UU6RBBHHL5IZNOEBRLV5ZDE6A5MOPEYQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069520844 (458h12m34.94060389s) [noise=true , address=45.91.116.11:4117 , piece_id=IMHTEB3WAFAO6554DFSOVOLTOIU65TI6KQSBEJNVP4W3M6STQYDA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069964640 (458h12m34.941047675s) [noise=true , address=145.79.227.49:4339 , piece_id=HBGK2U2V2OIPYUOBXJPV7O7FCP2TB2MAB44WRQSO4R7FYOHV3ROA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.070342990 (458h12m34.941426035s) [noise=true , address=145.79.227.7:4294 , piece_id=RAWBIZM3YPIHZ64SK7KXOXTL4GPVK3JGRGDINJN57USLVX53T6TA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.071430701 (458h12m34.942513736s) [noise=true , address=45.91.116.14:4191 , piece_id=PZSZV2XFKZOJ5W5HP22PWW776L4ATWJZBEEQTJV6JEHYSIKBS35Q, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.071491077 (458h12m34.942574112s) [noise=true , address=145.79.227.50:4374 , piece_id=MA5VLFQAK6U245SGQR5UODBBIQD7CPICYCYTM5SL3GMCLXURWZ7A, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.072542138 (458h12m34.943625183s) [noise=true , address=145.79.227.52:4446 , piece_id=NJF5KORJX4IZ2VFF3I7GTKELUFDRCZMZK2GZOUNFPURAPUDT47YQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.072669880 (458h12m34.943752925s) [noise=true , address=145.79.227.33:4869 , piece_id=VVRKB2PIP4RRW4DZ3OA67MRRVCKPTACQPY633LHHLLZBUNVPKJGQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.073725251 (458h12m34.944808286s) [noise=true , address=145.79.227.38:4979 , piece_id=3SSLNJ545M7DSFJWO2V7K4AOQMXIXQUAXOAOQIX6NP757T22VWGA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.075362869 (458h12m34.946445904s) [noise=true , address=145.79.227.46:4603 , piece_id=ILEBQVEFNXVBYTGLFBMG4BRO3HNAJ5GYPH53IQF2V7RRSOLHFIQQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:36.870712973 (458h12m36.741796018s) [upload=402229]: Next returned nil segment Dec 24 17:41:36.870729545 (458h12m36.74181258s) [upload=402229]: Waiting for error group managing segments... Dec 24 17:41:37.160017607 (458h12m37.031100642s) [noise=true , address=145.79.227.32:4834 , piece_id=OI4HEZS66F5LGW33SYDOAD4CDE47KP3MZ3C53BLTJWTV7D6AYK6Q, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.172949711 (458h12m37.044032757s) [noise=true , address=145.79.227.45:4231 , piece_id=O2RJOW4SBW2XC3PJ5XJ5NLPCTUZXQQBYZDGOBX3YZTW6FDVTOFMA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.183665827 (458h12m37.054748862s) [noise=true , address=145.79.227.50:4374 , piece_id=MA5VLFQAK6U245SGQR5UODBBIQD7CPICYCYTM5SL3GMCLXURWZ7A, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.245183227 (458h12m37.116266262s) [noise=true , address=145.79.227.7:4294 , piece_id=RAWBIZM3YPIHZ64SK7KXOXTL4GPVK3JGRGDINJN57USLVX53T6TA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.324356015 (458h12m37.19543905s) [noise=true , address=45.91.116.14:4191 , piece_id=PZSZV2XFKZOJ5W5HP22PWW776L4ATWJZBEEQTJV6JEHYSIKBS35Q, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.442771707 (458h12m37.313854752s) [noise=true , address=45.91.116.11:4117 , piece_id=IMHTEB3WAFAO6554DFSOVOLTOIU65TI6KQSBEJNVP4W3M6STQYDA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.478430989 (458h12m37.349514054s) [noise=true , address=145.79.227.51:4411 , piece_id=3RKCEBKZSY2MSVPVE7CBSF32WX7APWEIGNX6QRZ6KEN3NYGIMBCQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.926537889 (458h12m37.797620924s) [noise=true , address=145.79.227.33:4869 , piece_id=VVRKB2PIP4RRW4DZ3OA67MRRVCKPTACQPY633LHHLLZBUNVPKJGQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.187478223 (458h12m38.058561268s) [noise=true , address=145.79.227.52:4446 , piece_id=NJF5KORJX4IZ2VFF3I7GTKELUFDRCZMZK2GZOUNFPURAPUDT47YQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.189416954 (458h12m38.060499999s) [noise=true , address=145.79.227.46:4603 , piece_id=ILEBQVEFNXVBYTGLFBMG4BRO3HNAJ5GYPH53IQF2V7RRSOLHFIQQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.202496650 (458h12m38.073579685s) [noise=true , address=145.79.227.38:4979 , piece_id=3SSLNJ545M7DSFJWO2V7K4AOQMXIXQUAXOAOQIX6NP757T22VWGA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.237024437 (458h12m38.108107492s) [noise=true , address=145.79.227.4:4187 , piece_id=IAJZIMUQQETQWLVZX6J2UU6RBBHHL5IZNOEBRLV5ZDE6A5MOPEYQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:42:04.130206679 (458h13m4.001289724s) [noise=true , address=145.79.227.49:4339 , piece_id=HBGK2U2V2OIPYUOBXJPV7O7FCP2TB2MAB44WRQSO4R7FYOHV3ROA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection; write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection Dec 24 17:42:04.130319203 (458h13m4.001402248s) [noise=true , address=145.79.227.11:4730 , piece_id=BNYY6GVOVFYX6YSQR7F23ASYKM5SJWHGK5NQIYTDMO3SGIXU6TNQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection Dec 24 17:42:04.130411048 (458h13m4.001494083s) [noise=true , address=145.79.227.37:4566 , piece_id=JMK6ZS4UFM3ETIID532YYHTAO2CIYHEJBEU4Z3LLT32J6QL5VY5A, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:1SaNJZaVix7BSbEWhu2Vmt3XjDDWCsQ8wTSiFR7MQ8oGwD9N2F, address:145.79.227.37:4566): protocol: write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection; write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection Dec 24 17:42:04.130495238 (458h13m4.001578283s) [noise=true , address=145.79.227.29:4941 , piece_id=T3QBPFJWPSOCGUJ6C4RC3YGRTTVIDHCUKKL6GYAJRNREPIUM2OCA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:125fn3wMJUNjsKTgsssLJkZAobCbaAS9jC2VyxXxbUA2ei4Gjni, address:145.79.227.29:4941): protocol: write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection; write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection Dec 24 17:42:04.130522550 (458h13m4.001605595s) [seg_pos={0 0}, upload=402229]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 24 17:42:04.370980973 (458h13m4.242064028s) [upload=402229]: Done uploading segments... Dec 24 17:42:04.371031650 (458h13m4.242114695s) [upload=402229]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 11.662877174s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 15.197451032s trace: https://jaeger.dev.storj.io/trace/64a70b063120f6ff FAIL (2025-12-24 17:44:24 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 24 17:41:34.817232055 (458h12m34.68831509s) [upload=402229]: Starting upload Dec 24 17:41:34.817285716 (458h12m34.688368751s) [upload=402229]: Done starting upload Dec 24 17:41:34.817371771 (458h12m34.688454806s) [upload=402229]: Uploading segments... Dec 24 17:41:34.817473855 (458h12m34.68855689s) [upload=402229]: Got next segment. Inline: false Dec 24 17:41:34.817508080 (458h12m34.688591115s) [upload=402229]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 24 17:41:34.817512659 (458h12m34.688595694s) [upload=402229]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 24 17:41:35.067154038 (458h12m34.938237083s) [seg_pos={0 0}, upload=402229]: Begin upload segment... Dec 24 17:41:35.067209534 (458h12m34.938292579s) [seg_pos={0 0}, upload=402229]: Done begin upload segment. Dec 24 17:41:35.067237456 (458h12m34.938320491s) [noise=true , address=145.79.227.45:4231 , piece_id=O2RJOW4SBW2XC3PJ5XJ5NLPCTUZXQQBYZDGOBX3YZTW6FDVTOFMA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.067270990 (458h12m34.938354025s) [noise=true , address=145.79.227.51:4411 , piece_id=3RKCEBKZSY2MSVPVE7CBSF32WX7APWEIGNX6QRZ6KEN3NYGIMBCQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.067737579 (458h12m34.938820624s) [noise=true , address=145.79.227.37:4566 , piece_id=JMK6ZS4UFM3ETIID532YYHTAO2CIYHEJBEU4Z3LLT32J6QL5VY5A, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068069410 (458h12m34.939152455s) [noise=true , address=145.79.227.11:4730 , piece_id=BNYY6GVOVFYX6YSQR7F23ASYKM5SJWHGK5NQIYTDMO3SGIXU6TNQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068471236 (458h12m34.939554281s) [noise=true , address=145.79.227.32:4834 , piece_id=OI4HEZS66F5LGW33SYDOAD4CDE47KP3MZ3C53BLTJWTV7D6AYK6Q, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068826392 (458h12m34.939909437s) [noise=true , address=145.79.227.29:4941 , piece_id=T3QBPFJWPSOCGUJ6C4RC3YGRTTVIDHCUKKL6GYAJRNREPIUM2OCA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069118318 (458h12m34.940201353s) [noise=true , address=145.79.227.4:4187 , piece_id=IAJZIMUQQETQWLVZX6J2UU6RBBHHL5IZNOEBRLV5ZDE6A5MOPEYQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069520844 (458h12m34.94060389s) [noise=true , address=45.91.116.11:4117 , piece_id=IMHTEB3WAFAO6554DFSOVOLTOIU65TI6KQSBEJNVP4W3M6STQYDA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069964640 (458h12m34.941047675s) [noise=true , address=145.79.227.49:4339 , piece_id=HBGK2U2V2OIPYUOBXJPV7O7FCP2TB2MAB44WRQSO4R7FYOHV3ROA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.070342990 (458h12m34.941426035s) [noise=true , address=145.79.227.7:4294 , piece_id=RAWBIZM3YPIHZ64SK7KXOXTL4GPVK3JGRGDINJN57USLVX53T6TA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.071430701 (458h12m34.942513736s) [noise=true , address=45.91.116.14:4191 , piece_id=PZSZV2XFKZOJ5W5HP22PWW776L4ATWJZBEEQTJV6JEHYSIKBS35Q, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.071491077 (458h12m34.942574112s) [noise=true , address=145.79.227.50:4374 , piece_id=MA5VLFQAK6U245SGQR5UODBBIQD7CPICYCYTM5SL3GMCLXURWZ7A, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.072542138 (458h12m34.943625183s) [noise=true , address=145.79.227.52:4446 , piece_id=NJF5KORJX4IZ2VFF3I7GTKELUFDRCZMZK2GZOUNFPURAPUDT47YQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.072669880 (458h12m34.943752925s) [noise=true , address=145.79.227.33:4869 , piece_id=VVRKB2PIP4RRW4DZ3OA67MRRVCKPTACQPY633LHHLLZBUNVPKJGQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.073725251 (458h12m34.944808286s) [noise=true , address=145.79.227.38:4979 , piece_id=3SSLNJ545M7DSFJWO2V7K4AOQMXIXQUAXOAOQIX6NP757T22VWGA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.075362869 (458h12m34.946445904s) [noise=true , address=145.79.227.46:4603 , piece_id=ILEBQVEFNXVBYTGLFBMG4BRO3HNAJ5GYPH53IQF2V7RRSOLHFIQQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:36.870712973 (458h12m36.741796018s) [upload=402229]: Next returned nil segment Dec 24 17:41:36.870729545 (458h12m36.74181258s) [upload=402229]: Waiting for error group managing segments... Dec 24 17:41:37.160017607 (458h12m37.031100642s) [noise=true , address=145.79.227.32:4834 , piece_id=OI4HEZS66F5LGW33SYDOAD4CDE47KP3MZ3C53BLTJWTV7D6AYK6Q, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.172949711 (458h12m37.044032757s) [noise=true , address=145.79.227.45:4231 , piece_id=O2RJOW4SBW2XC3PJ5XJ5NLPCTUZXQQBYZDGOBX3YZTW6FDVTOFMA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.183665827 (458h12m37.054748862s) [noise=true , address=145.79.227.50:4374 , piece_id=MA5VLFQAK6U245SGQR5UODBBIQD7CPICYCYTM5SL3GMCLXURWZ7A, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.245183227 (458h12m37.116266262s) [noise=true , address=145.79.227.7:4294 , piece_id=RAWBIZM3YPIHZ64SK7KXOXTL4GPVK3JGRGDINJN57USLVX53T6TA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.324356015 (458h12m37.19543905s) [noise=true , address=45.91.116.14:4191 , piece_id=PZSZV2XFKZOJ5W5HP22PWW776L4ATWJZBEEQTJV6JEHYSIKBS35Q, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.442771707 (458h12m37.313854752s) [noise=true , address=45.91.116.11:4117 , piece_id=IMHTEB3WAFAO6554DFSOVOLTOIU65TI6KQSBEJNVP4W3M6STQYDA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.478430989 (458h12m37.349514054s) [noise=true , address=145.79.227.51:4411 , piece_id=3RKCEBKZSY2MSVPVE7CBSF32WX7APWEIGNX6QRZ6KEN3NYGIMBCQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.926537889 (458h12m37.797620924s) [noise=true , address=145.79.227.33:4869 , piece_id=VVRKB2PIP4RRW4DZ3OA67MRRVCKPTACQPY633LHHLLZBUNVPKJGQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.187478223 (458h12m38.058561268s) [noise=true , address=145.79.227.52:4446 , piece_id=NJF5KORJX4IZ2VFF3I7GTKELUFDRCZMZK2GZOUNFPURAPUDT47YQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.189416954 (458h12m38.060499999s) [noise=true , address=145.79.227.46:4603 , piece_id=ILEBQVEFNXVBYTGLFBMG4BRO3HNAJ5GYPH53IQF2V7RRSOLHFIQQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.202496650 (458h12m38.073579685s) [noise=true , address=145.79.227.38:4979 , piece_id=3SSLNJ545M7DSFJWO2V7K4AOQMXIXQUAXOAOQIX6NP757T22VWGA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.237024437 (458h12m38.108107492s) [noise=true , address=145.79.227.4:4187 , piece_id=IAJZIMUQQETQWLVZX6J2UU6RBBHHL5IZNOEBRLV5ZDE6A5MOPEYQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:42:04.130206679 (458h13m4.001289724s) [noise=true , address=145.79.227.49:4339 , piece_id=HBGK2U2V2OIPYUOBXJPV7O7FCP2TB2MAB44WRQSO4R7FYOHV3ROA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection; write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection Dec 24 17:42:04.130319203 (458h13m4.001402248s) [noise=true , address=145.79.227.11:4730 , piece_id=BNYY6GVOVFYX6YSQR7F23ASYKM5SJWHGK5NQIYTDMO3SGIXU6TNQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection Dec 24 17:42:04.130411048 (458h13m4.001494083s) [noise=true , address=145.79.227.37:4566 , piece_id=JMK6ZS4UFM3ETIID532YYHTAO2CIYHEJBEU4Z3LLT32J6QL5VY5A, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:1SaNJZaVix7BSbEWhu2Vmt3XjDDWCsQ8wTSiFR7MQ8oGwD9N2F, address:145.79.227.37:4566): protocol: write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection; write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection Dec 24 17:42:04.130495238 (458h13m4.001578283s) [noise=true , address=145.79.227.29:4941 , piece_id=T3QBPFJWPSOCGUJ6C4RC3YGRTTVIDHCUKKL6GYAJRNREPIUM2OCA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:125fn3wMJUNjsKTgsssLJkZAobCbaAS9jC2VyxXxbUA2ei4Gjni, address:145.79.227.29:4941): protocol: write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection; write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection Dec 24 17:42:04.130522550 (458h13m4.001605595s) [seg_pos={0 0}, upload=402229]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 24 17:42:04.370980973 (458h13m4.242064028s) [upload=402229]: Done uploading segments... Dec 24 17:42:04.371031650 (458h13m4.242114695s) [upload=402229]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 15.197478012s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.883030959s trace: https://jaeger.dev.storj.io/trace/64a70b063120f6ff FAIL (2025-12-24 17:43:23 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 24 17:41:34.817232055 (458h12m34.68831509s) [upload=402229]: Starting upload Dec 24 17:41:34.817285716 (458h12m34.688368751s) [upload=402229]: Done starting upload Dec 24 17:41:34.817371771 (458h12m34.688454806s) [upload=402229]: Uploading segments... Dec 24 17:41:34.817473855 (458h12m34.68855689s) [upload=402229]: Got next segment. Inline: false Dec 24 17:41:34.817508080 (458h12m34.688591115s) [upload=402229]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 24 17:41:34.817512659 (458h12m34.688595694s) [upload=402229]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 24 17:41:35.067154038 (458h12m34.938237083s) [seg_pos={0 0}, upload=402229]: Begin upload segment... Dec 24 17:41:35.067209534 (458h12m34.938292579s) [seg_pos={0 0}, upload=402229]: Done begin upload segment. Dec 24 17:41:35.067237456 (458h12m34.938320491s) [noise=true , address=145.79.227.45:4231 , piece_id=O2RJOW4SBW2XC3PJ5XJ5NLPCTUZXQQBYZDGOBX3YZTW6FDVTOFMA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.067270990 (458h12m34.938354025s) [noise=true , address=145.79.227.51:4411 , piece_id=3RKCEBKZSY2MSVPVE7CBSF32WX7APWEIGNX6QRZ6KEN3NYGIMBCQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.067737579 (458h12m34.938820624s) [noise=true , address=145.79.227.37:4566 , piece_id=JMK6ZS4UFM3ETIID532YYHTAO2CIYHEJBEU4Z3LLT32J6QL5VY5A, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068069410 (458h12m34.939152455s) [noise=true , address=145.79.227.11:4730 , piece_id=BNYY6GVOVFYX6YSQR7F23ASYKM5SJWHGK5NQIYTDMO3SGIXU6TNQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068471236 (458h12m34.939554281s) [noise=true , address=145.79.227.32:4834 , piece_id=OI4HEZS66F5LGW33SYDOAD4CDE47KP3MZ3C53BLTJWTV7D6AYK6Q, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068826392 (458h12m34.939909437s) [noise=true , address=145.79.227.29:4941 , piece_id=T3QBPFJWPSOCGUJ6C4RC3YGRTTVIDHCUKKL6GYAJRNREPIUM2OCA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069118318 (458h12m34.940201353s) [noise=true , address=145.79.227.4:4187 , piece_id=IAJZIMUQQETQWLVZX6J2UU6RBBHHL5IZNOEBRLV5ZDE6A5MOPEYQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069520844 (458h12m34.94060389s) [noise=true , address=45.91.116.11:4117 , piece_id=IMHTEB3WAFAO6554DFSOVOLTOIU65TI6KQSBEJNVP4W3M6STQYDA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069964640 (458h12m34.941047675s) [noise=true , address=145.79.227.49:4339 , piece_id=HBGK2U2V2OIPYUOBXJPV7O7FCP2TB2MAB44WRQSO4R7FYOHV3ROA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.070342990 (458h12m34.941426035s) [noise=true , address=145.79.227.7:4294 , piece_id=RAWBIZM3YPIHZ64SK7KXOXTL4GPVK3JGRGDINJN57USLVX53T6TA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.071430701 (458h12m34.942513736s) [noise=true , address=45.91.116.14:4191 , piece_id=PZSZV2XFKZOJ5W5HP22PWW776L4ATWJZBEEQTJV6JEHYSIKBS35Q, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.071491077 (458h12m34.942574112s) [noise=true , address=145.79.227.50:4374 , piece_id=MA5VLFQAK6U245SGQR5UODBBIQD7CPICYCYTM5SL3GMCLXURWZ7A, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.072542138 (458h12m34.943625183s) [noise=true , address=145.79.227.52:4446 , piece_id=NJF5KORJX4IZ2VFF3I7GTKELUFDRCZMZK2GZOUNFPURAPUDT47YQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.072669880 (458h12m34.943752925s) [noise=true , address=145.79.227.33:4869 , piece_id=VVRKB2PIP4RRW4DZ3OA67MRRVCKPTACQPY633LHHLLZBUNVPKJGQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.073725251 (458h12m34.944808286s) [noise=true , address=145.79.227.38:4979 , piece_id=3SSLNJ545M7DSFJWO2V7K4AOQMXIXQUAXOAOQIX6NP757T22VWGA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.075362869 (458h12m34.946445904s) [noise=true , address=145.79.227.46:4603 , piece_id=ILEBQVEFNXVBYTGLFBMG4BRO3HNAJ5GYPH53IQF2V7RRSOLHFIQQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:36.870712973 (458h12m36.741796018s) [upload=402229]: Next returned nil segment Dec 24 17:41:36.870729545 (458h12m36.74181258s) [upload=402229]: Waiting for error group managing segments... Dec 24 17:41:37.160017607 (458h12m37.031100642s) [noise=true , address=145.79.227.32:4834 , piece_id=OI4HEZS66F5LGW33SYDOAD4CDE47KP3MZ3C53BLTJWTV7D6AYK6Q, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.172949711 (458h12m37.044032757s) [noise=true , address=145.79.227.45:4231 , piece_id=O2RJOW4SBW2XC3PJ5XJ5NLPCTUZXQQBYZDGOBX3YZTW6FDVTOFMA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.183665827 (458h12m37.054748862s) [noise=true , address=145.79.227.50:4374 , piece_id=MA5VLFQAK6U245SGQR5UODBBIQD7CPICYCYTM5SL3GMCLXURWZ7A, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.245183227 (458h12m37.116266262s) [noise=true , address=145.79.227.7:4294 , piece_id=RAWBIZM3YPIHZ64SK7KXOXTL4GPVK3JGRGDINJN57USLVX53T6TA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.324356015 (458h12m37.19543905s) [noise=true , address=45.91.116.14:4191 , piece_id=PZSZV2XFKZOJ5W5HP22PWW776L4ATWJZBEEQTJV6JEHYSIKBS35Q, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.442771707 (458h12m37.313854752s) [noise=true , address=45.91.116.11:4117 , piece_id=IMHTEB3WAFAO6554DFSOVOLTOIU65TI6KQSBEJNVP4W3M6STQYDA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.478430989 (458h12m37.349514054s) [noise=true , address=145.79.227.51:4411 , piece_id=3RKCEBKZSY2MSVPVE7CBSF32WX7APWEIGNX6QRZ6KEN3NYGIMBCQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.926537889 (458h12m37.797620924s) [noise=true , address=145.79.227.33:4869 , piece_id=VVRKB2PIP4RRW4DZ3OA67MRRVCKPTACQPY633LHHLLZBUNVPKJGQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.187478223 (458h12m38.058561268s) [noise=true , address=145.79.227.52:4446 , piece_id=NJF5KORJX4IZ2VFF3I7GTKELUFDRCZMZK2GZOUNFPURAPUDT47YQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.189416954 (458h12m38.060499999s) [noise=true , address=145.79.227.46:4603 , piece_id=ILEBQVEFNXVBYTGLFBMG4BRO3HNAJ5GYPH53IQF2V7RRSOLHFIQQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.202496650 (458h12m38.073579685s) [noise=true , address=145.79.227.38:4979 , piece_id=3SSLNJ545M7DSFJWO2V7K4AOQMXIXQUAXOAOQIX6NP757T22VWGA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.237024437 (458h12m38.108107492s) [noise=true , address=145.79.227.4:4187 , piece_id=IAJZIMUQQETQWLVZX6J2UU6RBBHHL5IZNOEBRLV5ZDE6A5MOPEYQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:42:04.130206679 (458h13m4.001289724s) [noise=true , address=145.79.227.49:4339 , piece_id=HBGK2U2V2OIPYUOBXJPV7O7FCP2TB2MAB44WRQSO4R7FYOHV3ROA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection; write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection Dec 24 17:42:04.130319203 (458h13m4.001402248s) [noise=true , address=145.79.227.11:4730 , piece_id=BNYY6GVOVFYX6YSQR7F23ASYKM5SJWHGK5NQIYTDMO3SGIXU6TNQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection Dec 24 17:42:04.130411048 (458h13m4.001494083s) [noise=true , address=145.79.227.37:4566 , piece_id=JMK6ZS4UFM3ETIID532YYHTAO2CIYHEJBEU4Z3LLT32J6QL5VY5A, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:1SaNJZaVix7BSbEWhu2Vmt3XjDDWCsQ8wTSiFR7MQ8oGwD9N2F, address:145.79.227.37:4566): protocol: write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection; write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection Dec 24 17:42:04.130495238 (458h13m4.001578283s) [noise=true , address=145.79.227.29:4941 , piece_id=T3QBPFJWPSOCGUJ6C4RC3YGRTTVIDHCUKKL6GYAJRNREPIUM2OCA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:125fn3wMJUNjsKTgsssLJkZAobCbaAS9jC2VyxXxbUA2ei4Gjni, address:145.79.227.29:4941): protocol: write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection; write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection Dec 24 17:42:04.130522550 (458h13m4.001605595s) [seg_pos={0 0}, upload=402229]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 24 17:42:04.370980973 (458h13m4.242064028s) [upload=402229]: Done uploading segments... Dec 24 17:42:04.371031650 (458h13m4.242114695s) [upload=402229]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.883056417s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.825998657s trace: https://jaeger.dev.storj.io/trace/64a70b063120f6ff FAIL (2025-12-24 17:42:47 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 24 17:41:34.817232055 (458h12m34.68831509s) [upload=402229]: Starting upload Dec 24 17:41:34.817285716 (458h12m34.688368751s) [upload=402229]: Done starting upload Dec 24 17:41:34.817371771 (458h12m34.688454806s) [upload=402229]: Uploading segments... Dec 24 17:41:34.817473855 (458h12m34.68855689s) [upload=402229]: Got next segment. Inline: false Dec 24 17:41:34.817508080 (458h12m34.688591115s) [upload=402229]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 24 17:41:34.817512659 (458h12m34.688595694s) [upload=402229]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 24 17:41:35.067154038 (458h12m34.938237083s) [seg_pos={0 0}, upload=402229]: Begin upload segment... Dec 24 17:41:35.067209534 (458h12m34.938292579s) [seg_pos={0 0}, upload=402229]: Done begin upload segment. Dec 24 17:41:35.067237456 (458h12m34.938320491s) [noise=true , address=145.79.227.45:4231 , piece_id=O2RJOW4SBW2XC3PJ5XJ5NLPCTUZXQQBYZDGOBX3YZTW6FDVTOFMA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.067270990 (458h12m34.938354025s) [noise=true , address=145.79.227.51:4411 , piece_id=3RKCEBKZSY2MSVPVE7CBSF32WX7APWEIGNX6QRZ6KEN3NYGIMBCQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.067737579 (458h12m34.938820624s) [noise=true , address=145.79.227.37:4566 , piece_id=JMK6ZS4UFM3ETIID532YYHTAO2CIYHEJBEU4Z3LLT32J6QL5VY5A, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068069410 (458h12m34.939152455s) [noise=true , address=145.79.227.11:4730 , piece_id=BNYY6GVOVFYX6YSQR7F23ASYKM5SJWHGK5NQIYTDMO3SGIXU6TNQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068471236 (458h12m34.939554281s) [noise=true , address=145.79.227.32:4834 , piece_id=OI4HEZS66F5LGW33SYDOAD4CDE47KP3MZ3C53BLTJWTV7D6AYK6Q, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068826392 (458h12m34.939909437s) [noise=true , address=145.79.227.29:4941 , piece_id=T3QBPFJWPSOCGUJ6C4RC3YGRTTVIDHCUKKL6GYAJRNREPIUM2OCA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069118318 (458h12m34.940201353s) [noise=true , address=145.79.227.4:4187 , piece_id=IAJZIMUQQETQWLVZX6J2UU6RBBHHL5IZNOEBRLV5ZDE6A5MOPEYQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069520844 (458h12m34.94060389s) [noise=true , address=45.91.116.11:4117 , piece_id=IMHTEB3WAFAO6554DFSOVOLTOIU65TI6KQSBEJNVP4W3M6STQYDA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069964640 (458h12m34.941047675s) [noise=true , address=145.79.227.49:4339 , piece_id=HBGK2U2V2OIPYUOBXJPV7O7FCP2TB2MAB44WRQSO4R7FYOHV3ROA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.070342990 (458h12m34.941426035s) [noise=true , address=145.79.227.7:4294 , piece_id=RAWBIZM3YPIHZ64SK7KXOXTL4GPVK3JGRGDINJN57USLVX53T6TA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.071430701 (458h12m34.942513736s) [noise=true , address=45.91.116.14:4191 , piece_id=PZSZV2XFKZOJ5W5HP22PWW776L4ATWJZBEEQTJV6JEHYSIKBS35Q, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.071491077 (458h12m34.942574112s) [noise=true , address=145.79.227.50:4374 , piece_id=MA5VLFQAK6U245SGQR5UODBBIQD7CPICYCYTM5SL3GMCLXURWZ7A, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.072542138 (458h12m34.943625183s) [noise=true , address=145.79.227.52:4446 , piece_id=NJF5KORJX4IZ2VFF3I7GTKELUFDRCZMZK2GZOUNFPURAPUDT47YQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.072669880 (458h12m34.943752925s) [noise=true , address=145.79.227.33:4869 , piece_id=VVRKB2PIP4RRW4DZ3OA67MRRVCKPTACQPY633LHHLLZBUNVPKJGQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.073725251 (458h12m34.944808286s) [noise=true , address=145.79.227.38:4979 , piece_id=3SSLNJ545M7DSFJWO2V7K4AOQMXIXQUAXOAOQIX6NP757T22VWGA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.075362869 (458h12m34.946445904s) [noise=true , address=145.79.227.46:4603 , piece_id=ILEBQVEFNXVBYTGLFBMG4BRO3HNAJ5GYPH53IQF2V7RRSOLHFIQQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:36.870712973 (458h12m36.741796018s) [upload=402229]: Next returned nil segment Dec 24 17:41:36.870729545 (458h12m36.74181258s) [upload=402229]: Waiting for error group managing segments... Dec 24 17:41:37.160017607 (458h12m37.031100642s) [noise=true , address=145.79.227.32:4834 , piece_id=OI4HEZS66F5LGW33SYDOAD4CDE47KP3MZ3C53BLTJWTV7D6AYK6Q, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.172949711 (458h12m37.044032757s) [noise=true , address=145.79.227.45:4231 , piece_id=O2RJOW4SBW2XC3PJ5XJ5NLPCTUZXQQBYZDGOBX3YZTW6FDVTOFMA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.183665827 (458h12m37.054748862s) [noise=true , address=145.79.227.50:4374 , piece_id=MA5VLFQAK6U245SGQR5UODBBIQD7CPICYCYTM5SL3GMCLXURWZ7A, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.245183227 (458h12m37.116266262s) [noise=true , address=145.79.227.7:4294 , piece_id=RAWBIZM3YPIHZ64SK7KXOXTL4GPVK3JGRGDINJN57USLVX53T6TA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.324356015 (458h12m37.19543905s) [noise=true , address=45.91.116.14:4191 , piece_id=PZSZV2XFKZOJ5W5HP22PWW776L4ATWJZBEEQTJV6JEHYSIKBS35Q, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.442771707 (458h12m37.313854752s) [noise=true , address=45.91.116.11:4117 , piece_id=IMHTEB3WAFAO6554DFSOVOLTOIU65TI6KQSBEJNVP4W3M6STQYDA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.478430989 (458h12m37.349514054s) [noise=true , address=145.79.227.51:4411 , piece_id=3RKCEBKZSY2MSVPVE7CBSF32WX7APWEIGNX6QRZ6KEN3NYGIMBCQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.926537889 (458h12m37.797620924s) [noise=true , address=145.79.227.33:4869 , piece_id=VVRKB2PIP4RRW4DZ3OA67MRRVCKPTACQPY633LHHLLZBUNVPKJGQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.187478223 (458h12m38.058561268s) [noise=true , address=145.79.227.52:4446 , piece_id=NJF5KORJX4IZ2VFF3I7GTKELUFDRCZMZK2GZOUNFPURAPUDT47YQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.189416954 (458h12m38.060499999s) [noise=true , address=145.79.227.46:4603 , piece_id=ILEBQVEFNXVBYTGLFBMG4BRO3HNAJ5GYPH53IQF2V7RRSOLHFIQQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.202496650 (458h12m38.073579685s) [noise=true , address=145.79.227.38:4979 , piece_id=3SSLNJ545M7DSFJWO2V7K4AOQMXIXQUAXOAOQIX6NP757T22VWGA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.237024437 (458h12m38.108107492s) [noise=true , address=145.79.227.4:4187 , piece_id=IAJZIMUQQETQWLVZX6J2UU6RBBHHL5IZNOEBRLV5ZDE6A5MOPEYQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:42:04.130206679 (458h13m4.001289724s) [noise=true , address=145.79.227.49:4339 , piece_id=HBGK2U2V2OIPYUOBXJPV7O7FCP2TB2MAB44WRQSO4R7FYOHV3ROA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection; write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection Dec 24 17:42:04.130319203 (458h13m4.001402248s) [noise=true , address=145.79.227.11:4730 , piece_id=BNYY6GVOVFYX6YSQR7F23ASYKM5SJWHGK5NQIYTDMO3SGIXU6TNQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection Dec 24 17:42:04.130411048 (458h13m4.001494083s) [noise=true , address=145.79.227.37:4566 , piece_id=JMK6ZS4UFM3ETIID532YYHTAO2CIYHEJBEU4Z3LLT32J6QL5VY5A, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:1SaNJZaVix7BSbEWhu2Vmt3XjDDWCsQ8wTSiFR7MQ8oGwD9N2F, address:145.79.227.37:4566): protocol: write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection; write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection Dec 24 17:42:04.130495238 (458h13m4.001578283s) [noise=true , address=145.79.227.29:4941 , piece_id=T3QBPFJWPSOCGUJ6C4RC3YGRTTVIDHCUKKL6GYAJRNREPIUM2OCA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:125fn3wMJUNjsKTgsssLJkZAobCbaAS9jC2VyxXxbUA2ei4Gjni, address:145.79.227.29:4941): protocol: write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection; write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection Dec 24 17:42:04.130522550 (458h13m4.001605595s) [seg_pos={0 0}, upload=402229]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 24 17:42:04.370980973 (458h13m4.242064028s) [upload=402229]: Done uploading segments... Dec 24 17:42:04.371031650 (458h13m4.242114695s) [upload=402229]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 5.826039494s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.244015061s trace: https://jaeger.dev.storj.io/trace/64a70b063120f6ff FAIL (2025-12-24 17:42:04 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 12) ======LOGS====== Dec 24 17:41:34.817232055 (458h12m34.68831509s) [upload=402229]: Starting upload Dec 24 17:41:34.817285716 (458h12m34.688368751s) [upload=402229]: Done starting upload Dec 24 17:41:34.817371771 (458h12m34.688454806s) [upload=402229]: Uploading segments... Dec 24 17:41:34.817473855 (458h12m34.68855689s) [upload=402229]: Got next segment. Inline: false Dec 24 17:41:34.817508080 (458h12m34.688591115s) [upload=402229]: Flush batch item: pb.BatchRequestItem_ObjectBegin Dec 24 17:41:34.817512659 (458h12m34.688595694s) [upload=402229]: Flush batch item: pb.BatchRequestItem_SegmentBegin Dec 24 17:41:35.067154038 (458h12m34.938237083s) [seg_pos={0 0}, upload=402229]: Begin upload segment... Dec 24 17:41:35.067209534 (458h12m34.938292579s) [seg_pos={0 0}, upload=402229]: Done begin upload segment. Dec 24 17:41:35.067237456 (458h12m34.938320491s) [noise=true , address=145.79.227.45:4231 , piece_id=O2RJOW4SBW2XC3PJ5XJ5NLPCTUZXQQBYZDGOBX3YZTW6FDVTOFMA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.067270990 (458h12m34.938354025s) [noise=true , address=145.79.227.51:4411 , piece_id=3RKCEBKZSY2MSVPVE7CBSF32WX7APWEIGNX6QRZ6KEN3NYGIMBCQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.067737579 (458h12m34.938820624s) [noise=true , address=145.79.227.37:4566 , piece_id=JMK6ZS4UFM3ETIID532YYHTAO2CIYHEJBEU4Z3LLT32J6QL5VY5A, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068069410 (458h12m34.939152455s) [noise=true , address=145.79.227.11:4730 , piece_id=BNYY6GVOVFYX6YSQR7F23ASYKM5SJWHGK5NQIYTDMO3SGIXU6TNQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068471236 (458h12m34.939554281s) [noise=true , address=145.79.227.32:4834 , piece_id=OI4HEZS66F5LGW33SYDOAD4CDE47KP3MZ3C53BLTJWTV7D6AYK6Q, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.068826392 (458h12m34.939909437s) [noise=true , address=145.79.227.29:4941 , piece_id=T3QBPFJWPSOCGUJ6C4RC3YGRTTVIDHCUKKL6GYAJRNREPIUM2OCA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069118318 (458h12m34.940201353s) [noise=true , address=145.79.227.4:4187 , piece_id=IAJZIMUQQETQWLVZX6J2UU6RBBHHL5IZNOEBRLV5ZDE6A5MOPEYQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069520844 (458h12m34.94060389s) [noise=true , address=45.91.116.11:4117 , piece_id=IMHTEB3WAFAO6554DFSOVOLTOIU65TI6KQSBEJNVP4W3M6STQYDA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.069964640 (458h12m34.941047675s) [noise=true , address=145.79.227.49:4339 , piece_id=HBGK2U2V2OIPYUOBXJPV7O7FCP2TB2MAB44WRQSO4R7FYOHV3ROA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.070342990 (458h12m34.941426035s) [noise=true , address=145.79.227.7:4294 , piece_id=RAWBIZM3YPIHZ64SK7KXOXTL4GPVK3JGRGDINJN57USLVX53T6TA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.071430701 (458h12m34.942513736s) [noise=true , address=45.91.116.14:4191 , piece_id=PZSZV2XFKZOJ5W5HP22PWW776L4ATWJZBEEQTJV6JEHYSIKBS35Q, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.071491077 (458h12m34.942574112s) [noise=true , address=145.79.227.50:4374 , piece_id=MA5VLFQAK6U245SGQR5UODBBIQD7CPICYCYTM5SL3GMCLXURWZ7A, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.072542138 (458h12m34.943625183s) [noise=true , address=145.79.227.52:4446 , piece_id=NJF5KORJX4IZ2VFF3I7GTKELUFDRCZMZK2GZOUNFPURAPUDT47YQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.072669880 (458h12m34.943752925s) [noise=true , address=145.79.227.33:4869 , piece_id=VVRKB2PIP4RRW4DZ3OA67MRRVCKPTACQPY633LHHLLZBUNVPKJGQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.073725251 (458h12m34.944808286s) [noise=true , address=145.79.227.38:4979 , piece_id=3SSLNJ545M7DSFJWO2V7K4AOQMXIXQUAXOAOQIX6NP757T22VWGA, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:35.075362869 (458h12m34.946445904s) [noise=true , address=145.79.227.46:4603 , piece_id=ILEBQVEFNXVBYTGLFBMG4BRO3HNAJ5GYPH53IQF2V7RRSOLHFIQQ, seg_pos={0 0}, upload=402229]: Uploading piece... Dec 24 17:41:36.870712973 (458h12m36.741796018s) [upload=402229]: Next returned nil segment Dec 24 17:41:36.870729545 (458h12m36.74181258s) [upload=402229]: Waiting for error group managing segments... Dec 24 17:41:37.160017607 (458h12m37.031100642s) [noise=true , address=145.79.227.32:4834 , piece_id=OI4HEZS66F5LGW33SYDOAD4CDE47KP3MZ3C53BLTJWTV7D6AYK6Q, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.172949711 (458h12m37.044032757s) [noise=true , address=145.79.227.45:4231 , piece_id=O2RJOW4SBW2XC3PJ5XJ5NLPCTUZXQQBYZDGOBX3YZTW6FDVTOFMA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.183665827 (458h12m37.054748862s) [noise=true , address=145.79.227.50:4374 , piece_id=MA5VLFQAK6U245SGQR5UODBBIQD7CPICYCYTM5SL3GMCLXURWZ7A, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.245183227 (458h12m37.116266262s) [noise=true , address=145.79.227.7:4294 , piece_id=RAWBIZM3YPIHZ64SK7KXOXTL4GPVK3JGRGDINJN57USLVX53T6TA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.324356015 (458h12m37.19543905s) [noise=true , address=45.91.116.14:4191 , piece_id=PZSZV2XFKZOJ5W5HP22PWW776L4ATWJZBEEQTJV6JEHYSIKBS35Q, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.442771707 (458h12m37.313854752s) [noise=true , address=45.91.116.11:4117 , piece_id=IMHTEB3WAFAO6554DFSOVOLTOIU65TI6KQSBEJNVP4W3M6STQYDA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.478430989 (458h12m37.349514054s) [noise=true , address=145.79.227.51:4411 , piece_id=3RKCEBKZSY2MSVPVE7CBSF32WX7APWEIGNX6QRZ6KEN3NYGIMBCQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:37.926537889 (458h12m37.797620924s) [noise=true , address=145.79.227.33:4869 , piece_id=VVRKB2PIP4RRW4DZ3OA67MRRVCKPTACQPY633LHHLLZBUNVPKJGQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.187478223 (458h12m38.058561268s) [noise=true , address=145.79.227.52:4446 , piece_id=NJF5KORJX4IZ2VFF3I7GTKELUFDRCZMZK2GZOUNFPURAPUDT47YQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.189416954 (458h12m38.060499999s) [noise=true , address=145.79.227.46:4603 , piece_id=ILEBQVEFNXVBYTGLFBMG4BRO3HNAJ5GYPH53IQF2V7RRSOLHFIQQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.202496650 (458h12m38.073579685s) [noise=true , address=145.79.227.38:4979 , piece_id=3SSLNJ545M7DSFJWO2V7K4AOQMXIXQUAXOAOQIX6NP757T22VWGA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:41:38.237024437 (458h12m38.108107492s) [noise=true , address=145.79.227.4:4187 , piece_id=IAJZIMUQQETQWLVZX6J2UU6RBBHHL5IZNOEBRLV5ZDE6A5MOPEYQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: <nil> Dec 24 17:42:04.130206679 (458h13m4.001289724s) [noise=true , address=145.79.227.49:4339 , piece_id=HBGK2U2V2OIPYUOBXJPV7O7FCP2TB2MAB44WRQSO4R7FYOHV3ROA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:124ACRNWgJYWgCVsDkXchmT47DiUcgvtZcdGo2MzyVqZkPjyz1R, address:145.79.227.49:4339): protocol: write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection; write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:37998->145.79.227.49:4339: use of closed network connection Dec 24 17:42:04.130319203 (458h13m4.001402248s) [noise=true , address=145.79.227.11:4730 , piece_id=BNYY6GVOVFYX6YSQR7F23ASYKM5SJWHGK5NQIYTDMO3SGIXU6TNQ, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:12T7G85LguKGbxuMDp5u7q1j3TWc1ERBH6YgynJhE5NzzcyuMom, address:145.79.227.11:4730): protocol: write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection; write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43852->145.79.227.11:4730: use of closed network connection Dec 24 17:42:04.130411048 (458h13m4.001494083s) [noise=true , address=145.79.227.37:4566 , piece_id=JMK6ZS4UFM3ETIID532YYHTAO2CIYHEJBEU4Z3LLT32J6QL5VY5A, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:1SaNJZaVix7BSbEWhu2Vmt3XjDDWCsQ8wTSiFR7MQ8oGwD9N2F, address:145.79.227.37:4566): protocol: write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection; write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:44142->145.79.227.37:4566: use of closed network connection Dec 24 17:42:04.130495238 (458h13m4.001578283s) [noise=true , address=145.79.227.29:4941 , piece_id=T3QBPFJWPSOCGUJ6C4RC3YGRTTVIDHCUKKL6GYAJRNREPIUM2OCA, seg_pos={0 0}, upload=402229]: Done uploading piece. err: ecclient: upload failed (node:125fn3wMJUNjsKTgsssLJkZAobCbaAS9jC2VyxXxbUA2ei4Gjni, address:145.79.227.29:4941): protocol: write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection; write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40326->145.79.227.29:4941: use of closed network connection Dec 24 17:42:04.130522550 (458h13m4.001605595s) [seg_pos={0 0}, upload=402229]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil> Dec 24 17:42:04.370980973 (458h13m4.242064028s) [upload=402229]: Done uploading segments... Dec 24 17:42:04.371031650 (458h13m4.242114695s) [upload=402229]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12) Duration: 30.244035399s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [X...........................................................] duration: 3.668834699s trace: https://jaeger.dev.storj.io/trace/4ac66b41ae7e595a FAIL (2025-12-24 17:40:02 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.668863727s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.X..........................................................] duration: 3.386122258s trace: https://jaeger.dev.storj.io/trace/4ac66b41ae7e595a FAIL (2025-12-24 17:39:27 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.38614908s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..X.........................................................] duration: 3.601399932s trace: https://jaeger.dev.storj.io/trace/4ac66b41ae7e595a FAIL (2025-12-24 17:38:21 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.601453413s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [...X........................................................] duration: 3.763606313s trace: https://jaeger.dev.storj.io/trace/4ac66b41ae7e595a FAIL (2025-12-24 17:37:09 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.763638023s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [....X.......................................................] duration: 3.658526704s trace: https://jaeger.dev.storj.io/trace/4ac66b41ae7e595a FAIL (2025-12-24 17:36:21 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.658553624s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.....X......................................................] duration: 3.582724402s trace: https://jaeger.dev.storj.io/trace/4ac66b41ae7e595a FAIL (2025-12-24 17:35:28 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.582764147s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [......X.....................................................] duration: 3.690601056s trace: https://jaeger.dev.storj.io/trace/4ac66b41ae7e595a FAIL (2025-12-24 17:34:50 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.690639419s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.......X....................................................] duration: 3.528745544s trace: https://jaeger.dev.storj.io/trace/4ac66b41ae7e595a FAIL (2025-12-24 17:33:46 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.528771775s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.40016408s trace: https://jaeger.dev.storj.io/trace/13373403d5a918ad FAIL (2025-12-24 17:33:38 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.400201802s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.374821443s trace: https://jaeger.dev.storj.io/trace/13373403d5a918ad FAIL (2025-12-24 17:32:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.374849726s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [........X...................................................] duration: 3.399233425s trace: https://jaeger.dev.storj.io/trace/4ac66b41ae7e595a FAIL (2025-12-24 17:32:46 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.399259294s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.256446288s trace: https://jaeger.dev.storj.io/trace/13373403d5a918ad FAIL (2025-12-24 17:32:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.256479411s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [.........X..................................................] duration: 3.640128238s trace: https://jaeger.dev.storj.io/trace/4ac66b41ae7e595a FAIL (2025-12-24 17:31:52 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.640154419s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.434793022s trace: https://jaeger.dev.storj.io/trace/13373403d5a918ad FAIL (2025-12-24 17:31:16 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.434825734s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 1 out of 60 is failed (threshold=6) [..........X.................................................] duration: 3.484371513s trace: https://jaeger.dev.storj.io/trace/4ac66b41ae7e595a FAIL (2025-12-24 17:30:56 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.484399385s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.454240813s trace: https://jaeger.dev.storj.io/trace/13373403d5a918ad FAIL (2025-12-24 17:30:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.454270941s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [X..........X................................................] duration: 3.512755749s trace: https://jaeger.dev.storj.io/trace/4ac66b41ae7e595a FAIL (2025-12-24 17:30:18 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.512786806s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 6.171332709s trace: https://jaeger.dev.storj.io/trace/40deea8737f451c6 FAIL (2025-12-24 17:30:16 UTC) orbiter warning: context deadline exceeded Duration: 6.171455764s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.X..........X...............................................] duration: 3.499476103s trace: https://jaeger.dev.storj.io/trace/4ac66b41ae7e595a FAIL (2025-12-24 17:29:58 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.499503425s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.736310917s trace: https://jaeger.dev.storj.io/trace/40deea8737f451c6 FAIL (2025-12-24 17:29:57 UTC) orbiter warning: context deadline exceeded Duration: 5.736336026s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.922246188s trace: https://jaeger.dev.storj.io/trace/40deea8737f451c6 FAIL (2025-12-24 17:29:20 UTC) orbiter warning: context deadline exceeded Duration: 5.92230004s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.265519245s trace: https://jaeger.dev.storj.io/trace/13373403d5a918ad FAIL (2025-12-24 17:29:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.265544485s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.95194083s trace: https://jaeger.dev.storj.io/trace/4678fa68e097e01a FAIL (2025-12-24 17:29:04 UTC) orbiter warning: context deadline exceeded Duration: 5.951978291s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [..X..........X..............................................] duration: 3.44621845s trace: https://jaeger.dev.storj.io/trace/4ac66b41ae7e595a FAIL (2025-12-24 17:29:04 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.446254109s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [...X..........X.............................................] duration: 3.401583479s trace: https://jaeger.dev.storj.io/trace/4ac66b41ae7e595a FAIL (2025-12-24 17:28:22 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.401615942s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.439964046s trace: https://jaeger.dev.storj.io/trace/13373403d5a918ad FAIL (2025-12-24 17:28:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.439987812s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.787548873s trace: https://jaeger.dev.storj.io/trace/40deea8737f451c6 FAIL (2025-12-24 17:28:13 UTC) orbiter warning: context deadline exceeded Duration: 5.7875741s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 6.324125864s trace: https://jaeger.dev.storj.io/trace/4678fa68e097e01a FAIL (2025-12-24 17:28:10 UTC) orbiter warning: context deadline exceeded Duration: 6.324163136s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [....X..........X............................................] duration: 3.457406787s trace: https://jaeger.dev.storj.io/trace/4ac66b41ae7e595a FAIL (2025-12-24 17:27:49 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.457432225s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 6.421476614s trace: https://jaeger.dev.storj.io/trace/4678fa68e097e01a FAIL (2025-12-24 17:27:36 UTC) orbiter warning: context deadline exceeded Duration: 6.421513034s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [.....X..........X...........................................] duration: 3.592332817s trace: https://jaeger.dev.storj.io/trace/4ac66b41ae7e595a FAIL (2025-12-24 17:27:17 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.592355019s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.277871394s trace: https://jaeger.dev.storj.io/trace/13373403d5a918ad FAIL (2025-12-24 17:27:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.27790035s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.682163331s trace: https://jaeger.dev.storj.io/trace/40deea8737f451c6 FAIL (2025-12-24 17:27:14 UTC) orbiter warning: context deadline exceeded Duration: 5.682195192s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 6.082998878s trace: https://jaeger.dev.storj.io/trace/4678fa68e097e01a FAIL (2025-12-24 17:27:07 UTC) orbiter warning: context deadline exceeded Duration: 6.083030528s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 6.297506687s trace: https://jaeger.dev.storj.io/trace/4678fa68e097e01a FAIL (2025-12-24 17:26:49 UTC) orbiter warning: context deadline exceeded Duration: 6.297535021s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.468324677s trace: https://jaeger.dev.storj.io/trace/13373403d5a918ad FAIL (2025-12-24 17:26:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.468348193s edge gateway us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.860149182s trace: https://jaeger.dev.storj.io/trace/40deea8737f451c6 FAIL (2025-12-24 17:26:38 UTC) orbiter warning: context deadline exceeded Duration: 5.860174492s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/50kb", Size: 50.0 KiB} failure (antiblip window 6/60): (gateway.us1.placement_20_thumbnails) antiblip: 2 out of 60 is failed (threshold=6) [......X..........X..........................................] duration: 3.439374839s trace: https://jaeger.dev.storj.io/trace/4ac66b41ae7e595a FAIL (2025-12-24 17:26:18 UTC) orbiter warning: operation error S3: GetObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 3.439401498s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 6.212195949s trace: https://jaeger.dev.storj.io/trace/40deea8737f451c6 FAIL (2025-12-24 17:26:16 UTC) orbiter warning: context deadline exceeded Duration: 6.212222751s core uplink us-select-1 us1-placement-20

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)