Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.719623114s FAIL (2025-07-16 12:58:54 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== upload Jul 16 12:49:54.454430745 (555h39m29.22507217s) [upload=444362]: Uploading segments... Jul 16 12:49:54.454612783 (555h39m29.225254118s) [upload=444362]: Got next segment. Inline: false Jul 16 12:49:54.454649724 (555h39m29.225291059s) [upload=444362]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 12:49:54.454655314 (555h39m29.225296649s) [upload=444362]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 12:49:54.699076943 (555h39m29.469718278s) [seg_pos={0 0}, upload=444362]: Begin upload segment... Jul 16 12:49:54.699118793 (555h39m29.469760118s) [seg_pos={0 0}, upload=444362]: Done begin upload segment. Jul 16 12:49:54.699140215 (555h39m29.46978155s) [noise=true , address=77.90.31.11:4554 , piece_id=Z7BVO6PA7T56XUMN64H4RSSPTQLRTAMZXSKMDG2HMTYKQ2MR6IFA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699150905 (555h39m29.46979224s) [noise=true , address=45.91.116.13:4153 , piece_id=MVZ7IWOC76WEB7FLAEBYEXGGFKUF7ETEIE5NEVV6VXXYCBY5E2HA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699200289 (555h39m29.469841614s) [noise=true , address=104.36.82.4:4802 , piece_id=DP3RGIYNJD7B2RGC75JDLDHSZPZFFWE2XINJ2OWEYLRJZITZKH3Q, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699491557 (555h39m29.470132892s) [noise=true , address=77.90.31.19:4843 , piece_id=S2PNAQ4O6TNV7J4D4MR7XLVYSN7K5MTR2R2NZHZWAVKFTZTQOJ6Q, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699533877 (555h39m29.470175203s) [noise=true , address=45.91.116.10:4083 , piece_id=TRF2LD6QTPGSJ6H3ZBO6ZA2BX3ZGUDK5PBZYXNGHUCHSTBDN5GTA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699737808 (555h39m29.470379143s) [noise=true , address=77.90.31.18:4805 , piece_id=M72AUALYTYA5JSCFKBD6KQJMJMRCWVHNKLLOUA5HWFVD7ROXOIQQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699859721 (555h39m29.470501056s) [noise=true , address=77.90.31.18:4807 , piece_id=75JF6AQRMDV6EBZYPMYAVU6OIJOQF6VWCU7GKHLAFOJLOTWT46MQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700001562 (555h39m29.470642887s) [noise=true , address=45.91.116.4:4940 , piece_id=RBCXABGY54Q6NUYS4HBJYUO735G5KEXFHMFDB7A43OLUMSTBVASA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700262442 (555h39m29.470903787s) [noise=true , address=45.91.116.11:4119 , piece_id=YLYQYUSQQ3XFGQHATLKSMAKMEEZIJXSFGRHDNST3WPOWO7Z3D6QA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700465520 (555h39m29.471106855s) [noise=true , address=45.91.116.9:4261 , piece_id=WZ7JMCI4O7FLMUZ3DFMOXW5SJBB24OCN6ZMKLLGJVFJZYCZULGVQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700614956 (555h39m29.471256291s) [noise=true , address=45.91.116.12:4227 , piece_id=4VO2V6QRBIZK2MTURBDDY2NEJJ65MKR3JUINMZURAZNMBZMY6HNQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700835788 (555h39m29.471477113s) [noise=true , address=45.91.116.5:4297 , piece_id=YKATWUFEURM2TFYRRS32RYWORAIE6DQJDMSD2G5VJNVCR2TOANAQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701059667 (555h39m29.471700992s) [noise=true , address=77.90.31.14:4661 , piece_id=QJLO67GGOMAQKSMENVTF464Y65K6C3U5VTZ4R6QRTT26KV6G3TOQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701294466 (555h39m29.471935811s) [noise=true , address=77.90.31.13:4626 , piece_id=KPYO6FJN4CRMPASUY7QNVR7LGOEWJSOIN77QWYH6NQO5WEFJSUEQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701455474 (555h39m29.472096809s) [noise=true , address=45.91.116.10:4081 , piece_id=BLFVTGDFICTNBQLP5PDH3DWIS4JJYVKTD4Z4ADYWVOS62A23I2QQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701695604 (555h39m29.472336939s) [noise=true , address=45.91.116.8:4045 , piece_id=775P4F74ENG2MPEESXVP4E2YRUVIPAYFYJ7BRCKD6LFSDMWCFDTA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:56.462804855 (555h39m31.23344618s) [upload=444362]: Next returned nil segment Jul 16 12:49:56.462827357 (555h39m31.233468692s) [upload=444362]: Waiting for error group managing segments... Jul 16 12:49:56.744618805 (555h39m31.51526014s) [noise=true , address=45.91.116.10:4083 , piece_id=TRF2LD6QTPGSJ6H3ZBO6ZA2BX3ZGUDK5PBZYXNGHUCHSTBDN5GTA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.753612183 (555h39m31.524253508s) [noise=true , address=45.91.116.11:4119 , piece_id=YLYQYUSQQ3XFGQHATLKSMAKMEEZIJXSFGRHDNST3WPOWO7Z3D6QA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.761769189 (555h39m31.532410524s) [noise=true , address=45.91.116.9:4261 , piece_id=WZ7JMCI4O7FLMUZ3DFMOXW5SJBB24OCN6ZMKLLGJVFJZYCZULGVQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.771222316 (555h39m31.541863651s) [noise=true , address=45.91.116.12:4227 , piece_id=4VO2V6QRBIZK2MTURBDDY2NEJJ65MKR3JUINMZURAZNMBZMY6HNQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.791205801 (555h39m31.561847136s) [noise=true , address=45.91.116.8:4045 , piece_id=775P4F74ENG2MPEESXVP4E2YRUVIPAYFYJ7BRCKD6LFSDMWCFDTA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.834418742 (555h39m31.605060077s) [noise=true , address=45.91.116.10:4081 , piece_id=BLFVTGDFICTNBQLP5PDH3DWIS4JJYVKTD4Z4ADYWVOS62A23I2QQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.838049959 (555h39m31.608691294s) [noise=true , address=45.91.116.13:4153 , piece_id=MVZ7IWOC76WEB7FLAEBYEXGGFKUF7ETEIE5NEVV6VXXYCBY5E2HA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.838929011 (555h39m31.609570346s) [noise=true , address=45.91.116.5:4297 , piece_id=YKATWUFEURM2TFYRRS32RYWORAIE6DQJDMSD2G5VJNVCR2TOANAQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.842586269 (555h39m31.613227604s) [noise=true , address=45.91.116.4:4940 , piece_id=RBCXABGY54Q6NUYS4HBJYUO735G5KEXFHMFDB7A43OLUMSTBVASA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.847874477 (555h39m31.618515812s) [noise=true , address=104.36.82.4:4802 , piece_id=DP3RGIYNJD7B2RGC75JDLDHSZPZFFWE2XINJ2OWEYLRJZITZKH3Q, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:50:23.796531007 (555h39m58.567172343s) [noise=true , address=77.90.31.18:4805 , piece_id=M72AUALYTYA5JSCFKBD6KQJMJMRCWVHNKLLOUA5HWFVD7ROXOIQQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 12:50:23.796638163 (555h39m58.567279498s) [noise=true , address=77.90.31.13:4626 , piece_id=KPYO6FJN4CRMPASUY7QNVR7LGOEWJSOIN77QWYH6NQO5WEFJSUEQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection Jul 16 12:50:23.796656157 (555h39m58.567297492s) [noise=true , address=77.90.31.19:4843 , piece_id=S2PNAQ4O6TNV7J4D4MR7XLVYSN7K5MTR2R2NZHZWAVKFTZTQOJ6Q, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection Jul 16 12:50:23.796682628 (555h39m58.567323963s) [noise=true , address=77.90.31.11:4554 , piece_id=Z7BVO6PA7T56XUMN64H4RSSPTQLRTAMZXSKMDG2HMTYKQ2MR6IFA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection Jul 16 12:50:23.796701113 (555h39m58.567342448s) [noise=true , address=77.90.31.14:4661 , piece_id=QJLO67GGOMAQKSMENVTF464Y65K6C3U5VTZ4R6QRTT26KV6G3TOQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 12:50:23.796730048 (555h39m58.567371383s) [noise=true , address=77.90.31.18:4807 , piece_id=75JF6AQRMDV6EBZYPMYAVU6OIJOQF6VWCU7GKHLAFOJLOTWT46MQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection; write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection Jul 16 12:50:23.796753904 (555h39m58.567395239s) [seg_pos={0 0}, upload=444362]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Jul 16 12:50:24.030501338 (555h39m58.801142683s) [upload=444362]: Done uploading segments... Jul 16 12:50:24.030531145 (555h39m58.80117248s) [upload=444362]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 5.719666377s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 29.849242381s FAIL (2025-07-16 12:58:23 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== upload Jul 16 12:49:54.454430745 (555h39m29.22507217s) [upload=444362]: Uploading segments... Jul 16 12:49:54.454612783 (555h39m29.225254118s) [upload=444362]: Got next segment. Inline: false Jul 16 12:49:54.454649724 (555h39m29.225291059s) [upload=444362]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 12:49:54.454655314 (555h39m29.225296649s) [upload=444362]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 12:49:54.699076943 (555h39m29.469718278s) [seg_pos={0 0}, upload=444362]: Begin upload segment... Jul 16 12:49:54.699118793 (555h39m29.469760118s) [seg_pos={0 0}, upload=444362]: Done begin upload segment. Jul 16 12:49:54.699140215 (555h39m29.46978155s) [noise=true , address=77.90.31.11:4554 , piece_id=Z7BVO6PA7T56XUMN64H4RSSPTQLRTAMZXSKMDG2HMTYKQ2MR6IFA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699150905 (555h39m29.46979224s) [noise=true , address=45.91.116.13:4153 , piece_id=MVZ7IWOC76WEB7FLAEBYEXGGFKUF7ETEIE5NEVV6VXXYCBY5E2HA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699200289 (555h39m29.469841614s) [noise=true , address=104.36.82.4:4802 , piece_id=DP3RGIYNJD7B2RGC75JDLDHSZPZFFWE2XINJ2OWEYLRJZITZKH3Q, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699491557 (555h39m29.470132892s) [noise=true , address=77.90.31.19:4843 , piece_id=S2PNAQ4O6TNV7J4D4MR7XLVYSN7K5MTR2R2NZHZWAVKFTZTQOJ6Q, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699533877 (555h39m29.470175203s) [noise=true , address=45.91.116.10:4083 , piece_id=TRF2LD6QTPGSJ6H3ZBO6ZA2BX3ZGUDK5PBZYXNGHUCHSTBDN5GTA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699737808 (555h39m29.470379143s) [noise=true , address=77.90.31.18:4805 , piece_id=M72AUALYTYA5JSCFKBD6KQJMJMRCWVHNKLLOUA5HWFVD7ROXOIQQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699859721 (555h39m29.470501056s) [noise=true , address=77.90.31.18:4807 , piece_id=75JF6AQRMDV6EBZYPMYAVU6OIJOQF6VWCU7GKHLAFOJLOTWT46MQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700001562 (555h39m29.470642887s) [noise=true , address=45.91.116.4:4940 , piece_id=RBCXABGY54Q6NUYS4HBJYUO735G5KEXFHMFDB7A43OLUMSTBVASA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700262442 (555h39m29.470903787s) [noise=true , address=45.91.116.11:4119 , piece_id=YLYQYUSQQ3XFGQHATLKSMAKMEEZIJXSFGRHDNST3WPOWO7Z3D6QA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700465520 (555h39m29.471106855s) [noise=true , address=45.91.116.9:4261 , piece_id=WZ7JMCI4O7FLMUZ3DFMOXW5SJBB24OCN6ZMKLLGJVFJZYCZULGVQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700614956 (555h39m29.471256291s) [noise=true , address=45.91.116.12:4227 , piece_id=4VO2V6QRBIZK2MTURBDDY2NEJJ65MKR3JUINMZURAZNMBZMY6HNQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700835788 (555h39m29.471477113s) [noise=true , address=45.91.116.5:4297 , piece_id=YKATWUFEURM2TFYRRS32RYWORAIE6DQJDMSD2G5VJNVCR2TOANAQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701059667 (555h39m29.471700992s) [noise=true , address=77.90.31.14:4661 , piece_id=QJLO67GGOMAQKSMENVTF464Y65K6C3U5VTZ4R6QRTT26KV6G3TOQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701294466 (555h39m29.471935811s) [noise=true , address=77.90.31.13:4626 , piece_id=KPYO6FJN4CRMPASUY7QNVR7LGOEWJSOIN77QWYH6NQO5WEFJSUEQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701455474 (555h39m29.472096809s) [noise=true , address=45.91.116.10:4081 , piece_id=BLFVTGDFICTNBQLP5PDH3DWIS4JJYVKTD4Z4ADYWVOS62A23I2QQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701695604 (555h39m29.472336939s) [noise=true , address=45.91.116.8:4045 , piece_id=775P4F74ENG2MPEESXVP4E2YRUVIPAYFYJ7BRCKD6LFSDMWCFDTA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:56.462804855 (555h39m31.23344618s) [upload=444362]: Next returned nil segment Jul 16 12:49:56.462827357 (555h39m31.233468692s) [upload=444362]: Waiting for error group managing segments... Jul 16 12:49:56.744618805 (555h39m31.51526014s) [noise=true , address=45.91.116.10:4083 , piece_id=TRF2LD6QTPGSJ6H3ZBO6ZA2BX3ZGUDK5PBZYXNGHUCHSTBDN5GTA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.753612183 (555h39m31.524253508s) [noise=true , address=45.91.116.11:4119 , piece_id=YLYQYUSQQ3XFGQHATLKSMAKMEEZIJXSFGRHDNST3WPOWO7Z3D6QA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.761769189 (555h39m31.532410524s) [noise=true , address=45.91.116.9:4261 , piece_id=WZ7JMCI4O7FLMUZ3DFMOXW5SJBB24OCN6ZMKLLGJVFJZYCZULGVQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.771222316 (555h39m31.541863651s) [noise=true , address=45.91.116.12:4227 , piece_id=4VO2V6QRBIZK2MTURBDDY2NEJJ65MKR3JUINMZURAZNMBZMY6HNQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.791205801 (555h39m31.561847136s) [noise=true , address=45.91.116.8:4045 , piece_id=775P4F74ENG2MPEESXVP4E2YRUVIPAYFYJ7BRCKD6LFSDMWCFDTA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.834418742 (555h39m31.605060077s) [noise=true , address=45.91.116.10:4081 , piece_id=BLFVTGDFICTNBQLP5PDH3DWIS4JJYVKTD4Z4ADYWVOS62A23I2QQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.838049959 (555h39m31.608691294s) [noise=true , address=45.91.116.13:4153 , piece_id=MVZ7IWOC76WEB7FLAEBYEXGGFKUF7ETEIE5NEVV6VXXYCBY5E2HA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.838929011 (555h39m31.609570346s) [noise=true , address=45.91.116.5:4297 , piece_id=YKATWUFEURM2TFYRRS32RYWORAIE6DQJDMSD2G5VJNVCR2TOANAQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.842586269 (555h39m31.613227604s) [noise=true , address=45.91.116.4:4940 , piece_id=RBCXABGY54Q6NUYS4HBJYUO735G5KEXFHMFDB7A43OLUMSTBVASA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.847874477 (555h39m31.618515812s) [noise=true , address=104.36.82.4:4802 , piece_id=DP3RGIYNJD7B2RGC75JDLDHSZPZFFWE2XINJ2OWEYLRJZITZKH3Q, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:50:23.796531007 (555h39m58.567172343s) [noise=true , address=77.90.31.18:4805 , piece_id=M72AUALYTYA5JSCFKBD6KQJMJMRCWVHNKLLOUA5HWFVD7ROXOIQQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 12:50:23.796638163 (555h39m58.567279498s) [noise=true , address=77.90.31.13:4626 , piece_id=KPYO6FJN4CRMPASUY7QNVR7LGOEWJSOIN77QWYH6NQO5WEFJSUEQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection Jul 16 12:50:23.796656157 (555h39m58.567297492s) [noise=true , address=77.90.31.19:4843 , piece_id=S2PNAQ4O6TNV7J4D4MR7XLVYSN7K5MTR2R2NZHZWAVKFTZTQOJ6Q, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection Jul 16 12:50:23.796682628 (555h39m58.567323963s) [noise=true , address=77.90.31.11:4554 , piece_id=Z7BVO6PA7T56XUMN64H4RSSPTQLRTAMZXSKMDG2HMTYKQ2MR6IFA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection Jul 16 12:50:23.796701113 (555h39m58.567342448s) [noise=true , address=77.90.31.14:4661 , piece_id=QJLO67GGOMAQKSMENVTF464Y65K6C3U5VTZ4R6QRTT26KV6G3TOQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 12:50:23.796730048 (555h39m58.567371383s) [noise=true , address=77.90.31.18:4807 , piece_id=75JF6AQRMDV6EBZYPMYAVU6OIJOQF6VWCU7GKHLAFOJLOTWT46MQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection; write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection Jul 16 12:50:23.796753904 (555h39m58.567395239s) [seg_pos={0 0}, upload=444362]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Jul 16 12:50:24.030501338 (555h39m58.801142683s) [upload=444362]: Done uploading segments... Jul 16 12:50:24.030531145 (555h39m58.80117248s) [upload=444362]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 29.849268089s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.692718549s FAIL (2025-07-16 12:56:49 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== upload Jul 16 12:49:54.454430745 (555h39m29.22507217s) [upload=444362]: Uploading segments... Jul 16 12:49:54.454612783 (555h39m29.225254118s) [upload=444362]: Got next segment. Inline: false Jul 16 12:49:54.454649724 (555h39m29.225291059s) [upload=444362]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 12:49:54.454655314 (555h39m29.225296649s) [upload=444362]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 12:49:54.699076943 (555h39m29.469718278s) [seg_pos={0 0}, upload=444362]: Begin upload segment... Jul 16 12:49:54.699118793 (555h39m29.469760118s) [seg_pos={0 0}, upload=444362]: Done begin upload segment. Jul 16 12:49:54.699140215 (555h39m29.46978155s) [noise=true , address=77.90.31.11:4554 , piece_id=Z7BVO6PA7T56XUMN64H4RSSPTQLRTAMZXSKMDG2HMTYKQ2MR6IFA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699150905 (555h39m29.46979224s) [noise=true , address=45.91.116.13:4153 , piece_id=MVZ7IWOC76WEB7FLAEBYEXGGFKUF7ETEIE5NEVV6VXXYCBY5E2HA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699200289 (555h39m29.469841614s) [noise=true , address=104.36.82.4:4802 , piece_id=DP3RGIYNJD7B2RGC75JDLDHSZPZFFWE2XINJ2OWEYLRJZITZKH3Q, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699491557 (555h39m29.470132892s) [noise=true , address=77.90.31.19:4843 , piece_id=S2PNAQ4O6TNV7J4D4MR7XLVYSN7K5MTR2R2NZHZWAVKFTZTQOJ6Q, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699533877 (555h39m29.470175203s) [noise=true , address=45.91.116.10:4083 , piece_id=TRF2LD6QTPGSJ6H3ZBO6ZA2BX3ZGUDK5PBZYXNGHUCHSTBDN5GTA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699737808 (555h39m29.470379143s) [noise=true , address=77.90.31.18:4805 , piece_id=M72AUALYTYA5JSCFKBD6KQJMJMRCWVHNKLLOUA5HWFVD7ROXOIQQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699859721 (555h39m29.470501056s) [noise=true , address=77.90.31.18:4807 , piece_id=75JF6AQRMDV6EBZYPMYAVU6OIJOQF6VWCU7GKHLAFOJLOTWT46MQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700001562 (555h39m29.470642887s) [noise=true , address=45.91.116.4:4940 , piece_id=RBCXABGY54Q6NUYS4HBJYUO735G5KEXFHMFDB7A43OLUMSTBVASA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700262442 (555h39m29.470903787s) [noise=true , address=45.91.116.11:4119 , piece_id=YLYQYUSQQ3XFGQHATLKSMAKMEEZIJXSFGRHDNST3WPOWO7Z3D6QA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700465520 (555h39m29.471106855s) [noise=true , address=45.91.116.9:4261 , piece_id=WZ7JMCI4O7FLMUZ3DFMOXW5SJBB24OCN6ZMKLLGJVFJZYCZULGVQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700614956 (555h39m29.471256291s) [noise=true , address=45.91.116.12:4227 , piece_id=4VO2V6QRBIZK2MTURBDDY2NEJJ65MKR3JUINMZURAZNMBZMY6HNQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700835788 (555h39m29.471477113s) [noise=true , address=45.91.116.5:4297 , piece_id=YKATWUFEURM2TFYRRS32RYWORAIE6DQJDMSD2G5VJNVCR2TOANAQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701059667 (555h39m29.471700992s) [noise=true , address=77.90.31.14:4661 , piece_id=QJLO67GGOMAQKSMENVTF464Y65K6C3U5VTZ4R6QRTT26KV6G3TOQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701294466 (555h39m29.471935811s) [noise=true , address=77.90.31.13:4626 , piece_id=KPYO6FJN4CRMPASUY7QNVR7LGOEWJSOIN77QWYH6NQO5WEFJSUEQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701455474 (555h39m29.472096809s) [noise=true , address=45.91.116.10:4081 , piece_id=BLFVTGDFICTNBQLP5PDH3DWIS4JJYVKTD4Z4ADYWVOS62A23I2QQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701695604 (555h39m29.472336939s) [noise=true , address=45.91.116.8:4045 , piece_id=775P4F74ENG2MPEESXVP4E2YRUVIPAYFYJ7BRCKD6LFSDMWCFDTA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:56.462804855 (555h39m31.23344618s) [upload=444362]: Next returned nil segment Jul 16 12:49:56.462827357 (555h39m31.233468692s) [upload=444362]: Waiting for error group managing segments... Jul 16 12:49:56.744618805 (555h39m31.51526014s) [noise=true , address=45.91.116.10:4083 , piece_id=TRF2LD6QTPGSJ6H3ZBO6ZA2BX3ZGUDK5PBZYXNGHUCHSTBDN5GTA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.753612183 (555h39m31.524253508s) [noise=true , address=45.91.116.11:4119 , piece_id=YLYQYUSQQ3XFGQHATLKSMAKMEEZIJXSFGRHDNST3WPOWO7Z3D6QA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.761769189 (555h39m31.532410524s) [noise=true , address=45.91.116.9:4261 , piece_id=WZ7JMCI4O7FLMUZ3DFMOXW5SJBB24OCN6ZMKLLGJVFJZYCZULGVQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.771222316 (555h39m31.541863651s) [noise=true , address=45.91.116.12:4227 , piece_id=4VO2V6QRBIZK2MTURBDDY2NEJJ65MKR3JUINMZURAZNMBZMY6HNQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.791205801 (555h39m31.561847136s) [noise=true , address=45.91.116.8:4045 , piece_id=775P4F74ENG2MPEESXVP4E2YRUVIPAYFYJ7BRCKD6LFSDMWCFDTA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.834418742 (555h39m31.605060077s) [noise=true , address=45.91.116.10:4081 , piece_id=BLFVTGDFICTNBQLP5PDH3DWIS4JJYVKTD4Z4ADYWVOS62A23I2QQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.838049959 (555h39m31.608691294s) [noise=true , address=45.91.116.13:4153 , piece_id=MVZ7IWOC76WEB7FLAEBYEXGGFKUF7ETEIE5NEVV6VXXYCBY5E2HA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.838929011 (555h39m31.609570346s) [noise=true , address=45.91.116.5:4297 , piece_id=YKATWUFEURM2TFYRRS32RYWORAIE6DQJDMSD2G5VJNVCR2TOANAQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.842586269 (555h39m31.613227604s) [noise=true , address=45.91.116.4:4940 , piece_id=RBCXABGY54Q6NUYS4HBJYUO735G5KEXFHMFDB7A43OLUMSTBVASA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.847874477 (555h39m31.618515812s) [noise=true , address=104.36.82.4:4802 , piece_id=DP3RGIYNJD7B2RGC75JDLDHSZPZFFWE2XINJ2OWEYLRJZITZKH3Q, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:50:23.796531007 (555h39m58.567172343s) [noise=true , address=77.90.31.18:4805 , piece_id=M72AUALYTYA5JSCFKBD6KQJMJMRCWVHNKLLOUA5HWFVD7ROXOIQQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 12:50:23.796638163 (555h39m58.567279498s) [noise=true , address=77.90.31.13:4626 , piece_id=KPYO6FJN4CRMPASUY7QNVR7LGOEWJSOIN77QWYH6NQO5WEFJSUEQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection Jul 16 12:50:23.796656157 (555h39m58.567297492s) [noise=true , address=77.90.31.19:4843 , piece_id=S2PNAQ4O6TNV7J4D4MR7XLVYSN7K5MTR2R2NZHZWAVKFTZTQOJ6Q, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection Jul 16 12:50:23.796682628 (555h39m58.567323963s) [noise=true , address=77.90.31.11:4554 , piece_id=Z7BVO6PA7T56XUMN64H4RSSPTQLRTAMZXSKMDG2HMTYKQ2MR6IFA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection Jul 16 12:50:23.796701113 (555h39m58.567342448s) [noise=true , address=77.90.31.14:4661 , piece_id=QJLO67GGOMAQKSMENVTF464Y65K6C3U5VTZ4R6QRTT26KV6G3TOQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 12:50:23.796730048 (555h39m58.567371383s) [noise=true , address=77.90.31.18:4807 , piece_id=75JF6AQRMDV6EBZYPMYAVU6OIJOQF6VWCU7GKHLAFOJLOTWT46MQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection; write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection Jul 16 12:50:23.796753904 (555h39m58.567395239s) [seg_pos={0 0}, upload=444362]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Jul 16 12:50:24.030501338 (555h39m58.801142683s) [upload=444362]: Done uploading segments... Jul 16 12:50:24.030531145 (555h39m58.80117248s) [upload=444362]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 5.692741251s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.742677054s FAIL (2025-07-16 12:55:34 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== upload Jul 16 12:49:54.454430745 (555h39m29.22507217s) [upload=444362]: Uploading segments... Jul 16 12:49:54.454612783 (555h39m29.225254118s) [upload=444362]: Got next segment. Inline: false Jul 16 12:49:54.454649724 (555h39m29.225291059s) [upload=444362]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 12:49:54.454655314 (555h39m29.225296649s) [upload=444362]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 12:49:54.699076943 (555h39m29.469718278s) [seg_pos={0 0}, upload=444362]: Begin upload segment... Jul 16 12:49:54.699118793 (555h39m29.469760118s) [seg_pos={0 0}, upload=444362]: Done begin upload segment. Jul 16 12:49:54.699140215 (555h39m29.46978155s) [noise=true , address=77.90.31.11:4554 , piece_id=Z7BVO6PA7T56XUMN64H4RSSPTQLRTAMZXSKMDG2HMTYKQ2MR6IFA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699150905 (555h39m29.46979224s) [noise=true , address=45.91.116.13:4153 , piece_id=MVZ7IWOC76WEB7FLAEBYEXGGFKUF7ETEIE5NEVV6VXXYCBY5E2HA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699200289 (555h39m29.469841614s) [noise=true , address=104.36.82.4:4802 , piece_id=DP3RGIYNJD7B2RGC75JDLDHSZPZFFWE2XINJ2OWEYLRJZITZKH3Q, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699491557 (555h39m29.470132892s) [noise=true , address=77.90.31.19:4843 , piece_id=S2PNAQ4O6TNV7J4D4MR7XLVYSN7K5MTR2R2NZHZWAVKFTZTQOJ6Q, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699533877 (555h39m29.470175203s) [noise=true , address=45.91.116.10:4083 , piece_id=TRF2LD6QTPGSJ6H3ZBO6ZA2BX3ZGUDK5PBZYXNGHUCHSTBDN5GTA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699737808 (555h39m29.470379143s) [noise=true , address=77.90.31.18:4805 , piece_id=M72AUALYTYA5JSCFKBD6KQJMJMRCWVHNKLLOUA5HWFVD7ROXOIQQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699859721 (555h39m29.470501056s) [noise=true , address=77.90.31.18:4807 , piece_id=75JF6AQRMDV6EBZYPMYAVU6OIJOQF6VWCU7GKHLAFOJLOTWT46MQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700001562 (555h39m29.470642887s) [noise=true , address=45.91.116.4:4940 , piece_id=RBCXABGY54Q6NUYS4HBJYUO735G5KEXFHMFDB7A43OLUMSTBVASA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700262442 (555h39m29.470903787s) [noise=true , address=45.91.116.11:4119 , piece_id=YLYQYUSQQ3XFGQHATLKSMAKMEEZIJXSFGRHDNST3WPOWO7Z3D6QA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700465520 (555h39m29.471106855s) [noise=true , address=45.91.116.9:4261 , piece_id=WZ7JMCI4O7FLMUZ3DFMOXW5SJBB24OCN6ZMKLLGJVFJZYCZULGVQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700614956 (555h39m29.471256291s) [noise=true , address=45.91.116.12:4227 , piece_id=4VO2V6QRBIZK2MTURBDDY2NEJJ65MKR3JUINMZURAZNMBZMY6HNQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700835788 (555h39m29.471477113s) [noise=true , address=45.91.116.5:4297 , piece_id=YKATWUFEURM2TFYRRS32RYWORAIE6DQJDMSD2G5VJNVCR2TOANAQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701059667 (555h39m29.471700992s) [noise=true , address=77.90.31.14:4661 , piece_id=QJLO67GGOMAQKSMENVTF464Y65K6C3U5VTZ4R6QRTT26KV6G3TOQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701294466 (555h39m29.471935811s) [noise=true , address=77.90.31.13:4626 , piece_id=KPYO6FJN4CRMPASUY7QNVR7LGOEWJSOIN77QWYH6NQO5WEFJSUEQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701455474 (555h39m29.472096809s) [noise=true , address=45.91.116.10:4081 , piece_id=BLFVTGDFICTNBQLP5PDH3DWIS4JJYVKTD4Z4ADYWVOS62A23I2QQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701695604 (555h39m29.472336939s) [noise=true , address=45.91.116.8:4045 , piece_id=775P4F74ENG2MPEESXVP4E2YRUVIPAYFYJ7BRCKD6LFSDMWCFDTA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:56.462804855 (555h39m31.23344618s) [upload=444362]: Next returned nil segment Jul 16 12:49:56.462827357 (555h39m31.233468692s) [upload=444362]: Waiting for error group managing segments... Jul 16 12:49:56.744618805 (555h39m31.51526014s) [noise=true , address=45.91.116.10:4083 , piece_id=TRF2LD6QTPGSJ6H3ZBO6ZA2BX3ZGUDK5PBZYXNGHUCHSTBDN5GTA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.753612183 (555h39m31.524253508s) [noise=true , address=45.91.116.11:4119 , piece_id=YLYQYUSQQ3XFGQHATLKSMAKMEEZIJXSFGRHDNST3WPOWO7Z3D6QA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.761769189 (555h39m31.532410524s) [noise=true , address=45.91.116.9:4261 , piece_id=WZ7JMCI4O7FLMUZ3DFMOXW5SJBB24OCN6ZMKLLGJVFJZYCZULGVQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.771222316 (555h39m31.541863651s) [noise=true , address=45.91.116.12:4227 , piece_id=4VO2V6QRBIZK2MTURBDDY2NEJJ65MKR3JUINMZURAZNMBZMY6HNQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.791205801 (555h39m31.561847136s) [noise=true , address=45.91.116.8:4045 , piece_id=775P4F74ENG2MPEESXVP4E2YRUVIPAYFYJ7BRCKD6LFSDMWCFDTA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.834418742 (555h39m31.605060077s) [noise=true , address=45.91.116.10:4081 , piece_id=BLFVTGDFICTNBQLP5PDH3DWIS4JJYVKTD4Z4ADYWVOS62A23I2QQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.838049959 (555h39m31.608691294s) [noise=true , address=45.91.116.13:4153 , piece_id=MVZ7IWOC76WEB7FLAEBYEXGGFKUF7ETEIE5NEVV6VXXYCBY5E2HA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.838929011 (555h39m31.609570346s) [noise=true , address=45.91.116.5:4297 , piece_id=YKATWUFEURM2TFYRRS32RYWORAIE6DQJDMSD2G5VJNVCR2TOANAQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.842586269 (555h39m31.613227604s) [noise=true , address=45.91.116.4:4940 , piece_id=RBCXABGY54Q6NUYS4HBJYUO735G5KEXFHMFDB7A43OLUMSTBVASA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.847874477 (555h39m31.618515812s) [noise=true , address=104.36.82.4:4802 , piece_id=DP3RGIYNJD7B2RGC75JDLDHSZPZFFWE2XINJ2OWEYLRJZITZKH3Q, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:50:23.796531007 (555h39m58.567172343s) [noise=true , address=77.90.31.18:4805 , piece_id=M72AUALYTYA5JSCFKBD6KQJMJMRCWVHNKLLOUA5HWFVD7ROXOIQQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 12:50:23.796638163 (555h39m58.567279498s) [noise=true , address=77.90.31.13:4626 , piece_id=KPYO6FJN4CRMPASUY7QNVR7LGOEWJSOIN77QWYH6NQO5WEFJSUEQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection Jul 16 12:50:23.796656157 (555h39m58.567297492s) [noise=true , address=77.90.31.19:4843 , piece_id=S2PNAQ4O6TNV7J4D4MR7XLVYSN7K5MTR2R2NZHZWAVKFTZTQOJ6Q, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection Jul 16 12:50:23.796682628 (555h39m58.567323963s) [noise=true , address=77.90.31.11:4554 , piece_id=Z7BVO6PA7T56XUMN64H4RSSPTQLRTAMZXSKMDG2HMTYKQ2MR6IFA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection Jul 16 12:50:23.796701113 (555h39m58.567342448s) [noise=true , address=77.90.31.14:4661 , piece_id=QJLO67GGOMAQKSMENVTF464Y65K6C3U5VTZ4R6QRTT26KV6G3TOQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 12:50:23.796730048 (555h39m58.567371383s) [noise=true , address=77.90.31.18:4807 , piece_id=75JF6AQRMDV6EBZYPMYAVU6OIJOQF6VWCU7GKHLAFOJLOTWT46MQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection; write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection Jul 16 12:50:23.796753904 (555h39m58.567395239s) [seg_pos={0 0}, upload=444362]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Jul 16 12:50:24.030501338 (555h39m58.801142683s) [upload=444362]: Done uploading segments... Jul 16 12:50:24.030531145 (555h39m58.80117248s) [upload=444362]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 5.742703705s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.725139828s FAIL (2025-07-16 12:54:27 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== upload Jul 16 12:49:54.454430745 (555h39m29.22507217s) [upload=444362]: Uploading segments... Jul 16 12:49:54.454612783 (555h39m29.225254118s) [upload=444362]: Got next segment. Inline: false Jul 16 12:49:54.454649724 (555h39m29.225291059s) [upload=444362]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 12:49:54.454655314 (555h39m29.225296649s) [upload=444362]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 12:49:54.699076943 (555h39m29.469718278s) [seg_pos={0 0}, upload=444362]: Begin upload segment... Jul 16 12:49:54.699118793 (555h39m29.469760118s) [seg_pos={0 0}, upload=444362]: Done begin upload segment. Jul 16 12:49:54.699140215 (555h39m29.46978155s) [noise=true , address=77.90.31.11:4554 , piece_id=Z7BVO6PA7T56XUMN64H4RSSPTQLRTAMZXSKMDG2HMTYKQ2MR6IFA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699150905 (555h39m29.46979224s) [noise=true , address=45.91.116.13:4153 , piece_id=MVZ7IWOC76WEB7FLAEBYEXGGFKUF7ETEIE5NEVV6VXXYCBY5E2HA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699200289 (555h39m29.469841614s) [noise=true , address=104.36.82.4:4802 , piece_id=DP3RGIYNJD7B2RGC75JDLDHSZPZFFWE2XINJ2OWEYLRJZITZKH3Q, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699491557 (555h39m29.470132892s) [noise=true , address=77.90.31.19:4843 , piece_id=S2PNAQ4O6TNV7J4D4MR7XLVYSN7K5MTR2R2NZHZWAVKFTZTQOJ6Q, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699533877 (555h39m29.470175203s) [noise=true , address=45.91.116.10:4083 , piece_id=TRF2LD6QTPGSJ6H3ZBO6ZA2BX3ZGUDK5PBZYXNGHUCHSTBDN5GTA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699737808 (555h39m29.470379143s) [noise=true , address=77.90.31.18:4805 , piece_id=M72AUALYTYA5JSCFKBD6KQJMJMRCWVHNKLLOUA5HWFVD7ROXOIQQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699859721 (555h39m29.470501056s) [noise=true , address=77.90.31.18:4807 , piece_id=75JF6AQRMDV6EBZYPMYAVU6OIJOQF6VWCU7GKHLAFOJLOTWT46MQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700001562 (555h39m29.470642887s) [noise=true , address=45.91.116.4:4940 , piece_id=RBCXABGY54Q6NUYS4HBJYUO735G5KEXFHMFDB7A43OLUMSTBVASA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700262442 (555h39m29.470903787s) [noise=true , address=45.91.116.11:4119 , piece_id=YLYQYUSQQ3XFGQHATLKSMAKMEEZIJXSFGRHDNST3WPOWO7Z3D6QA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700465520 (555h39m29.471106855s) [noise=true , address=45.91.116.9:4261 , piece_id=WZ7JMCI4O7FLMUZ3DFMOXW5SJBB24OCN6ZMKLLGJVFJZYCZULGVQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700614956 (555h39m29.471256291s) [noise=true , address=45.91.116.12:4227 , piece_id=4VO2V6QRBIZK2MTURBDDY2NEJJ65MKR3JUINMZURAZNMBZMY6HNQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700835788 (555h39m29.471477113s) [noise=true , address=45.91.116.5:4297 , piece_id=YKATWUFEURM2TFYRRS32RYWORAIE6DQJDMSD2G5VJNVCR2TOANAQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701059667 (555h39m29.471700992s) [noise=true , address=77.90.31.14:4661 , piece_id=QJLO67GGOMAQKSMENVTF464Y65K6C3U5VTZ4R6QRTT26KV6G3TOQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701294466 (555h39m29.471935811s) [noise=true , address=77.90.31.13:4626 , piece_id=KPYO6FJN4CRMPASUY7QNVR7LGOEWJSOIN77QWYH6NQO5WEFJSUEQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701455474 (555h39m29.472096809s) [noise=true , address=45.91.116.10:4081 , piece_id=BLFVTGDFICTNBQLP5PDH3DWIS4JJYVKTD4Z4ADYWVOS62A23I2QQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701695604 (555h39m29.472336939s) [noise=true , address=45.91.116.8:4045 , piece_id=775P4F74ENG2MPEESXVP4E2YRUVIPAYFYJ7BRCKD6LFSDMWCFDTA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:56.462804855 (555h39m31.23344618s) [upload=444362]: Next returned nil segment Jul 16 12:49:56.462827357 (555h39m31.233468692s) [upload=444362]: Waiting for error group managing segments... Jul 16 12:49:56.744618805 (555h39m31.51526014s) [noise=true , address=45.91.116.10:4083 , piece_id=TRF2LD6QTPGSJ6H3ZBO6ZA2BX3ZGUDK5PBZYXNGHUCHSTBDN5GTA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.753612183 (555h39m31.524253508s) [noise=true , address=45.91.116.11:4119 , piece_id=YLYQYUSQQ3XFGQHATLKSMAKMEEZIJXSFGRHDNST3WPOWO7Z3D6QA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.761769189 (555h39m31.532410524s) [noise=true , address=45.91.116.9:4261 , piece_id=WZ7JMCI4O7FLMUZ3DFMOXW5SJBB24OCN6ZMKLLGJVFJZYCZULGVQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.771222316 (555h39m31.541863651s) [noise=true , address=45.91.116.12:4227 , piece_id=4VO2V6QRBIZK2MTURBDDY2NEJJ65MKR3JUINMZURAZNMBZMY6HNQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.791205801 (555h39m31.561847136s) [noise=true , address=45.91.116.8:4045 , piece_id=775P4F74ENG2MPEESXVP4E2YRUVIPAYFYJ7BRCKD6LFSDMWCFDTA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.834418742 (555h39m31.605060077s) [noise=true , address=45.91.116.10:4081 , piece_id=BLFVTGDFICTNBQLP5PDH3DWIS4JJYVKTD4Z4ADYWVOS62A23I2QQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.838049959 (555h39m31.608691294s) [noise=true , address=45.91.116.13:4153 , piece_id=MVZ7IWOC76WEB7FLAEBYEXGGFKUF7ETEIE5NEVV6VXXYCBY5E2HA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.838929011 (555h39m31.609570346s) [noise=true , address=45.91.116.5:4297 , piece_id=YKATWUFEURM2TFYRRS32RYWORAIE6DQJDMSD2G5VJNVCR2TOANAQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.842586269 (555h39m31.613227604s) [noise=true , address=45.91.116.4:4940 , piece_id=RBCXABGY54Q6NUYS4HBJYUO735G5KEXFHMFDB7A43OLUMSTBVASA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.847874477 (555h39m31.618515812s) [noise=true , address=104.36.82.4:4802 , piece_id=DP3RGIYNJD7B2RGC75JDLDHSZPZFFWE2XINJ2OWEYLRJZITZKH3Q, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:50:23.796531007 (555h39m58.567172343s) [noise=true , address=77.90.31.18:4805 , piece_id=M72AUALYTYA5JSCFKBD6KQJMJMRCWVHNKLLOUA5HWFVD7ROXOIQQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 12:50:23.796638163 (555h39m58.567279498s) [noise=true , address=77.90.31.13:4626 , piece_id=KPYO6FJN4CRMPASUY7QNVR7LGOEWJSOIN77QWYH6NQO5WEFJSUEQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection Jul 16 12:50:23.796656157 (555h39m58.567297492s) [noise=true , address=77.90.31.19:4843 , piece_id=S2PNAQ4O6TNV7J4D4MR7XLVYSN7K5MTR2R2NZHZWAVKFTZTQOJ6Q, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection Jul 16 12:50:23.796682628 (555h39m58.567323963s) [noise=true , address=77.90.31.11:4554 , piece_id=Z7BVO6PA7T56XUMN64H4RSSPTQLRTAMZXSKMDG2HMTYKQ2MR6IFA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection Jul 16 12:50:23.796701113 (555h39m58.567342448s) [noise=true , address=77.90.31.14:4661 , piece_id=QJLO67GGOMAQKSMENVTF464Y65K6C3U5VTZ4R6QRTT26KV6G3TOQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 12:50:23.796730048 (555h39m58.567371383s) [noise=true , address=77.90.31.18:4807 , piece_id=75JF6AQRMDV6EBZYPMYAVU6OIJOQF6VWCU7GKHLAFOJLOTWT46MQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection; write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection Jul 16 12:50:23.796753904 (555h39m58.567395239s) [seg_pos={0 0}, upload=444362]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Jul 16 12:50:24.030501338 (555h39m58.801142683s) [upload=444362]: Done uploading segments... Jul 16 12:50:24.030531145 (555h39m58.80117248s) [upload=444362]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 5.725163463s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.680712444s FAIL (2025-07-16 12:53:38 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== upload Jul 16 12:49:54.454430745 (555h39m29.22507217s) [upload=444362]: Uploading segments... Jul 16 12:49:54.454612783 (555h39m29.225254118s) [upload=444362]: Got next segment. Inline: false Jul 16 12:49:54.454649724 (555h39m29.225291059s) [upload=444362]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 12:49:54.454655314 (555h39m29.225296649s) [upload=444362]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 12:49:54.699076943 (555h39m29.469718278s) [seg_pos={0 0}, upload=444362]: Begin upload segment... Jul 16 12:49:54.699118793 (555h39m29.469760118s) [seg_pos={0 0}, upload=444362]: Done begin upload segment. Jul 16 12:49:54.699140215 (555h39m29.46978155s) [noise=true , address=77.90.31.11:4554 , piece_id=Z7BVO6PA7T56XUMN64H4RSSPTQLRTAMZXSKMDG2HMTYKQ2MR6IFA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699150905 (555h39m29.46979224s) [noise=true , address=45.91.116.13:4153 , piece_id=MVZ7IWOC76WEB7FLAEBYEXGGFKUF7ETEIE5NEVV6VXXYCBY5E2HA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699200289 (555h39m29.469841614s) [noise=true , address=104.36.82.4:4802 , piece_id=DP3RGIYNJD7B2RGC75JDLDHSZPZFFWE2XINJ2OWEYLRJZITZKH3Q, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699491557 (555h39m29.470132892s) [noise=true , address=77.90.31.19:4843 , piece_id=S2PNAQ4O6TNV7J4D4MR7XLVYSN7K5MTR2R2NZHZWAVKFTZTQOJ6Q, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699533877 (555h39m29.470175203s) [noise=true , address=45.91.116.10:4083 , piece_id=TRF2LD6QTPGSJ6H3ZBO6ZA2BX3ZGUDK5PBZYXNGHUCHSTBDN5GTA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699737808 (555h39m29.470379143s) [noise=true , address=77.90.31.18:4805 , piece_id=M72AUALYTYA5JSCFKBD6KQJMJMRCWVHNKLLOUA5HWFVD7ROXOIQQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699859721 (555h39m29.470501056s) [noise=true , address=77.90.31.18:4807 , piece_id=75JF6AQRMDV6EBZYPMYAVU6OIJOQF6VWCU7GKHLAFOJLOTWT46MQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700001562 (555h39m29.470642887s) [noise=true , address=45.91.116.4:4940 , piece_id=RBCXABGY54Q6NUYS4HBJYUO735G5KEXFHMFDB7A43OLUMSTBVASA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700262442 (555h39m29.470903787s) [noise=true , address=45.91.116.11:4119 , piece_id=YLYQYUSQQ3XFGQHATLKSMAKMEEZIJXSFGRHDNST3WPOWO7Z3D6QA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700465520 (555h39m29.471106855s) [noise=true , address=45.91.116.9:4261 , piece_id=WZ7JMCI4O7FLMUZ3DFMOXW5SJBB24OCN6ZMKLLGJVFJZYCZULGVQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700614956 (555h39m29.471256291s) [noise=true , address=45.91.116.12:4227 , piece_id=4VO2V6QRBIZK2MTURBDDY2NEJJ65MKR3JUINMZURAZNMBZMY6HNQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700835788 (555h39m29.471477113s) [noise=true , address=45.91.116.5:4297 , piece_id=YKATWUFEURM2TFYRRS32RYWORAIE6DQJDMSD2G5VJNVCR2TOANAQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701059667 (555h39m29.471700992s) [noise=true , address=77.90.31.14:4661 , piece_id=QJLO67GGOMAQKSMENVTF464Y65K6C3U5VTZ4R6QRTT26KV6G3TOQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701294466 (555h39m29.471935811s) [noise=true , address=77.90.31.13:4626 , piece_id=KPYO6FJN4CRMPASUY7QNVR7LGOEWJSOIN77QWYH6NQO5WEFJSUEQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701455474 (555h39m29.472096809s) [noise=true , address=45.91.116.10:4081 , piece_id=BLFVTGDFICTNBQLP5PDH3DWIS4JJYVKTD4Z4ADYWVOS62A23I2QQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701695604 (555h39m29.472336939s) [noise=true , address=45.91.116.8:4045 , piece_id=775P4F74ENG2MPEESXVP4E2YRUVIPAYFYJ7BRCKD6LFSDMWCFDTA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:56.462804855 (555h39m31.23344618s) [upload=444362]: Next returned nil segment Jul 16 12:49:56.462827357 (555h39m31.233468692s) [upload=444362]: Waiting for error group managing segments... Jul 16 12:49:56.744618805 (555h39m31.51526014s) [noise=true , address=45.91.116.10:4083 , piece_id=TRF2LD6QTPGSJ6H3ZBO6ZA2BX3ZGUDK5PBZYXNGHUCHSTBDN5GTA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.753612183 (555h39m31.524253508s) [noise=true , address=45.91.116.11:4119 , piece_id=YLYQYUSQQ3XFGQHATLKSMAKMEEZIJXSFGRHDNST3WPOWO7Z3D6QA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.761769189 (555h39m31.532410524s) [noise=true , address=45.91.116.9:4261 , piece_id=WZ7JMCI4O7FLMUZ3DFMOXW5SJBB24OCN6ZMKLLGJVFJZYCZULGVQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.771222316 (555h39m31.541863651s) [noise=true , address=45.91.116.12:4227 , piece_id=4VO2V6QRBIZK2MTURBDDY2NEJJ65MKR3JUINMZURAZNMBZMY6HNQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.791205801 (555h39m31.561847136s) [noise=true , address=45.91.116.8:4045 , piece_id=775P4F74ENG2MPEESXVP4E2YRUVIPAYFYJ7BRCKD6LFSDMWCFDTA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.834418742 (555h39m31.605060077s) [noise=true , address=45.91.116.10:4081 , piece_id=BLFVTGDFICTNBQLP5PDH3DWIS4JJYVKTD4Z4ADYWVOS62A23I2QQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.838049959 (555h39m31.608691294s) [noise=true , address=45.91.116.13:4153 , piece_id=MVZ7IWOC76WEB7FLAEBYEXGGFKUF7ETEIE5NEVV6VXXYCBY5E2HA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.838929011 (555h39m31.609570346s) [noise=true , address=45.91.116.5:4297 , piece_id=YKATWUFEURM2TFYRRS32RYWORAIE6DQJDMSD2G5VJNVCR2TOANAQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.842586269 (555h39m31.613227604s) [noise=true , address=45.91.116.4:4940 , piece_id=RBCXABGY54Q6NUYS4HBJYUO735G5KEXFHMFDB7A43OLUMSTBVASA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.847874477 (555h39m31.618515812s) [noise=true , address=104.36.82.4:4802 , piece_id=DP3RGIYNJD7B2RGC75JDLDHSZPZFFWE2XINJ2OWEYLRJZITZKH3Q, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:50:23.796531007 (555h39m58.567172343s) [noise=true , address=77.90.31.18:4805 , piece_id=M72AUALYTYA5JSCFKBD6KQJMJMRCWVHNKLLOUA5HWFVD7ROXOIQQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 12:50:23.796638163 (555h39m58.567279498s) [noise=true , address=77.90.31.13:4626 , piece_id=KPYO6FJN4CRMPASUY7QNVR7LGOEWJSOIN77QWYH6NQO5WEFJSUEQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection Jul 16 12:50:23.796656157 (555h39m58.567297492s) [noise=true , address=77.90.31.19:4843 , piece_id=S2PNAQ4O6TNV7J4D4MR7XLVYSN7K5MTR2R2NZHZWAVKFTZTQOJ6Q, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection Jul 16 12:50:23.796682628 (555h39m58.567323963s) [noise=true , address=77.90.31.11:4554 , piece_id=Z7BVO6PA7T56XUMN64H4RSSPTQLRTAMZXSKMDG2HMTYKQ2MR6IFA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection Jul 16 12:50:23.796701113 (555h39m58.567342448s) [noise=true , address=77.90.31.14:4661 , piece_id=QJLO67GGOMAQKSMENVTF464Y65K6C3U5VTZ4R6QRTT26KV6G3TOQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 12:50:23.796730048 (555h39m58.567371383s) [noise=true , address=77.90.31.18:4807 , piece_id=75JF6AQRMDV6EBZYPMYAVU6OIJOQF6VWCU7GKHLAFOJLOTWT46MQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection; write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection Jul 16 12:50:23.796753904 (555h39m58.567395239s) [seg_pos={0 0}, upload=444362]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Jul 16 12:50:24.030501338 (555h39m58.801142683s) [upload=444362]: Done uploading segments... Jul 16 12:50:24.030531145 (555h39m58.80117248s) [upload=444362]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 5.68074137s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 5.790000358s FAIL (2025-07-16 12:53:08 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== upload Jul 16 12:49:54.454430745 (555h39m29.22507217s) [upload=444362]: Uploading segments... Jul 16 12:49:54.454612783 (555h39m29.225254118s) [upload=444362]: Got next segment. Inline: false Jul 16 12:49:54.454649724 (555h39m29.225291059s) [upload=444362]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 12:49:54.454655314 (555h39m29.225296649s) [upload=444362]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 12:49:54.699076943 (555h39m29.469718278s) [seg_pos={0 0}, upload=444362]: Begin upload segment... Jul 16 12:49:54.699118793 (555h39m29.469760118s) [seg_pos={0 0}, upload=444362]: Done begin upload segment. Jul 16 12:49:54.699140215 (555h39m29.46978155s) [noise=true , address=77.90.31.11:4554 , piece_id=Z7BVO6PA7T56XUMN64H4RSSPTQLRTAMZXSKMDG2HMTYKQ2MR6IFA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699150905 (555h39m29.46979224s) [noise=true , address=45.91.116.13:4153 , piece_id=MVZ7IWOC76WEB7FLAEBYEXGGFKUF7ETEIE5NEVV6VXXYCBY5E2HA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699200289 (555h39m29.469841614s) [noise=true , address=104.36.82.4:4802 , piece_id=DP3RGIYNJD7B2RGC75JDLDHSZPZFFWE2XINJ2OWEYLRJZITZKH3Q, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699491557 (555h39m29.470132892s) [noise=true , address=77.90.31.19:4843 , piece_id=S2PNAQ4O6TNV7J4D4MR7XLVYSN7K5MTR2R2NZHZWAVKFTZTQOJ6Q, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699533877 (555h39m29.470175203s) [noise=true , address=45.91.116.10:4083 , piece_id=TRF2LD6QTPGSJ6H3ZBO6ZA2BX3ZGUDK5PBZYXNGHUCHSTBDN5GTA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699737808 (555h39m29.470379143s) [noise=true , address=77.90.31.18:4805 , piece_id=M72AUALYTYA5JSCFKBD6KQJMJMRCWVHNKLLOUA5HWFVD7ROXOIQQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699859721 (555h39m29.470501056s) [noise=true , address=77.90.31.18:4807 , piece_id=75JF6AQRMDV6EBZYPMYAVU6OIJOQF6VWCU7GKHLAFOJLOTWT46MQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700001562 (555h39m29.470642887s) [noise=true , address=45.91.116.4:4940 , piece_id=RBCXABGY54Q6NUYS4HBJYUO735G5KEXFHMFDB7A43OLUMSTBVASA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700262442 (555h39m29.470903787s) [noise=true , address=45.91.116.11:4119 , piece_id=YLYQYUSQQ3XFGQHATLKSMAKMEEZIJXSFGRHDNST3WPOWO7Z3D6QA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700465520 (555h39m29.471106855s) [noise=true , address=45.91.116.9:4261 , piece_id=WZ7JMCI4O7FLMUZ3DFMOXW5SJBB24OCN6ZMKLLGJVFJZYCZULGVQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700614956 (555h39m29.471256291s) [noise=true , address=45.91.116.12:4227 , piece_id=4VO2V6QRBIZK2MTURBDDY2NEJJ65MKR3JUINMZURAZNMBZMY6HNQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700835788 (555h39m29.471477113s) [noise=true , address=45.91.116.5:4297 , piece_id=YKATWUFEURM2TFYRRS32RYWORAIE6DQJDMSD2G5VJNVCR2TOANAQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701059667 (555h39m29.471700992s) [noise=true , address=77.90.31.14:4661 , piece_id=QJLO67GGOMAQKSMENVTF464Y65K6C3U5VTZ4R6QRTT26KV6G3TOQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701294466 (555h39m29.471935811s) [noise=true , address=77.90.31.13:4626 , piece_id=KPYO6FJN4CRMPASUY7QNVR7LGOEWJSOIN77QWYH6NQO5WEFJSUEQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701455474 (555h39m29.472096809s) [noise=true , address=45.91.116.10:4081 , piece_id=BLFVTGDFICTNBQLP5PDH3DWIS4JJYVKTD4Z4ADYWVOS62A23I2QQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701695604 (555h39m29.472336939s) [noise=true , address=45.91.116.8:4045 , piece_id=775P4F74ENG2MPEESXVP4E2YRUVIPAYFYJ7BRCKD6LFSDMWCFDTA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:56.462804855 (555h39m31.23344618s) [upload=444362]: Next returned nil segment Jul 16 12:49:56.462827357 (555h39m31.233468692s) [upload=444362]: Waiting for error group managing segments... Jul 16 12:49:56.744618805 (555h39m31.51526014s) [noise=true , address=45.91.116.10:4083 , piece_id=TRF2LD6QTPGSJ6H3ZBO6ZA2BX3ZGUDK5PBZYXNGHUCHSTBDN5GTA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.753612183 (555h39m31.524253508s) [noise=true , address=45.91.116.11:4119 , piece_id=YLYQYUSQQ3XFGQHATLKSMAKMEEZIJXSFGRHDNST3WPOWO7Z3D6QA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.761769189 (555h39m31.532410524s) [noise=true , address=45.91.116.9:4261 , piece_id=WZ7JMCI4O7FLMUZ3DFMOXW5SJBB24OCN6ZMKLLGJVFJZYCZULGVQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.771222316 (555h39m31.541863651s) [noise=true , address=45.91.116.12:4227 , piece_id=4VO2V6QRBIZK2MTURBDDY2NEJJ65MKR3JUINMZURAZNMBZMY6HNQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.791205801 (555h39m31.561847136s) [noise=true , address=45.91.116.8:4045 , piece_id=775P4F74ENG2MPEESXVP4E2YRUVIPAYFYJ7BRCKD6LFSDMWCFDTA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.834418742 (555h39m31.605060077s) [noise=true , address=45.91.116.10:4081 , piece_id=BLFVTGDFICTNBQLP5PDH3DWIS4JJYVKTD4Z4ADYWVOS62A23I2QQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.838049959 (555h39m31.608691294s) [noise=true , address=45.91.116.13:4153 , piece_id=MVZ7IWOC76WEB7FLAEBYEXGGFKUF7ETEIE5NEVV6VXXYCBY5E2HA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.838929011 (555h39m31.609570346s) [noise=true , address=45.91.116.5:4297 , piece_id=YKATWUFEURM2TFYRRS32RYWORAIE6DQJDMSD2G5VJNVCR2TOANAQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.842586269 (555h39m31.613227604s) [noise=true , address=45.91.116.4:4940 , piece_id=RBCXABGY54Q6NUYS4HBJYUO735G5KEXFHMFDB7A43OLUMSTBVASA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.847874477 (555h39m31.618515812s) [noise=true , address=104.36.82.4:4802 , piece_id=DP3RGIYNJD7B2RGC75JDLDHSZPZFFWE2XINJ2OWEYLRJZITZKH3Q, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:50:23.796531007 (555h39m58.567172343s) [noise=true , address=77.90.31.18:4805 , piece_id=M72AUALYTYA5JSCFKBD6KQJMJMRCWVHNKLLOUA5HWFVD7ROXOIQQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 12:50:23.796638163 (555h39m58.567279498s) [noise=true , address=77.90.31.13:4626 , piece_id=KPYO6FJN4CRMPASUY7QNVR7LGOEWJSOIN77QWYH6NQO5WEFJSUEQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection Jul 16 12:50:23.796656157 (555h39m58.567297492s) [noise=true , address=77.90.31.19:4843 , piece_id=S2PNAQ4O6TNV7J4D4MR7XLVYSN7K5MTR2R2NZHZWAVKFTZTQOJ6Q, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection Jul 16 12:50:23.796682628 (555h39m58.567323963s) [noise=true , address=77.90.31.11:4554 , piece_id=Z7BVO6PA7T56XUMN64H4RSSPTQLRTAMZXSKMDG2HMTYKQ2MR6IFA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection Jul 16 12:50:23.796701113 (555h39m58.567342448s) [noise=true , address=77.90.31.14:4661 , piece_id=QJLO67GGOMAQKSMENVTF464Y65K6C3U5VTZ4R6QRTT26KV6G3TOQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 12:50:23.796730048 (555h39m58.567371383s) [noise=true , address=77.90.31.18:4807 , piece_id=75JF6AQRMDV6EBZYPMYAVU6OIJOQF6VWCU7GKHLAFOJLOTWT46MQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection; write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection Jul 16 12:50:23.796753904 (555h39m58.567395239s) [seg_pos={0 0}, upload=444362]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Jul 16 12:50:24.030501338 (555h39m58.801142683s) [upload=444362]: Done uploading segments... Jul 16 12:50:24.030531145 (555h39m58.80117248s) [upload=444362]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 5.790020728s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 5.83753812s FAIL (2025-07-16 12:52:28 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== upload Jul 16 12:49:54.454430745 (555h39m29.22507217s) [upload=444362]: Uploading segments... Jul 16 12:49:54.454612783 (555h39m29.225254118s) [upload=444362]: Got next segment. Inline: false Jul 16 12:49:54.454649724 (555h39m29.225291059s) [upload=444362]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 12:49:54.454655314 (555h39m29.225296649s) [upload=444362]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 12:49:54.699076943 (555h39m29.469718278s) [seg_pos={0 0}, upload=444362]: Begin upload segment... Jul 16 12:49:54.699118793 (555h39m29.469760118s) [seg_pos={0 0}, upload=444362]: Done begin upload segment. Jul 16 12:49:54.699140215 (555h39m29.46978155s) [noise=true , address=77.90.31.11:4554 , piece_id=Z7BVO6PA7T56XUMN64H4RSSPTQLRTAMZXSKMDG2HMTYKQ2MR6IFA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699150905 (555h39m29.46979224s) [noise=true , address=45.91.116.13:4153 , piece_id=MVZ7IWOC76WEB7FLAEBYEXGGFKUF7ETEIE5NEVV6VXXYCBY5E2HA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699200289 (555h39m29.469841614s) [noise=true , address=104.36.82.4:4802 , piece_id=DP3RGIYNJD7B2RGC75JDLDHSZPZFFWE2XINJ2OWEYLRJZITZKH3Q, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699491557 (555h39m29.470132892s) [noise=true , address=77.90.31.19:4843 , piece_id=S2PNAQ4O6TNV7J4D4MR7XLVYSN7K5MTR2R2NZHZWAVKFTZTQOJ6Q, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699533877 (555h39m29.470175203s) [noise=true , address=45.91.116.10:4083 , piece_id=TRF2LD6QTPGSJ6H3ZBO6ZA2BX3ZGUDK5PBZYXNGHUCHSTBDN5GTA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699737808 (555h39m29.470379143s) [noise=true , address=77.90.31.18:4805 , piece_id=M72AUALYTYA5JSCFKBD6KQJMJMRCWVHNKLLOUA5HWFVD7ROXOIQQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699859721 (555h39m29.470501056s) [noise=true , address=77.90.31.18:4807 , piece_id=75JF6AQRMDV6EBZYPMYAVU6OIJOQF6VWCU7GKHLAFOJLOTWT46MQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700001562 (555h39m29.470642887s) [noise=true , address=45.91.116.4:4940 , piece_id=RBCXABGY54Q6NUYS4HBJYUO735G5KEXFHMFDB7A43OLUMSTBVASA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700262442 (555h39m29.470903787s) [noise=true , address=45.91.116.11:4119 , piece_id=YLYQYUSQQ3XFGQHATLKSMAKMEEZIJXSFGRHDNST3WPOWO7Z3D6QA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700465520 (555h39m29.471106855s) [noise=true , address=45.91.116.9:4261 , piece_id=WZ7JMCI4O7FLMUZ3DFMOXW5SJBB24OCN6ZMKLLGJVFJZYCZULGVQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700614956 (555h39m29.471256291s) [noise=true , address=45.91.116.12:4227 , piece_id=4VO2V6QRBIZK2MTURBDDY2NEJJ65MKR3JUINMZURAZNMBZMY6HNQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700835788 (555h39m29.471477113s) [noise=true , address=45.91.116.5:4297 , piece_id=YKATWUFEURM2TFYRRS32RYWORAIE6DQJDMSD2G5VJNVCR2TOANAQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701059667 (555h39m29.471700992s) [noise=true , address=77.90.31.14:4661 , piece_id=QJLO67GGOMAQKSMENVTF464Y65K6C3U5VTZ4R6QRTT26KV6G3TOQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701294466 (555h39m29.471935811s) [noise=true , address=77.90.31.13:4626 , piece_id=KPYO6FJN4CRMPASUY7QNVR7LGOEWJSOIN77QWYH6NQO5WEFJSUEQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701455474 (555h39m29.472096809s) [noise=true , address=45.91.116.10:4081 , piece_id=BLFVTGDFICTNBQLP5PDH3DWIS4JJYVKTD4Z4ADYWVOS62A23I2QQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701695604 (555h39m29.472336939s) [noise=true , address=45.91.116.8:4045 , piece_id=775P4F74ENG2MPEESXVP4E2YRUVIPAYFYJ7BRCKD6LFSDMWCFDTA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:56.462804855 (555h39m31.23344618s) [upload=444362]: Next returned nil segment Jul 16 12:49:56.462827357 (555h39m31.233468692s) [upload=444362]: Waiting for error group managing segments... Jul 16 12:49:56.744618805 (555h39m31.51526014s) [noise=true , address=45.91.116.10:4083 , piece_id=TRF2LD6QTPGSJ6H3ZBO6ZA2BX3ZGUDK5PBZYXNGHUCHSTBDN5GTA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.753612183 (555h39m31.524253508s) [noise=true , address=45.91.116.11:4119 , piece_id=YLYQYUSQQ3XFGQHATLKSMAKMEEZIJXSFGRHDNST3WPOWO7Z3D6QA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.761769189 (555h39m31.532410524s) [noise=true , address=45.91.116.9:4261 , piece_id=WZ7JMCI4O7FLMUZ3DFMOXW5SJBB24OCN6ZMKLLGJVFJZYCZULGVQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.771222316 (555h39m31.541863651s) [noise=true , address=45.91.116.12:4227 , piece_id=4VO2V6QRBIZK2MTURBDDY2NEJJ65MKR3JUINMZURAZNMBZMY6HNQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.791205801 (555h39m31.561847136s) [noise=true , address=45.91.116.8:4045 , piece_id=775P4F74ENG2MPEESXVP4E2YRUVIPAYFYJ7BRCKD6LFSDMWCFDTA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.834418742 (555h39m31.605060077s) [noise=true , address=45.91.116.10:4081 , piece_id=BLFVTGDFICTNBQLP5PDH3DWIS4JJYVKTD4Z4ADYWVOS62A23I2QQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.838049959 (555h39m31.608691294s) [noise=true , address=45.91.116.13:4153 , piece_id=MVZ7IWOC76WEB7FLAEBYEXGGFKUF7ETEIE5NEVV6VXXYCBY5E2HA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.838929011 (555h39m31.609570346s) [noise=true , address=45.91.116.5:4297 , piece_id=YKATWUFEURM2TFYRRS32RYWORAIE6DQJDMSD2G5VJNVCR2TOANAQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.842586269 (555h39m31.613227604s) [noise=true , address=45.91.116.4:4940 , piece_id=RBCXABGY54Q6NUYS4HBJYUO735G5KEXFHMFDB7A43OLUMSTBVASA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.847874477 (555h39m31.618515812s) [noise=true , address=104.36.82.4:4802 , piece_id=DP3RGIYNJD7B2RGC75JDLDHSZPZFFWE2XINJ2OWEYLRJZITZKH3Q, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:50:23.796531007 (555h39m58.567172343s) [noise=true , address=77.90.31.18:4805 , piece_id=M72AUALYTYA5JSCFKBD6KQJMJMRCWVHNKLLOUA5HWFVD7ROXOIQQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 12:50:23.796638163 (555h39m58.567279498s) [noise=true , address=77.90.31.13:4626 , piece_id=KPYO6FJN4CRMPASUY7QNVR7LGOEWJSOIN77QWYH6NQO5WEFJSUEQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection Jul 16 12:50:23.796656157 (555h39m58.567297492s) [noise=true , address=77.90.31.19:4843 , piece_id=S2PNAQ4O6TNV7J4D4MR7XLVYSN7K5MTR2R2NZHZWAVKFTZTQOJ6Q, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection Jul 16 12:50:23.796682628 (555h39m58.567323963s) [noise=true , address=77.90.31.11:4554 , piece_id=Z7BVO6PA7T56XUMN64H4RSSPTQLRTAMZXSKMDG2HMTYKQ2MR6IFA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection Jul 16 12:50:23.796701113 (555h39m58.567342448s) [noise=true , address=77.90.31.14:4661 , piece_id=QJLO67GGOMAQKSMENVTF464Y65K6C3U5VTZ4R6QRTT26KV6G3TOQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 12:50:23.796730048 (555h39m58.567371383s) [noise=true , address=77.90.31.18:4807 , piece_id=75JF6AQRMDV6EBZYPMYAVU6OIJOQF6VWCU7GKHLAFOJLOTWT46MQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection; write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection Jul 16 12:50:23.796753904 (555h39m58.567395239s) [seg_pos={0 0}, upload=444362]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Jul 16 12:50:24.030501338 (555h39m58.801142683s) [upload=444362]: Done uploading segments... Jul 16 12:50:24.030531145 (555h39m58.80117248s) [upload=444362]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 5.83755845s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 5.78784848s FAIL (2025-07-16 12:51:52 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== upload Jul 16 12:49:54.454430745 (555h39m29.22507217s) [upload=444362]: Uploading segments... Jul 16 12:49:54.454612783 (555h39m29.225254118s) [upload=444362]: Got next segment. Inline: false Jul 16 12:49:54.454649724 (555h39m29.225291059s) [upload=444362]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 12:49:54.454655314 (555h39m29.225296649s) [upload=444362]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 12:49:54.699076943 (555h39m29.469718278s) [seg_pos={0 0}, upload=444362]: Begin upload segment... Jul 16 12:49:54.699118793 (555h39m29.469760118s) [seg_pos={0 0}, upload=444362]: Done begin upload segment. Jul 16 12:49:54.699140215 (555h39m29.46978155s) [noise=true , address=77.90.31.11:4554 , piece_id=Z7BVO6PA7T56XUMN64H4RSSPTQLRTAMZXSKMDG2HMTYKQ2MR6IFA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699150905 (555h39m29.46979224s) [noise=true , address=45.91.116.13:4153 , piece_id=MVZ7IWOC76WEB7FLAEBYEXGGFKUF7ETEIE5NEVV6VXXYCBY5E2HA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699200289 (555h39m29.469841614s) [noise=true , address=104.36.82.4:4802 , piece_id=DP3RGIYNJD7B2RGC75JDLDHSZPZFFWE2XINJ2OWEYLRJZITZKH3Q, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699491557 (555h39m29.470132892s) [noise=true , address=77.90.31.19:4843 , piece_id=S2PNAQ4O6TNV7J4D4MR7XLVYSN7K5MTR2R2NZHZWAVKFTZTQOJ6Q, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699533877 (555h39m29.470175203s) [noise=true , address=45.91.116.10:4083 , piece_id=TRF2LD6QTPGSJ6H3ZBO6ZA2BX3ZGUDK5PBZYXNGHUCHSTBDN5GTA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699737808 (555h39m29.470379143s) [noise=true , address=77.90.31.18:4805 , piece_id=M72AUALYTYA5JSCFKBD6KQJMJMRCWVHNKLLOUA5HWFVD7ROXOIQQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699859721 (555h39m29.470501056s) [noise=true , address=77.90.31.18:4807 , piece_id=75JF6AQRMDV6EBZYPMYAVU6OIJOQF6VWCU7GKHLAFOJLOTWT46MQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700001562 (555h39m29.470642887s) [noise=true , address=45.91.116.4:4940 , piece_id=RBCXABGY54Q6NUYS4HBJYUO735G5KEXFHMFDB7A43OLUMSTBVASA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700262442 (555h39m29.470903787s) [noise=true , address=45.91.116.11:4119 , piece_id=YLYQYUSQQ3XFGQHATLKSMAKMEEZIJXSFGRHDNST3WPOWO7Z3D6QA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700465520 (555h39m29.471106855s) [noise=true , address=45.91.116.9:4261 , piece_id=WZ7JMCI4O7FLMUZ3DFMOXW5SJBB24OCN6ZMKLLGJVFJZYCZULGVQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700614956 (555h39m29.471256291s) [noise=true , address=45.91.116.12:4227 , piece_id=4VO2V6QRBIZK2MTURBDDY2NEJJ65MKR3JUINMZURAZNMBZMY6HNQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700835788 (555h39m29.471477113s) [noise=true , address=45.91.116.5:4297 , piece_id=YKATWUFEURM2TFYRRS32RYWORAIE6DQJDMSD2G5VJNVCR2TOANAQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701059667 (555h39m29.471700992s) [noise=true , address=77.90.31.14:4661 , piece_id=QJLO67GGOMAQKSMENVTF464Y65K6C3U5VTZ4R6QRTT26KV6G3TOQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701294466 (555h39m29.471935811s) [noise=true , address=77.90.31.13:4626 , piece_id=KPYO6FJN4CRMPASUY7QNVR7LGOEWJSOIN77QWYH6NQO5WEFJSUEQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701455474 (555h39m29.472096809s) [noise=true , address=45.91.116.10:4081 , piece_id=BLFVTGDFICTNBQLP5PDH3DWIS4JJYVKTD4Z4ADYWVOS62A23I2QQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701695604 (555h39m29.472336939s) [noise=true , address=45.91.116.8:4045 , piece_id=775P4F74ENG2MPEESXVP4E2YRUVIPAYFYJ7BRCKD6LFSDMWCFDTA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:56.462804855 (555h39m31.23344618s) [upload=444362]: Next returned nil segment Jul 16 12:49:56.462827357 (555h39m31.233468692s) [upload=444362]: Waiting for error group managing segments... Jul 16 12:49:56.744618805 (555h39m31.51526014s) [noise=true , address=45.91.116.10:4083 , piece_id=TRF2LD6QTPGSJ6H3ZBO6ZA2BX3ZGUDK5PBZYXNGHUCHSTBDN5GTA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.753612183 (555h39m31.524253508s) [noise=true , address=45.91.116.11:4119 , piece_id=YLYQYUSQQ3XFGQHATLKSMAKMEEZIJXSFGRHDNST3WPOWO7Z3D6QA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.761769189 (555h39m31.532410524s) [noise=true , address=45.91.116.9:4261 , piece_id=WZ7JMCI4O7FLMUZ3DFMOXW5SJBB24OCN6ZMKLLGJVFJZYCZULGVQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.771222316 (555h39m31.541863651s) [noise=true , address=45.91.116.12:4227 , piece_id=4VO2V6QRBIZK2MTURBDDY2NEJJ65MKR3JUINMZURAZNMBZMY6HNQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.791205801 (555h39m31.561847136s) [noise=true , address=45.91.116.8:4045 , piece_id=775P4F74ENG2MPEESXVP4E2YRUVIPAYFYJ7BRCKD6LFSDMWCFDTA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.834418742 (555h39m31.605060077s) [noise=true , address=45.91.116.10:4081 , piece_id=BLFVTGDFICTNBQLP5PDH3DWIS4JJYVKTD4Z4ADYWVOS62A23I2QQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.838049959 (555h39m31.608691294s) [noise=true , address=45.91.116.13:4153 , piece_id=MVZ7IWOC76WEB7FLAEBYEXGGFKUF7ETEIE5NEVV6VXXYCBY5E2HA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.838929011 (555h39m31.609570346s) [noise=true , address=45.91.116.5:4297 , piece_id=YKATWUFEURM2TFYRRS32RYWORAIE6DQJDMSD2G5VJNVCR2TOANAQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.842586269 (555h39m31.613227604s) [noise=true , address=45.91.116.4:4940 , piece_id=RBCXABGY54Q6NUYS4HBJYUO735G5KEXFHMFDB7A43OLUMSTBVASA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.847874477 (555h39m31.618515812s) [noise=true , address=104.36.82.4:4802 , piece_id=DP3RGIYNJD7B2RGC75JDLDHSZPZFFWE2XINJ2OWEYLRJZITZKH3Q, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:50:23.796531007 (555h39m58.567172343s) [noise=true , address=77.90.31.18:4805 , piece_id=M72AUALYTYA5JSCFKBD6KQJMJMRCWVHNKLLOUA5HWFVD7ROXOIQQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 12:50:23.796638163 (555h39m58.567279498s) [noise=true , address=77.90.31.13:4626 , piece_id=KPYO6FJN4CRMPASUY7QNVR7LGOEWJSOIN77QWYH6NQO5WEFJSUEQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection Jul 16 12:50:23.796656157 (555h39m58.567297492s) [noise=true , address=77.90.31.19:4843 , piece_id=S2PNAQ4O6TNV7J4D4MR7XLVYSN7K5MTR2R2NZHZWAVKFTZTQOJ6Q, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection Jul 16 12:50:23.796682628 (555h39m58.567323963s) [noise=true , address=77.90.31.11:4554 , piece_id=Z7BVO6PA7T56XUMN64H4RSSPTQLRTAMZXSKMDG2HMTYKQ2MR6IFA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection Jul 16 12:50:23.796701113 (555h39m58.567342448s) [noise=true , address=77.90.31.14:4661 , piece_id=QJLO67GGOMAQKSMENVTF464Y65K6C3U5VTZ4R6QRTT26KV6G3TOQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 12:50:23.796730048 (555h39m58.567371383s) [noise=true , address=77.90.31.18:4807 , piece_id=75JF6AQRMDV6EBZYPMYAVU6OIJOQF6VWCU7GKHLAFOJLOTWT46MQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection; write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection Jul 16 12:50:23.796753904 (555h39m58.567395239s) [seg_pos={0 0}, upload=444362]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Jul 16 12:50:24.030501338 (555h39m58.801142683s) [upload=444362]: Done uploading segments... Jul 16 12:50:24.030531145 (555h39m58.80117248s) [upload=444362]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 5.787872575s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 5.742863901s FAIL (2025-07-16 12:50:58 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== upload Jul 16 12:49:54.454430745 (555h39m29.22507217s) [upload=444362]: Uploading segments... Jul 16 12:49:54.454612783 (555h39m29.225254118s) [upload=444362]: Got next segment. Inline: false Jul 16 12:49:54.454649724 (555h39m29.225291059s) [upload=444362]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 12:49:54.454655314 (555h39m29.225296649s) [upload=444362]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 12:49:54.699076943 (555h39m29.469718278s) [seg_pos={0 0}, upload=444362]: Begin upload segment... Jul 16 12:49:54.699118793 (555h39m29.469760118s) [seg_pos={0 0}, upload=444362]: Done begin upload segment. Jul 16 12:49:54.699140215 (555h39m29.46978155s) [noise=true , address=77.90.31.11:4554 , piece_id=Z7BVO6PA7T56XUMN64H4RSSPTQLRTAMZXSKMDG2HMTYKQ2MR6IFA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699150905 (555h39m29.46979224s) [noise=true , address=45.91.116.13:4153 , piece_id=MVZ7IWOC76WEB7FLAEBYEXGGFKUF7ETEIE5NEVV6VXXYCBY5E2HA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699200289 (555h39m29.469841614s) [noise=true , address=104.36.82.4:4802 , piece_id=DP3RGIYNJD7B2RGC75JDLDHSZPZFFWE2XINJ2OWEYLRJZITZKH3Q, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699491557 (555h39m29.470132892s) [noise=true , address=77.90.31.19:4843 , piece_id=S2PNAQ4O6TNV7J4D4MR7XLVYSN7K5MTR2R2NZHZWAVKFTZTQOJ6Q, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699533877 (555h39m29.470175203s) [noise=true , address=45.91.116.10:4083 , piece_id=TRF2LD6QTPGSJ6H3ZBO6ZA2BX3ZGUDK5PBZYXNGHUCHSTBDN5GTA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699737808 (555h39m29.470379143s) [noise=true , address=77.90.31.18:4805 , piece_id=M72AUALYTYA5JSCFKBD6KQJMJMRCWVHNKLLOUA5HWFVD7ROXOIQQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699859721 (555h39m29.470501056s) [noise=true , address=77.90.31.18:4807 , piece_id=75JF6AQRMDV6EBZYPMYAVU6OIJOQF6VWCU7GKHLAFOJLOTWT46MQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700001562 (555h39m29.470642887s) [noise=true , address=45.91.116.4:4940 , piece_id=RBCXABGY54Q6NUYS4HBJYUO735G5KEXFHMFDB7A43OLUMSTBVASA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700262442 (555h39m29.470903787s) [noise=true , address=45.91.116.11:4119 , piece_id=YLYQYUSQQ3XFGQHATLKSMAKMEEZIJXSFGRHDNST3WPOWO7Z3D6QA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700465520 (555h39m29.471106855s) [noise=true , address=45.91.116.9:4261 , piece_id=WZ7JMCI4O7FLMUZ3DFMOXW5SJBB24OCN6ZMKLLGJVFJZYCZULGVQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700614956 (555h39m29.471256291s) [noise=true , address=45.91.116.12:4227 , piece_id=4VO2V6QRBIZK2MTURBDDY2NEJJ65MKR3JUINMZURAZNMBZMY6HNQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700835788 (555h39m29.471477113s) [noise=true , address=45.91.116.5:4297 , piece_id=YKATWUFEURM2TFYRRS32RYWORAIE6DQJDMSD2G5VJNVCR2TOANAQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701059667 (555h39m29.471700992s) [noise=true , address=77.90.31.14:4661 , piece_id=QJLO67GGOMAQKSMENVTF464Y65K6C3U5VTZ4R6QRTT26KV6G3TOQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701294466 (555h39m29.471935811s) [noise=true , address=77.90.31.13:4626 , piece_id=KPYO6FJN4CRMPASUY7QNVR7LGOEWJSOIN77QWYH6NQO5WEFJSUEQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701455474 (555h39m29.472096809s) [noise=true , address=45.91.116.10:4081 , piece_id=BLFVTGDFICTNBQLP5PDH3DWIS4JJYVKTD4Z4ADYWVOS62A23I2QQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701695604 (555h39m29.472336939s) [noise=true , address=45.91.116.8:4045 , piece_id=775P4F74ENG2MPEESXVP4E2YRUVIPAYFYJ7BRCKD6LFSDMWCFDTA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:56.462804855 (555h39m31.23344618s) [upload=444362]: Next returned nil segment Jul 16 12:49:56.462827357 (555h39m31.233468692s) [upload=444362]: Waiting for error group managing segments... Jul 16 12:49:56.744618805 (555h39m31.51526014s) [noise=true , address=45.91.116.10:4083 , piece_id=TRF2LD6QTPGSJ6H3ZBO6ZA2BX3ZGUDK5PBZYXNGHUCHSTBDN5GTA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.753612183 (555h39m31.524253508s) [noise=true , address=45.91.116.11:4119 , piece_id=YLYQYUSQQ3XFGQHATLKSMAKMEEZIJXSFGRHDNST3WPOWO7Z3D6QA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.761769189 (555h39m31.532410524s) [noise=true , address=45.91.116.9:4261 , piece_id=WZ7JMCI4O7FLMUZ3DFMOXW5SJBB24OCN6ZMKLLGJVFJZYCZULGVQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.771222316 (555h39m31.541863651s) [noise=true , address=45.91.116.12:4227 , piece_id=4VO2V6QRBIZK2MTURBDDY2NEJJ65MKR3JUINMZURAZNMBZMY6HNQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.791205801 (555h39m31.561847136s) [noise=true , address=45.91.116.8:4045 , piece_id=775P4F74ENG2MPEESXVP4E2YRUVIPAYFYJ7BRCKD6LFSDMWCFDTA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.834418742 (555h39m31.605060077s) [noise=true , address=45.91.116.10:4081 , piece_id=BLFVTGDFICTNBQLP5PDH3DWIS4JJYVKTD4Z4ADYWVOS62A23I2QQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.838049959 (555h39m31.608691294s) [noise=true , address=45.91.116.13:4153 , piece_id=MVZ7IWOC76WEB7FLAEBYEXGGFKUF7ETEIE5NEVV6VXXYCBY5E2HA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.838929011 (555h39m31.609570346s) [noise=true , address=45.91.116.5:4297 , piece_id=YKATWUFEURM2TFYRRS32RYWORAIE6DQJDMSD2G5VJNVCR2TOANAQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.842586269 (555h39m31.613227604s) [noise=true , address=45.91.116.4:4940 , piece_id=RBCXABGY54Q6NUYS4HBJYUO735G5KEXFHMFDB7A43OLUMSTBVASA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.847874477 (555h39m31.618515812s) [noise=true , address=104.36.82.4:4802 , piece_id=DP3RGIYNJD7B2RGC75JDLDHSZPZFFWE2XINJ2OWEYLRJZITZKH3Q, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:50:23.796531007 (555h39m58.567172343s) [noise=true , address=77.90.31.18:4805 , piece_id=M72AUALYTYA5JSCFKBD6KQJMJMRCWVHNKLLOUA5HWFVD7ROXOIQQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 12:50:23.796638163 (555h39m58.567279498s) [noise=true , address=77.90.31.13:4626 , piece_id=KPYO6FJN4CRMPASUY7QNVR7LGOEWJSOIN77QWYH6NQO5WEFJSUEQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection Jul 16 12:50:23.796656157 (555h39m58.567297492s) [noise=true , address=77.90.31.19:4843 , piece_id=S2PNAQ4O6TNV7J4D4MR7XLVYSN7K5MTR2R2NZHZWAVKFTZTQOJ6Q, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection Jul 16 12:50:23.796682628 (555h39m58.567323963s) [noise=true , address=77.90.31.11:4554 , piece_id=Z7BVO6PA7T56XUMN64H4RSSPTQLRTAMZXSKMDG2HMTYKQ2MR6IFA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection Jul 16 12:50:23.796701113 (555h39m58.567342448s) [noise=true , address=77.90.31.14:4661 , piece_id=QJLO67GGOMAQKSMENVTF464Y65K6C3U5VTZ4R6QRTT26KV6G3TOQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 12:50:23.796730048 (555h39m58.567371383s) [noise=true , address=77.90.31.18:4807 , piece_id=75JF6AQRMDV6EBZYPMYAVU6OIJOQF6VWCU7GKHLAFOJLOTWT46MQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection; write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection Jul 16 12:50:23.796753904 (555h39m58.567395239s) [seg_pos={0 0}, upload=444362]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Jul 16 12:50:24.030501338 (555h39m58.801142683s) [upload=444362]: Done uploading segments... Jul 16 12:50:24.030531145 (555h39m58.80117248s) [upload=444362]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 5.742892437s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 30.235865811s FAIL (2025-07-16 12:50:24 UTC) orbiter warning: ======ERROR====== uplink: failed to upload enough pieces (needed at least 13 but got 10) ======LOGS====== upload Jul 16 12:49:54.454430745 (555h39m29.22507217s) [upload=444362]: Uploading segments... Jul 16 12:49:54.454612783 (555h39m29.225254118s) [upload=444362]: Got next segment. Inline: false Jul 16 12:49:54.454649724 (555h39m29.225291059s) [upload=444362]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 12:49:54.454655314 (555h39m29.225296649s) [upload=444362]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 12:49:54.699076943 (555h39m29.469718278s) [seg_pos={0 0}, upload=444362]: Begin upload segment... Jul 16 12:49:54.699118793 (555h39m29.469760118s) [seg_pos={0 0}, upload=444362]: Done begin upload segment. Jul 16 12:49:54.699140215 (555h39m29.46978155s) [noise=true , address=77.90.31.11:4554 , piece_id=Z7BVO6PA7T56XUMN64H4RSSPTQLRTAMZXSKMDG2HMTYKQ2MR6IFA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699150905 (555h39m29.46979224s) [noise=true , address=45.91.116.13:4153 , piece_id=MVZ7IWOC76WEB7FLAEBYEXGGFKUF7ETEIE5NEVV6VXXYCBY5E2HA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699200289 (555h39m29.469841614s) [noise=true , address=104.36.82.4:4802 , piece_id=DP3RGIYNJD7B2RGC75JDLDHSZPZFFWE2XINJ2OWEYLRJZITZKH3Q, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699491557 (555h39m29.470132892s) [noise=true , address=77.90.31.19:4843 , piece_id=S2PNAQ4O6TNV7J4D4MR7XLVYSN7K5MTR2R2NZHZWAVKFTZTQOJ6Q, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699533877 (555h39m29.470175203s) [noise=true , address=45.91.116.10:4083 , piece_id=TRF2LD6QTPGSJ6H3ZBO6ZA2BX3ZGUDK5PBZYXNGHUCHSTBDN5GTA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699737808 (555h39m29.470379143s) [noise=true , address=77.90.31.18:4805 , piece_id=M72AUALYTYA5JSCFKBD6KQJMJMRCWVHNKLLOUA5HWFVD7ROXOIQQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.699859721 (555h39m29.470501056s) [noise=true , address=77.90.31.18:4807 , piece_id=75JF6AQRMDV6EBZYPMYAVU6OIJOQF6VWCU7GKHLAFOJLOTWT46MQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700001562 (555h39m29.470642887s) [noise=true , address=45.91.116.4:4940 , piece_id=RBCXABGY54Q6NUYS4HBJYUO735G5KEXFHMFDB7A43OLUMSTBVASA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700262442 (555h39m29.470903787s) [noise=true , address=45.91.116.11:4119 , piece_id=YLYQYUSQQ3XFGQHATLKSMAKMEEZIJXSFGRHDNST3WPOWO7Z3D6QA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700465520 (555h39m29.471106855s) [noise=true , address=45.91.116.9:4261 , piece_id=WZ7JMCI4O7FLMUZ3DFMOXW5SJBB24OCN6ZMKLLGJVFJZYCZULGVQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700614956 (555h39m29.471256291s) [noise=true , address=45.91.116.12:4227 , piece_id=4VO2V6QRBIZK2MTURBDDY2NEJJ65MKR3JUINMZURAZNMBZMY6HNQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.700835788 (555h39m29.471477113s) [noise=true , address=45.91.116.5:4297 , piece_id=YKATWUFEURM2TFYRRS32RYWORAIE6DQJDMSD2G5VJNVCR2TOANAQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701059667 (555h39m29.471700992s) [noise=true , address=77.90.31.14:4661 , piece_id=QJLO67GGOMAQKSMENVTF464Y65K6C3U5VTZ4R6QRTT26KV6G3TOQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701294466 (555h39m29.471935811s) [noise=true , address=77.90.31.13:4626 , piece_id=KPYO6FJN4CRMPASUY7QNVR7LGOEWJSOIN77QWYH6NQO5WEFJSUEQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701455474 (555h39m29.472096809s) [noise=true , address=45.91.116.10:4081 , piece_id=BLFVTGDFICTNBQLP5PDH3DWIS4JJYVKTD4Z4ADYWVOS62A23I2QQ, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:54.701695604 (555h39m29.472336939s) [noise=true , address=45.91.116.8:4045 , piece_id=775P4F74ENG2MPEESXVP4E2YRUVIPAYFYJ7BRCKD6LFSDMWCFDTA, seg_pos={0 0}, upload=444362]: Uploading piece... Jul 16 12:49:56.462804855 (555h39m31.23344618s) [upload=444362]: Next returned nil segment Jul 16 12:49:56.462827357 (555h39m31.233468692s) [upload=444362]: Waiting for error group managing segments... Jul 16 12:49:56.744618805 (555h39m31.51526014s) [noise=true , address=45.91.116.10:4083 , piece_id=TRF2LD6QTPGSJ6H3ZBO6ZA2BX3ZGUDK5PBZYXNGHUCHSTBDN5GTA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.753612183 (555h39m31.524253508s) [noise=true , address=45.91.116.11:4119 , piece_id=YLYQYUSQQ3XFGQHATLKSMAKMEEZIJXSFGRHDNST3WPOWO7Z3D6QA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.761769189 (555h39m31.532410524s) [noise=true , address=45.91.116.9:4261 , piece_id=WZ7JMCI4O7FLMUZ3DFMOXW5SJBB24OCN6ZMKLLGJVFJZYCZULGVQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.771222316 (555h39m31.541863651s) [noise=true , address=45.91.116.12:4227 , piece_id=4VO2V6QRBIZK2MTURBDDY2NEJJ65MKR3JUINMZURAZNMBZMY6HNQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.791205801 (555h39m31.561847136s) [noise=true , address=45.91.116.8:4045 , piece_id=775P4F74ENG2MPEESXVP4E2YRUVIPAYFYJ7BRCKD6LFSDMWCFDTA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.834418742 (555h39m31.605060077s) [noise=true , address=45.91.116.10:4081 , piece_id=BLFVTGDFICTNBQLP5PDH3DWIS4JJYVKTD4Z4ADYWVOS62A23I2QQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.838049959 (555h39m31.608691294s) [noise=true , address=45.91.116.13:4153 , piece_id=MVZ7IWOC76WEB7FLAEBYEXGGFKUF7ETEIE5NEVV6VXXYCBY5E2HA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.838929011 (555h39m31.609570346s) [noise=true , address=45.91.116.5:4297 , piece_id=YKATWUFEURM2TFYRRS32RYWORAIE6DQJDMSD2G5VJNVCR2TOANAQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.842586269 (555h39m31.613227604s) [noise=true , address=45.91.116.4:4940 , piece_id=RBCXABGY54Q6NUYS4HBJYUO735G5KEXFHMFDB7A43OLUMSTBVASA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:49:56.847874477 (555h39m31.618515812s) [noise=true , address=104.36.82.4:4802 , piece_id=DP3RGIYNJD7B2RGC75JDLDHSZPZFFWE2XINJ2OWEYLRJZITZKH3Q, seg_pos={0 0}, upload=444362]: Done uploading piece. err: <nil> Jul 16 12:50:23.796531007 (555h39m58.567172343s) [noise=true , address=77.90.31.18:4805 , piece_id=M72AUALYTYA5JSCFKBD6KQJMJMRCWVHNKLLOUA5HWFVD7ROXOIQQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12ExMgyeH6s1VMkWatpEqPQwMhX4aGJeK6AWn98kD4f6fQV7rcT, address:77.90.31.18:4805): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 12:50:23.796638163 (555h39m58.567279498s) [noise=true , address=77.90.31.13:4626 , piece_id=KPYO6FJN4CRMPASUY7QNVR7LGOEWJSOIN77QWYH6NQO5WEFJSUEQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu, address:77.90.31.13:4626): protocol: write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection; write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:34878->77.90.31.13:4626: use of closed network connection Jul 16 12:50:23.796656157 (555h39m58.567297492s) [noise=true , address=77.90.31.19:4843 , piece_id=S2PNAQ4O6TNV7J4D4MR7XLVYSN7K5MTR2R2NZHZWAVKFTZTQOJ6Q, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12akCPrMTihqq6CKv7VtDbHhXnWrXygXXhZKgZbftGbymRNzuMb, address:77.90.31.19:4843): protocol: write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection; write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:52290->77.90.31.19:4843: use of closed network connection Jul 16 12:50:23.796682628 (555h39m58.567323963s) [noise=true , address=77.90.31.11:4554 , piece_id=Z7BVO6PA7T56XUMN64H4RSSPTQLRTAMZXSKMDG2HMTYKQ2MR6IFA, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:1eto4dNcMUufd2GixDpEcuXN9ocPRFdnJUPht7vBRdA3BcqRek, address:77.90.31.11:4554): protocol: write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection; write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33128->77.90.31.11:4554: use of closed network connection Jul 16 12:50:23.796701113 (555h39m58.567342448s) [noise=true , address=77.90.31.14:4661 , piece_id=QJLO67GGOMAQKSMENVTF464Y65K6C3U5VTZ4R6QRTT26KV6G3TOQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: expected piece hash; context deadline exceeded; EOF Jul 16 12:50:23.796730048 (555h39m58.567371383s) [noise=true , address=77.90.31.18:4807 , piece_id=75JF6AQRMDV6EBZYPMYAVU6OIJOQF6VWCU7GKHLAFOJLOTWT46MQ, seg_pos={0 0}, upload=444362]: Done uploading piece. err: ecclient: upload failed (node:12jVDPs8JFrPp3swUR5wBoEHpii8BS9F5Hb5p3vUe6btGKHfYaS, address:77.90.31.18:4807): protocol: write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection; write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50186->77.90.31.18:4807: use of closed network connection Jul 16 12:50:23.796753904 (555h39m58.567395239s) [seg_pos={0 0}, upload=444362]: Done waiting for segment. successful: 10 optimal: 13 errs: <nil> Jul 16 12:50:24.030501338 (555h39m58.801142683s) [upload=444362]: Done uploading segments... Jul 16 12:50:24.030531145 (555h39m58.80117248s) [upload=444362]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 10) Duration: 30.235889196s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.920398222s FAIL (2025-07-16 10:46:21 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.920424131s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.869240874s FAIL (2025-07-16 10:45:31 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.869281222s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.859143772s FAIL (2025-07-16 10:44:40 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.859168259s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.734233347s FAIL (2025-07-16 10:44:16 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.734254107s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.810944451s FAIL (2025-07-16 10:43:56 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.810971543s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.708558784s FAIL (2025-07-16 10:42:43 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.70858376s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.92929152s FAIL (2025-07-16 10:41:35 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.929318933s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.694503442s FAIL (2025-07-16 10:41:11 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.69452314s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.69943128s FAIL (2025-07-16 10:40:26 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.699464252s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 5.761703708s FAIL (2025-07-16 10:39:28 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.761728656s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 5.665655423s FAIL (2025-07-16 10:38:19 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.665687473s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 5.641161873s FAIL (2025-07-16 10:37:28 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.64118638s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 5.755064307s FAIL (2025-07-16 10:37:08 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.755088523s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 5.772856969s FAIL (2025-07-16 10:36:37 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.772883269s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 5.740146665s FAIL (2025-07-16 10:35:51 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.740174759s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 5.603263594s FAIL (2025-07-16 10:34:52 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.603293109s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.702521886s FAIL (2025-07-16 10:34:13 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.702545082s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.766192746s FAIL (2025-07-16 10:33:49 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.766221782s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.680246255s FAIL (2025-07-16 10:33:32 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.680274879s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.701826956s FAIL (2025-07-16 10:33:09 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.701857223s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 5.750238966s FAIL (2025-07-16 10:32:26 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.750266499s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 5.885024262s FAIL (2025-07-16 10:31:11 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.885048408s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.82864662s FAIL (2025-07-16 10:30:51 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.828677449s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 5.739259035s FAIL (2025-07-16 10:29:44 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.739285476s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 6.041735027s FAIL (2025-07-16 10:28:30 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 6.041754344s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 5.756378909s FAIL (2025-07-16 10:27:27 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.756405852s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 5.753556785s FAIL (2025-07-16 10:26:57 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.753583005s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 5.716615505s FAIL (2025-07-16 10:26:41 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.716644452s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.759373088s FAIL (2025-07-16 10:26:05 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.759463692s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 5.773262173s FAIL (2025-07-16 10:25:15 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.773282033s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 5.814195112s FAIL (2025-07-16 10:24:06 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.814218547s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.717361767s FAIL (2025-07-16 10:23:01 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.717383649s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 5.775950828s FAIL (2025-07-16 10:21:47 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.775976768s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 5.76783052s FAIL (2025-07-16 10:21:27 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.767866569s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.74556585s FAIL (2025-07-16 10:20:32 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.745591259s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.751470381s FAIL (2025-07-16 10:20:10 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.751498503s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.87443518s FAIL (2025-07-16 10:19:10 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.874475278s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.680764343s FAIL (2025-07-16 10:18:42 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.680794571s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.821828448s FAIL (2025-07-16 10:17:48 UTC) orbiter warning: ======ERROR====== uplink: bucket: metaclient: context deadline exceeded ======LOGS====== 247393737 (552h49m37.018035092s) [noise=true , address=45.91.116.5:4298 , piece_id=SO5TK54HNRJYPBWWO7G5Z7LILWBVYRO7GYSUBLGXP3AENSNNWUHQ, seg_pos={0 0}, upload=442102]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12k2VGS6TVLT1L3KSF5eUEii6VQ2jnkZaCHVrckQaCvANqFHh5C): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:02.247425508 (552h49m37.018066853s) [seg_pos={0 0}, upload=442102]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:02.247519749 (552h49m37.018161094s) [upload=442102]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:02.247526431 (552h49m37.018167776s) [upload=442102]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:02.567193618 (552h49m37.337834964s) [upload=442102]: Done uploading segments... Jul 16 10:00:02.567223626 (552h49m37.337864971s) [upload=442102]: Upload finished. err: <nil> Jul 16 10:00:35.322798409 (552h50m10.093439744s) [upload=442109]: Starting upload Jul 16 10:00:35.322854246 (552h50m10.093495581s) [upload=442109]: Done starting upload Jul 16 10:00:35.322959147 (552h50m10.093600482s) [upload=442109]: Uploading segments... Jul 16 10:00:35.323170992 (552h50m10.093812327s) [upload=442109]: Got next segment. Inline: false Jul 16 10:00:35.323212882 (552h50m10.093854217s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 10:00:35.323218092 (552h50m10.093859427s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 10:00:35.563095085 (552h50m10.33373642s) [seg_pos={0 0}, upload=442109]: Begin upload segment... Jul 16 10:00:35.563136655 (552h50m10.33377799s) [seg_pos={0 0}, upload=442109]: Done begin upload segment. Jul 16 10:00:35.563158777 (552h50m10.333800112s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563198944 (552h50m10.333840279s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563587467 (552h50m10.334228802s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563707898 (552h50m10.334349233s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.563853246 (552h50m10.334494581s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564066364 (552h50m10.334707709s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564126779 (552h50m10.334768114s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564460948 (552h50m10.335102283s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564516885 (552h50m10.33515822s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564768236 (552h50m10.335409571s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.564775581 (552h50m10.335416906s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565144586 (552h50m10.335785922s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.565412429 (552h50m10.336053794s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.566888023 (552h50m10.337529358s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.567630944 (552h50m10.338272279s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:35.569125584 (552h50m10.339766919s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Uploading piece... Jul 16 10:00:37.312772479 (552h50m12.083413814s) [upload=442109]: Next returned nil segment Jul 16 10:00:37.312790493 (552h50m12.083431828s) [upload=442109]: Waiting for error group managing segments... Jul 16 10:00:37.621481541 (552h50m12.392122876s) [noise=true , address=45.91.116.14:4189 , piece_id=2EOPVJYRHRLZE57BPRX6AO7GAFSNOS5GDJ3ARZAICQUNTAMF3JOA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.622538452 (552h50m12.393179787s) [noise=true , address=45.91.116.8:4047 , piece_id=PZOXUWLARQPBNSN67OX2ANYWWWOUXZ4BJTQAQRRDX3YWR7LUC7JQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625336787 (552h50m12.395978122s) [noise=true , address=45.91.116.11:4118 , piece_id=6AJYPKWRE27Y5VYRHV643PH3MWLR7DQ3CJG7CRNGFUU5DXIPP6LA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.625486202 (552h50m12.396127537s) [noise=true , address=45.91.116.13:4154 , piece_id=7T7C7GQK6MMN2WB5K5GMT7MVIS5LDE7ZVJ3NJXUYSBROTVWED5QA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.643097378 (552h50m12.413738723s) [noise=true , address=45.91.116.12:4227 , piece_id=BUY5Z3M7E6QDKLHNIODRQK3RKJ32XPNXZG7EDKQF6IWFBRAPC67Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.646933618 (552h50m12.417574953s) [noise=true , address=77.90.31.11:4553 , piece_id=ER33GQYXW5WQCSR7MTAFCS5LREVU4IEQFZVU25MIK27TOVZJSPMQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.656912601 (552h50m12.427553936s) [noise=true , address=77.90.31.14:4661 , piece_id=RQUAB4AGZSNROLUFJEVE2F4YO67LJDYQKWQ4KXDZDUACMAZ36ZXA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.657051858 (552h50m12.427693193s) [noise=true , address=77.90.31.16:4735 , piece_id=HD3S7QZXO4RMPYCL23T3Z74YTJVG7C5MYBWKB244J7WKDNNXCCTA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.658382904 (552h50m12.429024239s) [noise=true , address=77.90.31.18:4806 , piece_id=XUQS52FOQ3QI3V3VXZ2T3OJIML4TFADNTK4IUR4QZMHXOFOGXI7A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.659112881 (552h50m12.429754216s) [noise=true , address=77.90.31.12:4589 , piece_id=PP4Y5NRJ6JVK4LE6BGTRDN4MCD5JBUY7REZ4BBVQ65YUVZ7UCHWA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.662495022 (552h50m12.433136357s) [noise=true , address=77.90.31.10:4519 , piece_id=Y7FCGTWSZUYYQVVN4A2K5Y6HXYOYUBTDZ4BB3GKZ3CG36M4JG72Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.663463916 (552h50m12.434105251s) [noise=true , address=77.90.31.13:4628 , piece_id=JFF7FVEJF4PI3EDCTMGCRWKRT536IKPR367EJDSU6NL5K432I2MQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695800476 (552h50m12.466441811s) [noise=true , address=45.91.116.10:4082 , piece_id=5SQCN7SRWSQWDEUD6CWGKXPIRJZ3AUTMRE3TWOSIE5LB6AHXI56Q, seg_pos={0 0}, upload=442109]: Done uploading piece. err: <nil> Jul 16 10:00:37.695821076 (552h50m12.466462411s) [seg_pos={0 0}, upload=442109]: Segment reached optimal threshold of 13 pieces. Jul 16 10:00:37.695931788 (552h50m12.466573133s) [noise=true , address=104.36.82.9:4005 , piece_id=VRB6S4DFGLIOXJUK3HODA7F3MNEGWCJKLEQ75TUFEPZW334UITVQ, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12YnzPGyppEZ97NvHxEQiSK18T1bctGqPzdDrXzLGeCSRUBj2WJ): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.695964340 (552h50m12.466605675s) [noise=true , address=45.91.116.7:4011 , piece_id=FO6J6XC73ANPA23IMGP3D5K5MJVNTX7EBJT3ASYUWAJTSK3PLS2A, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12gZ5sVLg58D2gh3MVkHJ42qVRWrRU5EbuDWcG6hYU9MPgcSNQf): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696027892 (552h50m12.466669227s) [noise=true , address=104.36.82.3:4767 , piece_id=CCBSXDZKI6GJNPKY5N46KQOMOJQU6YGFH3NTRYKIGZJOCGV3FEBA, seg_pos={0 0}, upload=442109]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1TiDHs6xp3atLDHHv1i2564ibyPGLKfFyHx3bgZWGRRN5cwUi5): protocol: expected piece hash; context canceled; EOF Jul 16 10:00:37.696084500 (552h50m12.466725835s) [seg_pos={0 0}, upload=442109]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 10:00:37.696142571 (552h50m12.466783896s) [upload=442109]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 10:00:37.696146709 (552h50m12.466788044s) [upload=442109]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 10:00:38.117285014 (552h50m12.887926599s) [upload=442109]: Done uploading segments... Jul 16 10:00:38.117304631 (552h50m12.887945967s) [upload=442109]: Upload finished. err: <nil> Duration: 5.821846873s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)