Orbiter History

checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.493627318s FAIL (2025-07-05 17:50:12 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.493647326s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 5.861771987s FAIL (2025-07-05 17:50:04 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ent. successful: 13 optimal: 13 errs: <nil> Jul 5 17:27:16.571809944 (296h16m51.342451279s) [upload=236932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:27:16.571815556 (296h16m51.342456891s) [upload=236932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:27:16.863746763 (296h16m51.634388098s) [upload=236932]: Done uploading segments... Jul 5 17:27:16.863764737 (296h16m51.634406072s) [upload=236932]: Upload finished. err: <nil> Jul 5 17:28:09.347078064 (296h17m44.117719429s) [upload=236945]: Starting upload Jul 5 17:28:09.347155812 (296h17m44.117797177s) [upload=236945]: Done starting upload Jul 5 17:28:09.347274910 (296h17m44.117916235s) [upload=236945]: Uploading segments... Jul 5 17:28:09.347379050 (296h17m44.118020375s) [upload=236945]: Got next segment. Inline: false Jul 5 17:28:09.347407714 (296h17m44.118049049s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 17:28:09.347412954 (296h17m44.118054289s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 5 17:28:09.588206709 (296h17m44.358848034s) [seg_pos={0 0}, upload=236945]: Begin upload segment... Jul 5 17:28:09.588274739 (296h17m44.358916074s) [seg_pos={0 0}, upload=236945]: Done begin upload segment. Jul 5 17:28:09.588323944 (296h17m44.358965279s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588379069 (296h17m44.359020404s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588734989 (296h17m44.359376314s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588935924 (296h17m44.359577259s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589011298 (296h17m44.359652633s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589270053 (296h17m44.359911389s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590002835 (296h17m44.36064416s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590746688 (296h17m44.361388043s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590753250 (296h17m44.361394585s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591032105 (296h17m44.36167344s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591093732 (296h17m44.361735067s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591452879 (296h17m44.362094215s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591644045 (296h17m44.36228538s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591713738 (296h17m44.362355063s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592268069 (296h17m44.362909394s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592567602 (296h17m44.363208937s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:11.227912581 (296h17m45.998553916s) [upload=236945]: Next returned nil segment Jul 5 17:28:11.227925805 (296h17m45.99856714s) [upload=236945]: Waiting for error group managing segments... Jul 5 17:28:11.529771340 (296h17m46.300412675s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.537274264 (296h17m46.307915599s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.543770743 (296h17m46.314412088s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.562362180 (296h17m46.333003515s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.599523163 (296h17m46.370164498s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.639344807 (296h17m46.409986142s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.657182702 (296h17m46.427824037s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.670611894 (296h17m46.441253229s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.694057187 (296h17m46.464698522s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:29.767976961 (296h18m4.538618326s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:30.958706550 (296h18m5.729347885s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:34.136679007 (296h18m8.907320332s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719142580 (296h18m11.489783905s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719168730 (296h18m11.489810085s) [seg_pos={0 0}, upload=236945]: Segment reached optimal threshold of 13 pieces. Jul 5 17:28:36.719447222 (296h18m11.490088547s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection Jul 5 17:28:36.719487790 (296h18m11.490129126s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Jul 5 17:28:36.719529169 (296h18m11.490170514s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection Jul 5 17:28:36.719580027 (296h18m11.490221362s) [seg_pos={0 0}, upload=236945]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 5 17:28:36.719668395 (296h18m11.49030973s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:28:36.719674027 (296h18m11.490315362s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:28:37.004680607 (296h18m11.775321942s) [upload=236945]: Done uploading segments... Jul 5 17:28:37.004698051 (296h18m11.775339386s) [upload=236945]: Upload finished. err: <nil> Duration: 5.861801404s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 5.514783125s FAIL (2025-07-05 17:49:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.514802672s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 5.63174369s FAIL (2025-07-05 17:49:48 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ent. successful: 13 optimal: 13 errs: <nil> Jul 5 17:27:16.571809944 (296h16m51.342451279s) [upload=236932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:27:16.571815556 (296h16m51.342456891s) [upload=236932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:27:16.863746763 (296h16m51.634388098s) [upload=236932]: Done uploading segments... Jul 5 17:27:16.863764737 (296h16m51.634406072s) [upload=236932]: Upload finished. err: <nil> Jul 5 17:28:09.347078064 (296h17m44.117719429s) [upload=236945]: Starting upload Jul 5 17:28:09.347155812 (296h17m44.117797177s) [upload=236945]: Done starting upload Jul 5 17:28:09.347274910 (296h17m44.117916235s) [upload=236945]: Uploading segments... Jul 5 17:28:09.347379050 (296h17m44.118020375s) [upload=236945]: Got next segment. Inline: false Jul 5 17:28:09.347407714 (296h17m44.118049049s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 17:28:09.347412954 (296h17m44.118054289s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 5 17:28:09.588206709 (296h17m44.358848034s) [seg_pos={0 0}, upload=236945]: Begin upload segment... Jul 5 17:28:09.588274739 (296h17m44.358916074s) [seg_pos={0 0}, upload=236945]: Done begin upload segment. Jul 5 17:28:09.588323944 (296h17m44.358965279s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588379069 (296h17m44.359020404s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588734989 (296h17m44.359376314s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588935924 (296h17m44.359577259s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589011298 (296h17m44.359652633s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589270053 (296h17m44.359911389s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590002835 (296h17m44.36064416s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590746688 (296h17m44.361388043s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590753250 (296h17m44.361394585s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591032105 (296h17m44.36167344s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591093732 (296h17m44.361735067s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591452879 (296h17m44.362094215s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591644045 (296h17m44.36228538s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591713738 (296h17m44.362355063s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592268069 (296h17m44.362909394s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592567602 (296h17m44.363208937s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:11.227912581 (296h17m45.998553916s) [upload=236945]: Next returned nil segment Jul 5 17:28:11.227925805 (296h17m45.99856714s) [upload=236945]: Waiting for error group managing segments... Jul 5 17:28:11.529771340 (296h17m46.300412675s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.537274264 (296h17m46.307915599s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.543770743 (296h17m46.314412088s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.562362180 (296h17m46.333003515s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.599523163 (296h17m46.370164498s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.639344807 (296h17m46.409986142s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.657182702 (296h17m46.427824037s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.670611894 (296h17m46.441253229s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.694057187 (296h17m46.464698522s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:29.767976961 (296h18m4.538618326s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:30.958706550 (296h18m5.729347885s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:34.136679007 (296h18m8.907320332s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719142580 (296h18m11.489783905s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719168730 (296h18m11.489810085s) [seg_pos={0 0}, upload=236945]: Segment reached optimal threshold of 13 pieces. Jul 5 17:28:36.719447222 (296h18m11.490088547s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection Jul 5 17:28:36.719487790 (296h18m11.490129126s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Jul 5 17:28:36.719529169 (296h18m11.490170514s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection Jul 5 17:28:36.719580027 (296h18m11.490221362s) [seg_pos={0 0}, upload=236945]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 5 17:28:36.719668395 (296h18m11.49030973s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:28:36.719674027 (296h18m11.490315362s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:28:37.004680607 (296h18m11.775321942s) [upload=236945]: Done uploading segments... Jul 5 17:28:37.004698051 (296h18m11.775339386s) [upload=236945]: Upload finished. err: <nil> Duration: 5.631773056s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 5.431277375s FAIL (2025-07-05 17:49:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.43130105s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 5.645065444s FAIL (2025-07-05 17:49:16 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ent. successful: 13 optimal: 13 errs: <nil> Jul 5 17:27:16.571809944 (296h16m51.342451279s) [upload=236932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:27:16.571815556 (296h16m51.342456891s) [upload=236932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:27:16.863746763 (296h16m51.634388098s) [upload=236932]: Done uploading segments... Jul 5 17:27:16.863764737 (296h16m51.634406072s) [upload=236932]: Upload finished. err: <nil> Jul 5 17:28:09.347078064 (296h17m44.117719429s) [upload=236945]: Starting upload Jul 5 17:28:09.347155812 (296h17m44.117797177s) [upload=236945]: Done starting upload Jul 5 17:28:09.347274910 (296h17m44.117916235s) [upload=236945]: Uploading segments... Jul 5 17:28:09.347379050 (296h17m44.118020375s) [upload=236945]: Got next segment. Inline: false Jul 5 17:28:09.347407714 (296h17m44.118049049s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 17:28:09.347412954 (296h17m44.118054289s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 5 17:28:09.588206709 (296h17m44.358848034s) [seg_pos={0 0}, upload=236945]: Begin upload segment... Jul 5 17:28:09.588274739 (296h17m44.358916074s) [seg_pos={0 0}, upload=236945]: Done begin upload segment. Jul 5 17:28:09.588323944 (296h17m44.358965279s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588379069 (296h17m44.359020404s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588734989 (296h17m44.359376314s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588935924 (296h17m44.359577259s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589011298 (296h17m44.359652633s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589270053 (296h17m44.359911389s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590002835 (296h17m44.36064416s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590746688 (296h17m44.361388043s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590753250 (296h17m44.361394585s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591032105 (296h17m44.36167344s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591093732 (296h17m44.361735067s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591452879 (296h17m44.362094215s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591644045 (296h17m44.36228538s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591713738 (296h17m44.362355063s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592268069 (296h17m44.362909394s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592567602 (296h17m44.363208937s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:11.227912581 (296h17m45.998553916s) [upload=236945]: Next returned nil segment Jul 5 17:28:11.227925805 (296h17m45.99856714s) [upload=236945]: Waiting for error group managing segments... Jul 5 17:28:11.529771340 (296h17m46.300412675s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.537274264 (296h17m46.307915599s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.543770743 (296h17m46.314412088s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.562362180 (296h17m46.333003515s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.599523163 (296h17m46.370164498s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.639344807 (296h17m46.409986142s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.657182702 (296h17m46.427824037s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.670611894 (296h17m46.441253229s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.694057187 (296h17m46.464698522s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:29.767976961 (296h18m4.538618326s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:30.958706550 (296h18m5.729347885s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:34.136679007 (296h18m8.907320332s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719142580 (296h18m11.489783905s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719168730 (296h18m11.489810085s) [seg_pos={0 0}, upload=236945]: Segment reached optimal threshold of 13 pieces. Jul 5 17:28:36.719447222 (296h18m11.490088547s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection Jul 5 17:28:36.719487790 (296h18m11.490129126s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Jul 5 17:28:36.719529169 (296h18m11.490170514s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection Jul 5 17:28:36.719580027 (296h18m11.490221362s) [seg_pos={0 0}, upload=236945]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 5 17:28:36.719668395 (296h18m11.49030973s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:28:36.719674027 (296h18m11.490315362s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:28:37.004680607 (296h18m11.775321942s) [upload=236945]: Done uploading segments... Jul 5 17:28:37.004698051 (296h18m11.775339386s) [upload=236945]: Upload finished. err: <nil> Duration: 5.645096473s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.840323319s FAIL (2025-07-05 17:48:31 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ent. successful: 13 optimal: 13 errs: <nil> Jul 5 17:27:16.571809944 (296h16m51.342451279s) [upload=236932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:27:16.571815556 (296h16m51.342456891s) [upload=236932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:27:16.863746763 (296h16m51.634388098s) [upload=236932]: Done uploading segments... Jul 5 17:27:16.863764737 (296h16m51.634406072s) [upload=236932]: Upload finished. err: <nil> Jul 5 17:28:09.347078064 (296h17m44.117719429s) [upload=236945]: Starting upload Jul 5 17:28:09.347155812 (296h17m44.117797177s) [upload=236945]: Done starting upload Jul 5 17:28:09.347274910 (296h17m44.117916235s) [upload=236945]: Uploading segments... Jul 5 17:28:09.347379050 (296h17m44.118020375s) [upload=236945]: Got next segment. Inline: false Jul 5 17:28:09.347407714 (296h17m44.118049049s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 17:28:09.347412954 (296h17m44.118054289s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 5 17:28:09.588206709 (296h17m44.358848034s) [seg_pos={0 0}, upload=236945]: Begin upload segment... Jul 5 17:28:09.588274739 (296h17m44.358916074s) [seg_pos={0 0}, upload=236945]: Done begin upload segment. Jul 5 17:28:09.588323944 (296h17m44.358965279s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588379069 (296h17m44.359020404s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588734989 (296h17m44.359376314s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588935924 (296h17m44.359577259s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589011298 (296h17m44.359652633s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589270053 (296h17m44.359911389s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590002835 (296h17m44.36064416s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590746688 (296h17m44.361388043s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590753250 (296h17m44.361394585s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591032105 (296h17m44.36167344s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591093732 (296h17m44.361735067s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591452879 (296h17m44.362094215s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591644045 (296h17m44.36228538s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591713738 (296h17m44.362355063s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592268069 (296h17m44.362909394s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592567602 (296h17m44.363208937s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:11.227912581 (296h17m45.998553916s) [upload=236945]: Next returned nil segment Jul 5 17:28:11.227925805 (296h17m45.99856714s) [upload=236945]: Waiting for error group managing segments... Jul 5 17:28:11.529771340 (296h17m46.300412675s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.537274264 (296h17m46.307915599s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.543770743 (296h17m46.314412088s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.562362180 (296h17m46.333003515s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.599523163 (296h17m46.370164498s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.639344807 (296h17m46.409986142s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.657182702 (296h17m46.427824037s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.670611894 (296h17m46.441253229s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.694057187 (296h17m46.464698522s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:29.767976961 (296h18m4.538618326s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:30.958706550 (296h18m5.729347885s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:34.136679007 (296h18m8.907320332s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719142580 (296h18m11.489783905s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719168730 (296h18m11.489810085s) [seg_pos={0 0}, upload=236945]: Segment reached optimal threshold of 13 pieces. Jul 5 17:28:36.719447222 (296h18m11.490088547s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection Jul 5 17:28:36.719487790 (296h18m11.490129126s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Jul 5 17:28:36.719529169 (296h18m11.490170514s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection Jul 5 17:28:36.719580027 (296h18m11.490221362s) [seg_pos={0 0}, upload=236945]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 5 17:28:36.719668395 (296h18m11.49030973s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:28:36.719674027 (296h18m11.490315362s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:28:37.004680607 (296h18m11.775321942s) [upload=236945]: Done uploading segments... Jul 5 17:28:37.004698051 (296h18m11.775339386s) [upload=236945]: Upload finished. err: <nil> Duration: 5.840344239s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 5.680159244s FAIL (2025-07-05 17:48:14 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ent. successful: 13 optimal: 13 errs: <nil> Jul 5 17:27:16.571809944 (296h16m51.342451279s) [upload=236932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:27:16.571815556 (296h16m51.342456891s) [upload=236932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:27:16.863746763 (296h16m51.634388098s) [upload=236932]: Done uploading segments... Jul 5 17:27:16.863764737 (296h16m51.634406072s) [upload=236932]: Upload finished. err: <nil> Jul 5 17:28:09.347078064 (296h17m44.117719429s) [upload=236945]: Starting upload Jul 5 17:28:09.347155812 (296h17m44.117797177s) [upload=236945]: Done starting upload Jul 5 17:28:09.347274910 (296h17m44.117916235s) [upload=236945]: Uploading segments... Jul 5 17:28:09.347379050 (296h17m44.118020375s) [upload=236945]: Got next segment. Inline: false Jul 5 17:28:09.347407714 (296h17m44.118049049s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 17:28:09.347412954 (296h17m44.118054289s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 5 17:28:09.588206709 (296h17m44.358848034s) [seg_pos={0 0}, upload=236945]: Begin upload segment... Jul 5 17:28:09.588274739 (296h17m44.358916074s) [seg_pos={0 0}, upload=236945]: Done begin upload segment. Jul 5 17:28:09.588323944 (296h17m44.358965279s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588379069 (296h17m44.359020404s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588734989 (296h17m44.359376314s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588935924 (296h17m44.359577259s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589011298 (296h17m44.359652633s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589270053 (296h17m44.359911389s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590002835 (296h17m44.36064416s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590746688 (296h17m44.361388043s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590753250 (296h17m44.361394585s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591032105 (296h17m44.36167344s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591093732 (296h17m44.361735067s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591452879 (296h17m44.362094215s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591644045 (296h17m44.36228538s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591713738 (296h17m44.362355063s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592268069 (296h17m44.362909394s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592567602 (296h17m44.363208937s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:11.227912581 (296h17m45.998553916s) [upload=236945]: Next returned nil segment Jul 5 17:28:11.227925805 (296h17m45.99856714s) [upload=236945]: Waiting for error group managing segments... Jul 5 17:28:11.529771340 (296h17m46.300412675s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.537274264 (296h17m46.307915599s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.543770743 (296h17m46.314412088s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.562362180 (296h17m46.333003515s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.599523163 (296h17m46.370164498s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.639344807 (296h17m46.409986142s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.657182702 (296h17m46.427824037s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.670611894 (296h17m46.441253229s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.694057187 (296h17m46.464698522s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:29.767976961 (296h18m4.538618326s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:30.958706550 (296h18m5.729347885s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:34.136679007 (296h18m8.907320332s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719142580 (296h18m11.489783905s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719168730 (296h18m11.489810085s) [seg_pos={0 0}, upload=236945]: Segment reached optimal threshold of 13 pieces. Jul 5 17:28:36.719447222 (296h18m11.490088547s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection Jul 5 17:28:36.719487790 (296h18m11.490129126s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Jul 5 17:28:36.719529169 (296h18m11.490170514s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection Jul 5 17:28:36.719580027 (296h18m11.490221362s) [seg_pos={0 0}, upload=236945]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 5 17:28:36.719668395 (296h18m11.49030973s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:28:36.719674027 (296h18m11.490315362s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:28:37.004680607 (296h18m11.775321942s) [upload=236945]: Done uploading segments... Jul 5 17:28:37.004698051 (296h18m11.775339386s) [upload=236945]: Upload finished. err: <nil> Duration: 5.680186467s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.420644062s FAIL (2025-07-05 17:48:07 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.420667068s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.570193557s FAIL (2025-07-05 17:47:35 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.570215509s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 5.686587751s FAIL (2025-07-05 17:47:21 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ent. successful: 13 optimal: 13 errs: <nil> Jul 5 17:27:16.571809944 (296h16m51.342451279s) [upload=236932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:27:16.571815556 (296h16m51.342456891s) [upload=236932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:27:16.863746763 (296h16m51.634388098s) [upload=236932]: Done uploading segments... Jul 5 17:27:16.863764737 (296h16m51.634406072s) [upload=236932]: Upload finished. err: <nil> Jul 5 17:28:09.347078064 (296h17m44.117719429s) [upload=236945]: Starting upload Jul 5 17:28:09.347155812 (296h17m44.117797177s) [upload=236945]: Done starting upload Jul 5 17:28:09.347274910 (296h17m44.117916235s) [upload=236945]: Uploading segments... Jul 5 17:28:09.347379050 (296h17m44.118020375s) [upload=236945]: Got next segment. Inline: false Jul 5 17:28:09.347407714 (296h17m44.118049049s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 17:28:09.347412954 (296h17m44.118054289s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 5 17:28:09.588206709 (296h17m44.358848034s) [seg_pos={0 0}, upload=236945]: Begin upload segment... Jul 5 17:28:09.588274739 (296h17m44.358916074s) [seg_pos={0 0}, upload=236945]: Done begin upload segment. Jul 5 17:28:09.588323944 (296h17m44.358965279s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588379069 (296h17m44.359020404s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588734989 (296h17m44.359376314s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588935924 (296h17m44.359577259s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589011298 (296h17m44.359652633s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589270053 (296h17m44.359911389s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590002835 (296h17m44.36064416s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590746688 (296h17m44.361388043s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590753250 (296h17m44.361394585s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591032105 (296h17m44.36167344s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591093732 (296h17m44.361735067s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591452879 (296h17m44.362094215s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591644045 (296h17m44.36228538s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591713738 (296h17m44.362355063s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592268069 (296h17m44.362909394s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592567602 (296h17m44.363208937s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:11.227912581 (296h17m45.998553916s) [upload=236945]: Next returned nil segment Jul 5 17:28:11.227925805 (296h17m45.99856714s) [upload=236945]: Waiting for error group managing segments... Jul 5 17:28:11.529771340 (296h17m46.300412675s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.537274264 (296h17m46.307915599s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.543770743 (296h17m46.314412088s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.562362180 (296h17m46.333003515s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.599523163 (296h17m46.370164498s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.639344807 (296h17m46.409986142s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.657182702 (296h17m46.427824037s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.670611894 (296h17m46.441253229s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.694057187 (296h17m46.464698522s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:29.767976961 (296h18m4.538618326s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:30.958706550 (296h18m5.729347885s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:34.136679007 (296h18m8.907320332s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719142580 (296h18m11.489783905s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719168730 (296h18m11.489810085s) [seg_pos={0 0}, upload=236945]: Segment reached optimal threshold of 13 pieces. Jul 5 17:28:36.719447222 (296h18m11.490088547s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection Jul 5 17:28:36.719487790 (296h18m11.490129126s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Jul 5 17:28:36.719529169 (296h18m11.490170514s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection Jul 5 17:28:36.719580027 (296h18m11.490221362s) [seg_pos={0 0}, upload=236945]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 5 17:28:36.719668395 (296h18m11.49030973s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:28:36.719674027 (296h18m11.490315362s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:28:37.004680607 (296h18m11.775321942s) [upload=236945]: Done uploading segments... Jul 5 17:28:37.004698051 (296h18m11.775339386s) [upload=236945]: Upload finished. err: <nil> Duration: 5.686623178s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.45175331s FAIL (2025-07-05 17:47:17 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.45176884s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.551837179s FAIL (2025-07-05 17:46:34 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.551868409s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 6.028773703s FAIL (2025-07-05 17:46:21 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ent. successful: 13 optimal: 13 errs: <nil> Jul 5 17:27:16.571809944 (296h16m51.342451279s) [upload=236932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:27:16.571815556 (296h16m51.342456891s) [upload=236932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:27:16.863746763 (296h16m51.634388098s) [upload=236932]: Done uploading segments... Jul 5 17:27:16.863764737 (296h16m51.634406072s) [upload=236932]: Upload finished. err: <nil> Jul 5 17:28:09.347078064 (296h17m44.117719429s) [upload=236945]: Starting upload Jul 5 17:28:09.347155812 (296h17m44.117797177s) [upload=236945]: Done starting upload Jul 5 17:28:09.347274910 (296h17m44.117916235s) [upload=236945]: Uploading segments... Jul 5 17:28:09.347379050 (296h17m44.118020375s) [upload=236945]: Got next segment. Inline: false Jul 5 17:28:09.347407714 (296h17m44.118049049s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 17:28:09.347412954 (296h17m44.118054289s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 5 17:28:09.588206709 (296h17m44.358848034s) [seg_pos={0 0}, upload=236945]: Begin upload segment... Jul 5 17:28:09.588274739 (296h17m44.358916074s) [seg_pos={0 0}, upload=236945]: Done begin upload segment. Jul 5 17:28:09.588323944 (296h17m44.358965279s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588379069 (296h17m44.359020404s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588734989 (296h17m44.359376314s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588935924 (296h17m44.359577259s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589011298 (296h17m44.359652633s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589270053 (296h17m44.359911389s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590002835 (296h17m44.36064416s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590746688 (296h17m44.361388043s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590753250 (296h17m44.361394585s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591032105 (296h17m44.36167344s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591093732 (296h17m44.361735067s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591452879 (296h17m44.362094215s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591644045 (296h17m44.36228538s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591713738 (296h17m44.362355063s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592268069 (296h17m44.362909394s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592567602 (296h17m44.363208937s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:11.227912581 (296h17m45.998553916s) [upload=236945]: Next returned nil segment Jul 5 17:28:11.227925805 (296h17m45.99856714s) [upload=236945]: Waiting for error group managing segments... Jul 5 17:28:11.529771340 (296h17m46.300412675s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.537274264 (296h17m46.307915599s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.543770743 (296h17m46.314412088s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.562362180 (296h17m46.333003515s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.599523163 (296h17m46.370164498s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.639344807 (296h17m46.409986142s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.657182702 (296h17m46.427824037s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.670611894 (296h17m46.441253229s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.694057187 (296h17m46.464698522s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:29.767976961 (296h18m4.538618326s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:30.958706550 (296h18m5.729347885s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:34.136679007 (296h18m8.907320332s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719142580 (296h18m11.489783905s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719168730 (296h18m11.489810085s) [seg_pos={0 0}, upload=236945]: Segment reached optimal threshold of 13 pieces. Jul 5 17:28:36.719447222 (296h18m11.490088547s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection Jul 5 17:28:36.719487790 (296h18m11.490129126s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Jul 5 17:28:36.719529169 (296h18m11.490170514s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection Jul 5 17:28:36.719580027 (296h18m11.490221362s) [seg_pos={0 0}, upload=236945]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 5 17:28:36.719668395 (296h18m11.49030973s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:28:36.719674027 (296h18m11.490315362s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:28:37.004680607 (296h18m11.775321942s) [upload=236945]: Done uploading segments... Jul 5 17:28:37.004698051 (296h18m11.775339386s) [upload=236945]: Upload finished. err: <nil> Duration: 6.028798038s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.728673566s FAIL (2025-07-05 17:45:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.728710086s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 5.731616208s FAIL (2025-07-05 17:45:39 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ent. successful: 13 optimal: 13 errs: <nil> Jul 5 17:27:16.571809944 (296h16m51.342451279s) [upload=236932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:27:16.571815556 (296h16m51.342456891s) [upload=236932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:27:16.863746763 (296h16m51.634388098s) [upload=236932]: Done uploading segments... Jul 5 17:27:16.863764737 (296h16m51.634406072s) [upload=236932]: Upload finished. err: <nil> Jul 5 17:28:09.347078064 (296h17m44.117719429s) [upload=236945]: Starting upload Jul 5 17:28:09.347155812 (296h17m44.117797177s) [upload=236945]: Done starting upload Jul 5 17:28:09.347274910 (296h17m44.117916235s) [upload=236945]: Uploading segments... Jul 5 17:28:09.347379050 (296h17m44.118020375s) [upload=236945]: Got next segment. Inline: false Jul 5 17:28:09.347407714 (296h17m44.118049049s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 17:28:09.347412954 (296h17m44.118054289s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 5 17:28:09.588206709 (296h17m44.358848034s) [seg_pos={0 0}, upload=236945]: Begin upload segment... Jul 5 17:28:09.588274739 (296h17m44.358916074s) [seg_pos={0 0}, upload=236945]: Done begin upload segment. Jul 5 17:28:09.588323944 (296h17m44.358965279s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588379069 (296h17m44.359020404s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588734989 (296h17m44.359376314s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588935924 (296h17m44.359577259s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589011298 (296h17m44.359652633s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589270053 (296h17m44.359911389s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590002835 (296h17m44.36064416s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590746688 (296h17m44.361388043s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590753250 (296h17m44.361394585s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591032105 (296h17m44.36167344s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591093732 (296h17m44.361735067s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591452879 (296h17m44.362094215s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591644045 (296h17m44.36228538s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591713738 (296h17m44.362355063s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592268069 (296h17m44.362909394s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592567602 (296h17m44.363208937s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:11.227912581 (296h17m45.998553916s) [upload=236945]: Next returned nil segment Jul 5 17:28:11.227925805 (296h17m45.99856714s) [upload=236945]: Waiting for error group managing segments... Jul 5 17:28:11.529771340 (296h17m46.300412675s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.537274264 (296h17m46.307915599s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.543770743 (296h17m46.314412088s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.562362180 (296h17m46.333003515s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.599523163 (296h17m46.370164498s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.639344807 (296h17m46.409986142s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.657182702 (296h17m46.427824037s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.670611894 (296h17m46.441253229s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.694057187 (296h17m46.464698522s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:29.767976961 (296h18m4.538618326s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:30.958706550 (296h18m5.729347885s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:34.136679007 (296h18m8.907320332s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719142580 (296h18m11.489783905s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719168730 (296h18m11.489810085s) [seg_pos={0 0}, upload=236945]: Segment reached optimal threshold of 13 pieces. Jul 5 17:28:36.719447222 (296h18m11.490088547s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection Jul 5 17:28:36.719487790 (296h18m11.490129126s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Jul 5 17:28:36.719529169 (296h18m11.490170514s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection Jul 5 17:28:36.719580027 (296h18m11.490221362s) [seg_pos={0 0}, upload=236945]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 5 17:28:36.719668395 (296h18m11.49030973s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:28:36.719674027 (296h18m11.490315362s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:28:37.004680607 (296h18m11.775321942s) [upload=236945]: Done uploading segments... Jul 5 17:28:37.004698051 (296h18m11.775339386s) [upload=236945]: Upload finished. err: <nil> Duration: 5.731646586s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.46411103s FAIL (2025-07-05 17:45:20 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.464134255s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 5.678664456s FAIL (2025-07-05 17:45:09 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ent. successful: 13 optimal: 13 errs: <nil> Jul 5 17:27:16.571809944 (296h16m51.342451279s) [upload=236932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:27:16.571815556 (296h16m51.342456891s) [upload=236932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:27:16.863746763 (296h16m51.634388098s) [upload=236932]: Done uploading segments... Jul 5 17:27:16.863764737 (296h16m51.634406072s) [upload=236932]: Upload finished. err: <nil> Jul 5 17:28:09.347078064 (296h17m44.117719429s) [upload=236945]: Starting upload Jul 5 17:28:09.347155812 (296h17m44.117797177s) [upload=236945]: Done starting upload Jul 5 17:28:09.347274910 (296h17m44.117916235s) [upload=236945]: Uploading segments... Jul 5 17:28:09.347379050 (296h17m44.118020375s) [upload=236945]: Got next segment. Inline: false Jul 5 17:28:09.347407714 (296h17m44.118049049s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 17:28:09.347412954 (296h17m44.118054289s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 5 17:28:09.588206709 (296h17m44.358848034s) [seg_pos={0 0}, upload=236945]: Begin upload segment... Jul 5 17:28:09.588274739 (296h17m44.358916074s) [seg_pos={0 0}, upload=236945]: Done begin upload segment. Jul 5 17:28:09.588323944 (296h17m44.358965279s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588379069 (296h17m44.359020404s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588734989 (296h17m44.359376314s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588935924 (296h17m44.359577259s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589011298 (296h17m44.359652633s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589270053 (296h17m44.359911389s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590002835 (296h17m44.36064416s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590746688 (296h17m44.361388043s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590753250 (296h17m44.361394585s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591032105 (296h17m44.36167344s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591093732 (296h17m44.361735067s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591452879 (296h17m44.362094215s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591644045 (296h17m44.36228538s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591713738 (296h17m44.362355063s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592268069 (296h17m44.362909394s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592567602 (296h17m44.363208937s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:11.227912581 (296h17m45.998553916s) [upload=236945]: Next returned nil segment Jul 5 17:28:11.227925805 (296h17m45.99856714s) [upload=236945]: Waiting for error group managing segments... Jul 5 17:28:11.529771340 (296h17m46.300412675s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.537274264 (296h17m46.307915599s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.543770743 (296h17m46.314412088s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.562362180 (296h17m46.333003515s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.599523163 (296h17m46.370164498s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.639344807 (296h17m46.409986142s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.657182702 (296h17m46.427824037s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.670611894 (296h17m46.441253229s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.694057187 (296h17m46.464698522s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:29.767976961 (296h18m4.538618326s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:30.958706550 (296h18m5.729347885s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:34.136679007 (296h18m8.907320332s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719142580 (296h18m11.489783905s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719168730 (296h18m11.489810085s) [seg_pos={0 0}, upload=236945]: Segment reached optimal threshold of 13 pieces. Jul 5 17:28:36.719447222 (296h18m11.490088547s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection Jul 5 17:28:36.719487790 (296h18m11.490129126s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Jul 5 17:28:36.719529169 (296h18m11.490170514s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection Jul 5 17:28:36.719580027 (296h18m11.490221362s) [seg_pos={0 0}, upload=236945]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 5 17:28:36.719668395 (296h18m11.49030973s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:28:36.719674027 (296h18m11.490315362s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:28:37.004680607 (296h18m11.775321942s) [upload=236945]: Done uploading segments... Jul 5 17:28:37.004698051 (296h18m11.775339386s) [upload=236945]: Upload finished. err: <nil> Duration: 5.678697488s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.514994386s FAIL (2025-07-05 17:44:33 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.515025115s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.705776101s FAIL (2025-07-05 17:44:21 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ent. successful: 13 optimal: 13 errs: <nil> Jul 5 17:27:16.571809944 (296h16m51.342451279s) [upload=236932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:27:16.571815556 (296h16m51.342456891s) [upload=236932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:27:16.863746763 (296h16m51.634388098s) [upload=236932]: Done uploading segments... Jul 5 17:27:16.863764737 (296h16m51.634406072s) [upload=236932]: Upload finished. err: <nil> Jul 5 17:28:09.347078064 (296h17m44.117719429s) [upload=236945]: Starting upload Jul 5 17:28:09.347155812 (296h17m44.117797177s) [upload=236945]: Done starting upload Jul 5 17:28:09.347274910 (296h17m44.117916235s) [upload=236945]: Uploading segments... Jul 5 17:28:09.347379050 (296h17m44.118020375s) [upload=236945]: Got next segment. Inline: false Jul 5 17:28:09.347407714 (296h17m44.118049049s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 17:28:09.347412954 (296h17m44.118054289s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 5 17:28:09.588206709 (296h17m44.358848034s) [seg_pos={0 0}, upload=236945]: Begin upload segment... Jul 5 17:28:09.588274739 (296h17m44.358916074s) [seg_pos={0 0}, upload=236945]: Done begin upload segment. Jul 5 17:28:09.588323944 (296h17m44.358965279s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588379069 (296h17m44.359020404s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588734989 (296h17m44.359376314s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588935924 (296h17m44.359577259s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589011298 (296h17m44.359652633s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589270053 (296h17m44.359911389s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590002835 (296h17m44.36064416s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590746688 (296h17m44.361388043s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590753250 (296h17m44.361394585s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591032105 (296h17m44.36167344s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591093732 (296h17m44.361735067s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591452879 (296h17m44.362094215s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591644045 (296h17m44.36228538s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591713738 (296h17m44.362355063s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592268069 (296h17m44.362909394s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592567602 (296h17m44.363208937s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:11.227912581 (296h17m45.998553916s) [upload=236945]: Next returned nil segment Jul 5 17:28:11.227925805 (296h17m45.99856714s) [upload=236945]: Waiting for error group managing segments... Jul 5 17:28:11.529771340 (296h17m46.300412675s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.537274264 (296h17m46.307915599s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.543770743 (296h17m46.314412088s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.562362180 (296h17m46.333003515s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.599523163 (296h17m46.370164498s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.639344807 (296h17m46.409986142s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.657182702 (296h17m46.427824037s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.670611894 (296h17m46.441253229s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.694057187 (296h17m46.464698522s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:29.767976961 (296h18m4.538618326s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:30.958706550 (296h18m5.729347885s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:34.136679007 (296h18m8.907320332s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719142580 (296h18m11.489783905s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719168730 (296h18m11.489810085s) [seg_pos={0 0}, upload=236945]: Segment reached optimal threshold of 13 pieces. Jul 5 17:28:36.719447222 (296h18m11.490088547s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection Jul 5 17:28:36.719487790 (296h18m11.490129126s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Jul 5 17:28:36.719529169 (296h18m11.490170514s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection Jul 5 17:28:36.719580027 (296h18m11.490221362s) [seg_pos={0 0}, upload=236945]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 5 17:28:36.719668395 (296h18m11.49030973s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:28:36.719674027 (296h18m11.490315362s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:28:37.004680607 (296h18m11.775321942s) [upload=236945]: Done uploading segments... Jul 5 17:28:37.004698051 (296h18m11.775339386s) [upload=236945]: Upload finished. err: <nil> Duration: 5.705799706s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.580489849s FAIL (2025-07-05 17:44:03 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.580509958s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.654413633s FAIL (2025-07-05 17:43:57 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ent. successful: 13 optimal: 13 errs: <nil> Jul 5 17:27:16.571809944 (296h16m51.342451279s) [upload=236932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:27:16.571815556 (296h16m51.342456891s) [upload=236932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:27:16.863746763 (296h16m51.634388098s) [upload=236932]: Done uploading segments... Jul 5 17:27:16.863764737 (296h16m51.634406072s) [upload=236932]: Upload finished. err: <nil> Jul 5 17:28:09.347078064 (296h17m44.117719429s) [upload=236945]: Starting upload Jul 5 17:28:09.347155812 (296h17m44.117797177s) [upload=236945]: Done starting upload Jul 5 17:28:09.347274910 (296h17m44.117916235s) [upload=236945]: Uploading segments... Jul 5 17:28:09.347379050 (296h17m44.118020375s) [upload=236945]: Got next segment. Inline: false Jul 5 17:28:09.347407714 (296h17m44.118049049s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 17:28:09.347412954 (296h17m44.118054289s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 5 17:28:09.588206709 (296h17m44.358848034s) [seg_pos={0 0}, upload=236945]: Begin upload segment... Jul 5 17:28:09.588274739 (296h17m44.358916074s) [seg_pos={0 0}, upload=236945]: Done begin upload segment. Jul 5 17:28:09.588323944 (296h17m44.358965279s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588379069 (296h17m44.359020404s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588734989 (296h17m44.359376314s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588935924 (296h17m44.359577259s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589011298 (296h17m44.359652633s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589270053 (296h17m44.359911389s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590002835 (296h17m44.36064416s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590746688 (296h17m44.361388043s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590753250 (296h17m44.361394585s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591032105 (296h17m44.36167344s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591093732 (296h17m44.361735067s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591452879 (296h17m44.362094215s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591644045 (296h17m44.36228538s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591713738 (296h17m44.362355063s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592268069 (296h17m44.362909394s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592567602 (296h17m44.363208937s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:11.227912581 (296h17m45.998553916s) [upload=236945]: Next returned nil segment Jul 5 17:28:11.227925805 (296h17m45.99856714s) [upload=236945]: Waiting for error group managing segments... Jul 5 17:28:11.529771340 (296h17m46.300412675s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.537274264 (296h17m46.307915599s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.543770743 (296h17m46.314412088s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.562362180 (296h17m46.333003515s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.599523163 (296h17m46.370164498s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.639344807 (296h17m46.409986142s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.657182702 (296h17m46.427824037s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.670611894 (296h17m46.441253229s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.694057187 (296h17m46.464698522s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:29.767976961 (296h18m4.538618326s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:30.958706550 (296h18m5.729347885s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:34.136679007 (296h18m8.907320332s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719142580 (296h18m11.489783905s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719168730 (296h18m11.489810085s) [seg_pos={0 0}, upload=236945]: Segment reached optimal threshold of 13 pieces. Jul 5 17:28:36.719447222 (296h18m11.490088547s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection Jul 5 17:28:36.719487790 (296h18m11.490129126s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Jul 5 17:28:36.719529169 (296h18m11.490170514s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection Jul 5 17:28:36.719580027 (296h18m11.490221362s) [seg_pos={0 0}, upload=236945]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 5 17:28:36.719668395 (296h18m11.49030973s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:28:36.719674027 (296h18m11.490315362s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:28:37.004680607 (296h18m11.775321942s) [upload=236945]: Done uploading segments... Jul 5 17:28:37.004698051 (296h18m11.775339386s) [upload=236945]: Upload finished. err: <nil> Duration: 5.654435686s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.594698011s FAIL (2025-07-05 17:43:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.594716617s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 5.711671402s FAIL (2025-07-05 17:43:23 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ent. successful: 13 optimal: 13 errs: <nil> Jul 5 17:27:16.571809944 (296h16m51.342451279s) [upload=236932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:27:16.571815556 (296h16m51.342456891s) [upload=236932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:27:16.863746763 (296h16m51.634388098s) [upload=236932]: Done uploading segments... Jul 5 17:27:16.863764737 (296h16m51.634406072s) [upload=236932]: Upload finished. err: <nil> Jul 5 17:28:09.347078064 (296h17m44.117719429s) [upload=236945]: Starting upload Jul 5 17:28:09.347155812 (296h17m44.117797177s) [upload=236945]: Done starting upload Jul 5 17:28:09.347274910 (296h17m44.117916235s) [upload=236945]: Uploading segments... Jul 5 17:28:09.347379050 (296h17m44.118020375s) [upload=236945]: Got next segment. Inline: false Jul 5 17:28:09.347407714 (296h17m44.118049049s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 17:28:09.347412954 (296h17m44.118054289s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 5 17:28:09.588206709 (296h17m44.358848034s) [seg_pos={0 0}, upload=236945]: Begin upload segment... Jul 5 17:28:09.588274739 (296h17m44.358916074s) [seg_pos={0 0}, upload=236945]: Done begin upload segment. Jul 5 17:28:09.588323944 (296h17m44.358965279s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588379069 (296h17m44.359020404s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588734989 (296h17m44.359376314s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588935924 (296h17m44.359577259s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589011298 (296h17m44.359652633s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589270053 (296h17m44.359911389s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590002835 (296h17m44.36064416s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590746688 (296h17m44.361388043s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590753250 (296h17m44.361394585s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591032105 (296h17m44.36167344s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591093732 (296h17m44.361735067s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591452879 (296h17m44.362094215s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591644045 (296h17m44.36228538s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591713738 (296h17m44.362355063s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592268069 (296h17m44.362909394s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592567602 (296h17m44.363208937s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:11.227912581 (296h17m45.998553916s) [upload=236945]: Next returned nil segment Jul 5 17:28:11.227925805 (296h17m45.99856714s) [upload=236945]: Waiting for error group managing segments... Jul 5 17:28:11.529771340 (296h17m46.300412675s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.537274264 (296h17m46.307915599s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.543770743 (296h17m46.314412088s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.562362180 (296h17m46.333003515s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.599523163 (296h17m46.370164498s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.639344807 (296h17m46.409986142s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.657182702 (296h17m46.427824037s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.670611894 (296h17m46.441253229s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.694057187 (296h17m46.464698522s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:29.767976961 (296h18m4.538618326s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:30.958706550 (296h18m5.729347885s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:34.136679007 (296h18m8.907320332s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719142580 (296h18m11.489783905s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719168730 (296h18m11.489810085s) [seg_pos={0 0}, upload=236945]: Segment reached optimal threshold of 13 pieces. Jul 5 17:28:36.719447222 (296h18m11.490088547s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection Jul 5 17:28:36.719487790 (296h18m11.490129126s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Jul 5 17:28:36.719529169 (296h18m11.490170514s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection Jul 5 17:28:36.719580027 (296h18m11.490221362s) [seg_pos={0 0}, upload=236945]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 5 17:28:36.719668395 (296h18m11.49030973s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:28:36.719674027 (296h18m11.490315362s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:28:37.004680607 (296h18m11.775321942s) [upload=236945]: Done uploading segments... Jul 5 17:28:37.004698051 (296h18m11.775339386s) [upload=236945]: Upload finished. err: <nil> Duration: 5.711703704s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.475703692s FAIL (2025-07-05 17:43:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.475724682s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.795891674s FAIL (2025-07-05 17:42:23 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ent. successful: 13 optimal: 13 errs: <nil> Jul 5 17:27:16.571809944 (296h16m51.342451279s) [upload=236932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:27:16.571815556 (296h16m51.342456891s) [upload=236932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:27:16.863746763 (296h16m51.634388098s) [upload=236932]: Done uploading segments... Jul 5 17:27:16.863764737 (296h16m51.634406072s) [upload=236932]: Upload finished. err: <nil> Jul 5 17:28:09.347078064 (296h17m44.117719429s) [upload=236945]: Starting upload Jul 5 17:28:09.347155812 (296h17m44.117797177s) [upload=236945]: Done starting upload Jul 5 17:28:09.347274910 (296h17m44.117916235s) [upload=236945]: Uploading segments... Jul 5 17:28:09.347379050 (296h17m44.118020375s) [upload=236945]: Got next segment. Inline: false Jul 5 17:28:09.347407714 (296h17m44.118049049s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 17:28:09.347412954 (296h17m44.118054289s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 5 17:28:09.588206709 (296h17m44.358848034s) [seg_pos={0 0}, upload=236945]: Begin upload segment... Jul 5 17:28:09.588274739 (296h17m44.358916074s) [seg_pos={0 0}, upload=236945]: Done begin upload segment. Jul 5 17:28:09.588323944 (296h17m44.358965279s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588379069 (296h17m44.359020404s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588734989 (296h17m44.359376314s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588935924 (296h17m44.359577259s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589011298 (296h17m44.359652633s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589270053 (296h17m44.359911389s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590002835 (296h17m44.36064416s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590746688 (296h17m44.361388043s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590753250 (296h17m44.361394585s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591032105 (296h17m44.36167344s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591093732 (296h17m44.361735067s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591452879 (296h17m44.362094215s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591644045 (296h17m44.36228538s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591713738 (296h17m44.362355063s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592268069 (296h17m44.362909394s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592567602 (296h17m44.363208937s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:11.227912581 (296h17m45.998553916s) [upload=236945]: Next returned nil segment Jul 5 17:28:11.227925805 (296h17m45.99856714s) [upload=236945]: Waiting for error group managing segments... Jul 5 17:28:11.529771340 (296h17m46.300412675s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.537274264 (296h17m46.307915599s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.543770743 (296h17m46.314412088s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.562362180 (296h17m46.333003515s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.599523163 (296h17m46.370164498s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.639344807 (296h17m46.409986142s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.657182702 (296h17m46.427824037s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.670611894 (296h17m46.441253229s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.694057187 (296h17m46.464698522s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:29.767976961 (296h18m4.538618326s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:30.958706550 (296h18m5.729347885s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:34.136679007 (296h18m8.907320332s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719142580 (296h18m11.489783905s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719168730 (296h18m11.489810085s) [seg_pos={0 0}, upload=236945]: Segment reached optimal threshold of 13 pieces. Jul 5 17:28:36.719447222 (296h18m11.490088547s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection Jul 5 17:28:36.719487790 (296h18m11.490129126s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Jul 5 17:28:36.719529169 (296h18m11.490170514s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection Jul 5 17:28:36.719580027 (296h18m11.490221362s) [seg_pos={0 0}, upload=236945]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 5 17:28:36.719668395 (296h18m11.49030973s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:28:36.719674027 (296h18m11.490315362s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:28:37.004680607 (296h18m11.775321942s) [upload=236945]: Done uploading segments... Jul 5 17:28:37.004698051 (296h18m11.775339386s) [upload=236945]: Upload finished. err: <nil> Duration: 5.79592152s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.583853621s FAIL (2025-07-05 17:41:59 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.583875042s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.821519593s FAIL (2025-07-05 17:41:13 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ent. successful: 13 optimal: 13 errs: <nil> Jul 5 17:27:16.571809944 (296h16m51.342451279s) [upload=236932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:27:16.571815556 (296h16m51.342456891s) [upload=236932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:27:16.863746763 (296h16m51.634388098s) [upload=236932]: Done uploading segments... Jul 5 17:27:16.863764737 (296h16m51.634406072s) [upload=236932]: Upload finished. err: <nil> Jul 5 17:28:09.347078064 (296h17m44.117719429s) [upload=236945]: Starting upload Jul 5 17:28:09.347155812 (296h17m44.117797177s) [upload=236945]: Done starting upload Jul 5 17:28:09.347274910 (296h17m44.117916235s) [upload=236945]: Uploading segments... Jul 5 17:28:09.347379050 (296h17m44.118020375s) [upload=236945]: Got next segment. Inline: false Jul 5 17:28:09.347407714 (296h17m44.118049049s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 17:28:09.347412954 (296h17m44.118054289s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 5 17:28:09.588206709 (296h17m44.358848034s) [seg_pos={0 0}, upload=236945]: Begin upload segment... Jul 5 17:28:09.588274739 (296h17m44.358916074s) [seg_pos={0 0}, upload=236945]: Done begin upload segment. Jul 5 17:28:09.588323944 (296h17m44.358965279s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588379069 (296h17m44.359020404s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588734989 (296h17m44.359376314s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588935924 (296h17m44.359577259s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589011298 (296h17m44.359652633s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589270053 (296h17m44.359911389s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590002835 (296h17m44.36064416s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590746688 (296h17m44.361388043s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590753250 (296h17m44.361394585s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591032105 (296h17m44.36167344s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591093732 (296h17m44.361735067s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591452879 (296h17m44.362094215s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591644045 (296h17m44.36228538s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591713738 (296h17m44.362355063s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592268069 (296h17m44.362909394s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592567602 (296h17m44.363208937s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:11.227912581 (296h17m45.998553916s) [upload=236945]: Next returned nil segment Jul 5 17:28:11.227925805 (296h17m45.99856714s) [upload=236945]: Waiting for error group managing segments... Jul 5 17:28:11.529771340 (296h17m46.300412675s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.537274264 (296h17m46.307915599s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.543770743 (296h17m46.314412088s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.562362180 (296h17m46.333003515s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.599523163 (296h17m46.370164498s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.639344807 (296h17m46.409986142s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.657182702 (296h17m46.427824037s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.670611894 (296h17m46.441253229s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.694057187 (296h17m46.464698522s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:29.767976961 (296h18m4.538618326s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:30.958706550 (296h18m5.729347885s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:34.136679007 (296h18m8.907320332s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719142580 (296h18m11.489783905s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719168730 (296h18m11.489810085s) [seg_pos={0 0}, upload=236945]: Segment reached optimal threshold of 13 pieces. Jul 5 17:28:36.719447222 (296h18m11.490088547s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection Jul 5 17:28:36.719487790 (296h18m11.490129126s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Jul 5 17:28:36.719529169 (296h18m11.490170514s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection Jul 5 17:28:36.719580027 (296h18m11.490221362s) [seg_pos={0 0}, upload=236945]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 5 17:28:36.719668395 (296h18m11.49030973s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:28:36.719674027 (296h18m11.490315362s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:28:37.004680607 (296h18m11.775321942s) [upload=236945]: Done uploading segments... Jul 5 17:28:37.004698051 (296h18m11.775339386s) [upload=236945]: Upload finished. err: <nil> Duration: 5.821547085s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.461883734s FAIL (2025-07-05 17:40:55 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.461900725s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.837851786s FAIL (2025-07-05 17:40:26 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ent. successful: 13 optimal: 13 errs: <nil> Jul 5 17:27:16.571809944 (296h16m51.342451279s) [upload=236932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:27:16.571815556 (296h16m51.342456891s) [upload=236932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:27:16.863746763 (296h16m51.634388098s) [upload=236932]: Done uploading segments... Jul 5 17:27:16.863764737 (296h16m51.634406072s) [upload=236932]: Upload finished. err: <nil> Jul 5 17:28:09.347078064 (296h17m44.117719429s) [upload=236945]: Starting upload Jul 5 17:28:09.347155812 (296h17m44.117797177s) [upload=236945]: Done starting upload Jul 5 17:28:09.347274910 (296h17m44.117916235s) [upload=236945]: Uploading segments... Jul 5 17:28:09.347379050 (296h17m44.118020375s) [upload=236945]: Got next segment. Inline: false Jul 5 17:28:09.347407714 (296h17m44.118049049s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 17:28:09.347412954 (296h17m44.118054289s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 5 17:28:09.588206709 (296h17m44.358848034s) [seg_pos={0 0}, upload=236945]: Begin upload segment... Jul 5 17:28:09.588274739 (296h17m44.358916074s) [seg_pos={0 0}, upload=236945]: Done begin upload segment. Jul 5 17:28:09.588323944 (296h17m44.358965279s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588379069 (296h17m44.359020404s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588734989 (296h17m44.359376314s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588935924 (296h17m44.359577259s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589011298 (296h17m44.359652633s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589270053 (296h17m44.359911389s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590002835 (296h17m44.36064416s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590746688 (296h17m44.361388043s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590753250 (296h17m44.361394585s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591032105 (296h17m44.36167344s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591093732 (296h17m44.361735067s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591452879 (296h17m44.362094215s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591644045 (296h17m44.36228538s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591713738 (296h17m44.362355063s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592268069 (296h17m44.362909394s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592567602 (296h17m44.363208937s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:11.227912581 (296h17m45.998553916s) [upload=236945]: Next returned nil segment Jul 5 17:28:11.227925805 (296h17m45.99856714s) [upload=236945]: Waiting for error group managing segments... Jul 5 17:28:11.529771340 (296h17m46.300412675s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.537274264 (296h17m46.307915599s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.543770743 (296h17m46.314412088s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.562362180 (296h17m46.333003515s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.599523163 (296h17m46.370164498s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.639344807 (296h17m46.409986142s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.657182702 (296h17m46.427824037s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.670611894 (296h17m46.441253229s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.694057187 (296h17m46.464698522s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:29.767976961 (296h18m4.538618326s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:30.958706550 (296h18m5.729347885s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:34.136679007 (296h18m8.907320332s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719142580 (296h18m11.489783905s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719168730 (296h18m11.489810085s) [seg_pos={0 0}, upload=236945]: Segment reached optimal threshold of 13 pieces. Jul 5 17:28:36.719447222 (296h18m11.490088547s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection Jul 5 17:28:36.719487790 (296h18m11.490129126s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Jul 5 17:28:36.719529169 (296h18m11.490170514s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection Jul 5 17:28:36.719580027 (296h18m11.490221362s) [seg_pos={0 0}, upload=236945]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 5 17:28:36.719668395 (296h18m11.49030973s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:28:36.719674027 (296h18m11.490315362s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:28:37.004680607 (296h18m11.775321942s) [upload=236945]: Done uploading segments... Jul 5 17:28:37.004698051 (296h18m11.775339386s) [upload=236945]: Upload finished. err: <nil> Duration: 5.837885029s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.558808981s FAIL (2025-07-05 17:40:24 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.558826234s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.638994153s FAIL (2025-07-05 17:39:57 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ent. successful: 13 optimal: 13 errs: <nil> Jul 5 17:27:16.571809944 (296h16m51.342451279s) [upload=236932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:27:16.571815556 (296h16m51.342456891s) [upload=236932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:27:16.863746763 (296h16m51.634388098s) [upload=236932]: Done uploading segments... Jul 5 17:27:16.863764737 (296h16m51.634406072s) [upload=236932]: Upload finished. err: <nil> Jul 5 17:28:09.347078064 (296h17m44.117719429s) [upload=236945]: Starting upload Jul 5 17:28:09.347155812 (296h17m44.117797177s) [upload=236945]: Done starting upload Jul 5 17:28:09.347274910 (296h17m44.117916235s) [upload=236945]: Uploading segments... Jul 5 17:28:09.347379050 (296h17m44.118020375s) [upload=236945]: Got next segment. Inline: false Jul 5 17:28:09.347407714 (296h17m44.118049049s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 17:28:09.347412954 (296h17m44.118054289s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 5 17:28:09.588206709 (296h17m44.358848034s) [seg_pos={0 0}, upload=236945]: Begin upload segment... Jul 5 17:28:09.588274739 (296h17m44.358916074s) [seg_pos={0 0}, upload=236945]: Done begin upload segment. Jul 5 17:28:09.588323944 (296h17m44.358965279s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588379069 (296h17m44.359020404s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588734989 (296h17m44.359376314s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588935924 (296h17m44.359577259s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589011298 (296h17m44.359652633s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589270053 (296h17m44.359911389s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590002835 (296h17m44.36064416s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590746688 (296h17m44.361388043s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590753250 (296h17m44.361394585s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591032105 (296h17m44.36167344s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591093732 (296h17m44.361735067s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591452879 (296h17m44.362094215s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591644045 (296h17m44.36228538s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591713738 (296h17m44.362355063s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592268069 (296h17m44.362909394s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592567602 (296h17m44.363208937s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:11.227912581 (296h17m45.998553916s) [upload=236945]: Next returned nil segment Jul 5 17:28:11.227925805 (296h17m45.99856714s) [upload=236945]: Waiting for error group managing segments... Jul 5 17:28:11.529771340 (296h17m46.300412675s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.537274264 (296h17m46.307915599s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.543770743 (296h17m46.314412088s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.562362180 (296h17m46.333003515s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.599523163 (296h17m46.370164498s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.639344807 (296h17m46.409986142s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.657182702 (296h17m46.427824037s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.670611894 (296h17m46.441253229s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.694057187 (296h17m46.464698522s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:29.767976961 (296h18m4.538618326s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:30.958706550 (296h18m5.729347885s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:34.136679007 (296h18m8.907320332s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719142580 (296h18m11.489783905s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719168730 (296h18m11.489810085s) [seg_pos={0 0}, upload=236945]: Segment reached optimal threshold of 13 pieces. Jul 5 17:28:36.719447222 (296h18m11.490088547s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection Jul 5 17:28:36.719487790 (296h18m11.490129126s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Jul 5 17:28:36.719529169 (296h18m11.490170514s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection Jul 5 17:28:36.719580027 (296h18m11.490221362s) [seg_pos={0 0}, upload=236945]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 5 17:28:36.719668395 (296h18m11.49030973s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:28:36.719674027 (296h18m11.490315362s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:28:37.004680607 (296h18m11.775321942s) [upload=236945]: Done uploading segments... Jul 5 17:28:37.004698051 (296h18m11.775339386s) [upload=236945]: Upload finished. err: <nil> Duration: 5.639021043s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.702957232s FAIL (2025-07-05 17:39:37 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ent. successful: 13 optimal: 13 errs: <nil> Jul 5 17:27:16.571809944 (296h16m51.342451279s) [upload=236932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:27:16.571815556 (296h16m51.342456891s) [upload=236932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:27:16.863746763 (296h16m51.634388098s) [upload=236932]: Done uploading segments... Jul 5 17:27:16.863764737 (296h16m51.634406072s) [upload=236932]: Upload finished. err: <nil> Jul 5 17:28:09.347078064 (296h17m44.117719429s) [upload=236945]: Starting upload Jul 5 17:28:09.347155812 (296h17m44.117797177s) [upload=236945]: Done starting upload Jul 5 17:28:09.347274910 (296h17m44.117916235s) [upload=236945]: Uploading segments... Jul 5 17:28:09.347379050 (296h17m44.118020375s) [upload=236945]: Got next segment. Inline: false Jul 5 17:28:09.347407714 (296h17m44.118049049s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 17:28:09.347412954 (296h17m44.118054289s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 5 17:28:09.588206709 (296h17m44.358848034s) [seg_pos={0 0}, upload=236945]: Begin upload segment... Jul 5 17:28:09.588274739 (296h17m44.358916074s) [seg_pos={0 0}, upload=236945]: Done begin upload segment. Jul 5 17:28:09.588323944 (296h17m44.358965279s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588379069 (296h17m44.359020404s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588734989 (296h17m44.359376314s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588935924 (296h17m44.359577259s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589011298 (296h17m44.359652633s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589270053 (296h17m44.359911389s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590002835 (296h17m44.36064416s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590746688 (296h17m44.361388043s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590753250 (296h17m44.361394585s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591032105 (296h17m44.36167344s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591093732 (296h17m44.361735067s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591452879 (296h17m44.362094215s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591644045 (296h17m44.36228538s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591713738 (296h17m44.362355063s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592268069 (296h17m44.362909394s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592567602 (296h17m44.363208937s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:11.227912581 (296h17m45.998553916s) [upload=236945]: Next returned nil segment Jul 5 17:28:11.227925805 (296h17m45.99856714s) [upload=236945]: Waiting for error group managing segments... Jul 5 17:28:11.529771340 (296h17m46.300412675s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.537274264 (296h17m46.307915599s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.543770743 (296h17m46.314412088s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.562362180 (296h17m46.333003515s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.599523163 (296h17m46.370164498s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.639344807 (296h17m46.409986142s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.657182702 (296h17m46.427824037s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.670611894 (296h17m46.441253229s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.694057187 (296h17m46.464698522s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:29.767976961 (296h18m4.538618326s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:30.958706550 (296h18m5.729347885s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:34.136679007 (296h18m8.907320332s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719142580 (296h18m11.489783905s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719168730 (296h18m11.489810085s) [seg_pos={0 0}, upload=236945]: Segment reached optimal threshold of 13 pieces. Jul 5 17:28:36.719447222 (296h18m11.490088547s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection Jul 5 17:28:36.719487790 (296h18m11.490129126s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Jul 5 17:28:36.719529169 (296h18m11.490170514s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection Jul 5 17:28:36.719580027 (296h18m11.490221362s) [seg_pos={0 0}, upload=236945]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 5 17:28:36.719668395 (296h18m11.49030973s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:28:36.719674027 (296h18m11.490315362s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:28:37.004680607 (296h18m11.775321942s) [upload=236945]: Done uploading segments... Jul 5 17:28:37.004698051 (296h18m11.775339386s) [upload=236945]: Upload finished. err: <nil> Duration: 5.702981798s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.537901822s FAIL (2025-07-05 17:39:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.537923745s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.745229813s FAIL (2025-07-05 17:38:43 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ent. successful: 13 optimal: 13 errs: <nil> Jul 5 17:27:16.571809944 (296h16m51.342451279s) [upload=236932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:27:16.571815556 (296h16m51.342456891s) [upload=236932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:27:16.863746763 (296h16m51.634388098s) [upload=236932]: Done uploading segments... Jul 5 17:27:16.863764737 (296h16m51.634406072s) [upload=236932]: Upload finished. err: <nil> Jul 5 17:28:09.347078064 (296h17m44.117719429s) [upload=236945]: Starting upload Jul 5 17:28:09.347155812 (296h17m44.117797177s) [upload=236945]: Done starting upload Jul 5 17:28:09.347274910 (296h17m44.117916235s) [upload=236945]: Uploading segments... Jul 5 17:28:09.347379050 (296h17m44.118020375s) [upload=236945]: Got next segment. Inline: false Jul 5 17:28:09.347407714 (296h17m44.118049049s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 17:28:09.347412954 (296h17m44.118054289s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 5 17:28:09.588206709 (296h17m44.358848034s) [seg_pos={0 0}, upload=236945]: Begin upload segment... Jul 5 17:28:09.588274739 (296h17m44.358916074s) [seg_pos={0 0}, upload=236945]: Done begin upload segment. Jul 5 17:28:09.588323944 (296h17m44.358965279s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588379069 (296h17m44.359020404s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588734989 (296h17m44.359376314s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588935924 (296h17m44.359577259s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589011298 (296h17m44.359652633s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589270053 (296h17m44.359911389s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590002835 (296h17m44.36064416s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590746688 (296h17m44.361388043s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590753250 (296h17m44.361394585s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591032105 (296h17m44.36167344s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591093732 (296h17m44.361735067s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591452879 (296h17m44.362094215s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591644045 (296h17m44.36228538s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591713738 (296h17m44.362355063s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592268069 (296h17m44.362909394s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592567602 (296h17m44.363208937s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:11.227912581 (296h17m45.998553916s) [upload=236945]: Next returned nil segment Jul 5 17:28:11.227925805 (296h17m45.99856714s) [upload=236945]: Waiting for error group managing segments... Jul 5 17:28:11.529771340 (296h17m46.300412675s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.537274264 (296h17m46.307915599s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.543770743 (296h17m46.314412088s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.562362180 (296h17m46.333003515s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.599523163 (296h17m46.370164498s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.639344807 (296h17m46.409986142s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.657182702 (296h17m46.427824037s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.670611894 (296h17m46.441253229s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.694057187 (296h17m46.464698522s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:29.767976961 (296h18m4.538618326s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:30.958706550 (296h18m5.729347885s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:34.136679007 (296h18m8.907320332s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719142580 (296h18m11.489783905s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719168730 (296h18m11.489810085s) [seg_pos={0 0}, upload=236945]: Segment reached optimal threshold of 13 pieces. Jul 5 17:28:36.719447222 (296h18m11.490088547s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection Jul 5 17:28:36.719487790 (296h18m11.490129126s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Jul 5 17:28:36.719529169 (296h18m11.490170514s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection Jul 5 17:28:36.719580027 (296h18m11.490221362s) [seg_pos={0 0}, upload=236945]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 5 17:28:36.719668395 (296h18m11.49030973s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:28:36.719674027 (296h18m11.490315362s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:28:37.004680607 (296h18m11.775321942s) [upload=236945]: Done uploading segments... Jul 5 17:28:37.004698051 (296h18m11.775339386s) [upload=236945]: Upload finished. err: <nil> Duration: 5.745253208s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.453093469s FAIL (2025-07-05 17:38:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.453114861s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.566833364s FAIL (2025-07-05 17:37:54 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.566854884s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 5.824752964s FAIL (2025-07-05 17:37:48 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ent. successful: 13 optimal: 13 errs: <nil> Jul 5 17:27:16.571809944 (296h16m51.342451279s) [upload=236932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:27:16.571815556 (296h16m51.342456891s) [upload=236932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:27:16.863746763 (296h16m51.634388098s) [upload=236932]: Done uploading segments... Jul 5 17:27:16.863764737 (296h16m51.634406072s) [upload=236932]: Upload finished. err: <nil> Jul 5 17:28:09.347078064 (296h17m44.117719429s) [upload=236945]: Starting upload Jul 5 17:28:09.347155812 (296h17m44.117797177s) [upload=236945]: Done starting upload Jul 5 17:28:09.347274910 (296h17m44.117916235s) [upload=236945]: Uploading segments... Jul 5 17:28:09.347379050 (296h17m44.118020375s) [upload=236945]: Got next segment. Inline: false Jul 5 17:28:09.347407714 (296h17m44.118049049s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 17:28:09.347412954 (296h17m44.118054289s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 5 17:28:09.588206709 (296h17m44.358848034s) [seg_pos={0 0}, upload=236945]: Begin upload segment... Jul 5 17:28:09.588274739 (296h17m44.358916074s) [seg_pos={0 0}, upload=236945]: Done begin upload segment. Jul 5 17:28:09.588323944 (296h17m44.358965279s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588379069 (296h17m44.359020404s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588734989 (296h17m44.359376314s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588935924 (296h17m44.359577259s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589011298 (296h17m44.359652633s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589270053 (296h17m44.359911389s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590002835 (296h17m44.36064416s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590746688 (296h17m44.361388043s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590753250 (296h17m44.361394585s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591032105 (296h17m44.36167344s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591093732 (296h17m44.361735067s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591452879 (296h17m44.362094215s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591644045 (296h17m44.36228538s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591713738 (296h17m44.362355063s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592268069 (296h17m44.362909394s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592567602 (296h17m44.363208937s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:11.227912581 (296h17m45.998553916s) [upload=236945]: Next returned nil segment Jul 5 17:28:11.227925805 (296h17m45.99856714s) [upload=236945]: Waiting for error group managing segments... Jul 5 17:28:11.529771340 (296h17m46.300412675s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.537274264 (296h17m46.307915599s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.543770743 (296h17m46.314412088s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.562362180 (296h17m46.333003515s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.599523163 (296h17m46.370164498s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.639344807 (296h17m46.409986142s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.657182702 (296h17m46.427824037s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.670611894 (296h17m46.441253229s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.694057187 (296h17m46.464698522s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:29.767976961 (296h18m4.538618326s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:30.958706550 (296h18m5.729347885s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:34.136679007 (296h18m8.907320332s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719142580 (296h18m11.489783905s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719168730 (296h18m11.489810085s) [seg_pos={0 0}, upload=236945]: Segment reached optimal threshold of 13 pieces. Jul 5 17:28:36.719447222 (296h18m11.490088547s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection Jul 5 17:28:36.719487790 (296h18m11.490129126s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Jul 5 17:28:36.719529169 (296h18m11.490170514s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection Jul 5 17:28:36.719580027 (296h18m11.490221362s) [seg_pos={0 0}, upload=236945]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 5 17:28:36.719668395 (296h18m11.49030973s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:28:36.719674027 (296h18m11.490315362s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:28:37.004680607 (296h18m11.775321942s) [upload=236945]: Done uploading segments... Jul 5 17:28:37.004698051 (296h18m11.775339386s) [upload=236945]: Upload finished. err: <nil> Duration: 5.824780929s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.779886968s FAIL (2025-07-05 17:37:08 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ent. successful: 13 optimal: 13 errs: <nil> Jul 5 17:27:16.571809944 (296h16m51.342451279s) [upload=236932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:27:16.571815556 (296h16m51.342456891s) [upload=236932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:27:16.863746763 (296h16m51.634388098s) [upload=236932]: Done uploading segments... Jul 5 17:27:16.863764737 (296h16m51.634406072s) [upload=236932]: Upload finished. err: <nil> Jul 5 17:28:09.347078064 (296h17m44.117719429s) [upload=236945]: Starting upload Jul 5 17:28:09.347155812 (296h17m44.117797177s) [upload=236945]: Done starting upload Jul 5 17:28:09.347274910 (296h17m44.117916235s) [upload=236945]: Uploading segments... Jul 5 17:28:09.347379050 (296h17m44.118020375s) [upload=236945]: Got next segment. Inline: false Jul 5 17:28:09.347407714 (296h17m44.118049049s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 17:28:09.347412954 (296h17m44.118054289s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 5 17:28:09.588206709 (296h17m44.358848034s) [seg_pos={0 0}, upload=236945]: Begin upload segment... Jul 5 17:28:09.588274739 (296h17m44.358916074s) [seg_pos={0 0}, upload=236945]: Done begin upload segment. Jul 5 17:28:09.588323944 (296h17m44.358965279s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588379069 (296h17m44.359020404s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588734989 (296h17m44.359376314s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588935924 (296h17m44.359577259s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589011298 (296h17m44.359652633s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589270053 (296h17m44.359911389s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590002835 (296h17m44.36064416s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590746688 (296h17m44.361388043s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590753250 (296h17m44.361394585s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591032105 (296h17m44.36167344s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591093732 (296h17m44.361735067s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591452879 (296h17m44.362094215s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591644045 (296h17m44.36228538s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591713738 (296h17m44.362355063s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592268069 (296h17m44.362909394s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592567602 (296h17m44.363208937s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:11.227912581 (296h17m45.998553916s) [upload=236945]: Next returned nil segment Jul 5 17:28:11.227925805 (296h17m45.99856714s) [upload=236945]: Waiting for error group managing segments... Jul 5 17:28:11.529771340 (296h17m46.300412675s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.537274264 (296h17m46.307915599s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.543770743 (296h17m46.314412088s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.562362180 (296h17m46.333003515s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.599523163 (296h17m46.370164498s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.639344807 (296h17m46.409986142s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.657182702 (296h17m46.427824037s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.670611894 (296h17m46.441253229s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.694057187 (296h17m46.464698522s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:29.767976961 (296h18m4.538618326s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:30.958706550 (296h18m5.729347885s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:34.136679007 (296h18m8.907320332s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719142580 (296h18m11.489783905s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719168730 (296h18m11.489810085s) [seg_pos={0 0}, upload=236945]: Segment reached optimal threshold of 13 pieces. Jul 5 17:28:36.719447222 (296h18m11.490088547s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection Jul 5 17:28:36.719487790 (296h18m11.490129126s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Jul 5 17:28:36.719529169 (296h18m11.490170514s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection Jul 5 17:28:36.719580027 (296h18m11.490221362s) [seg_pos={0 0}, upload=236945]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 5 17:28:36.719668395 (296h18m11.49030973s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:28:36.719674027 (296h18m11.490315362s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:28:37.004680607 (296h18m11.775321942s) [upload=236945]: Done uploading segments... Jul 5 17:28:37.004698051 (296h18m11.775339386s) [upload=236945]: Upload finished. err: <nil> Duration: 5.779910963s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.459952558s FAIL (2025-07-05 17:37:04 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.459974279s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.693812236s FAIL (2025-07-05 17:36:23 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ent. successful: 13 optimal: 13 errs: <nil> Jul 5 17:27:16.571809944 (296h16m51.342451279s) [upload=236932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:27:16.571815556 (296h16m51.342456891s) [upload=236932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:27:16.863746763 (296h16m51.634388098s) [upload=236932]: Done uploading segments... Jul 5 17:27:16.863764737 (296h16m51.634406072s) [upload=236932]: Upload finished. err: <nil> Jul 5 17:28:09.347078064 (296h17m44.117719429s) [upload=236945]: Starting upload Jul 5 17:28:09.347155812 (296h17m44.117797177s) [upload=236945]: Done starting upload Jul 5 17:28:09.347274910 (296h17m44.117916235s) [upload=236945]: Uploading segments... Jul 5 17:28:09.347379050 (296h17m44.118020375s) [upload=236945]: Got next segment. Inline: false Jul 5 17:28:09.347407714 (296h17m44.118049049s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 17:28:09.347412954 (296h17m44.118054289s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 5 17:28:09.588206709 (296h17m44.358848034s) [seg_pos={0 0}, upload=236945]: Begin upload segment... Jul 5 17:28:09.588274739 (296h17m44.358916074s) [seg_pos={0 0}, upload=236945]: Done begin upload segment. Jul 5 17:28:09.588323944 (296h17m44.358965279s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588379069 (296h17m44.359020404s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588734989 (296h17m44.359376314s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588935924 (296h17m44.359577259s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589011298 (296h17m44.359652633s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589270053 (296h17m44.359911389s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590002835 (296h17m44.36064416s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590746688 (296h17m44.361388043s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590753250 (296h17m44.361394585s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591032105 (296h17m44.36167344s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591093732 (296h17m44.361735067s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591452879 (296h17m44.362094215s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591644045 (296h17m44.36228538s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591713738 (296h17m44.362355063s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592268069 (296h17m44.362909394s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592567602 (296h17m44.363208937s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:11.227912581 (296h17m45.998553916s) [upload=236945]: Next returned nil segment Jul 5 17:28:11.227925805 (296h17m45.99856714s) [upload=236945]: Waiting for error group managing segments... Jul 5 17:28:11.529771340 (296h17m46.300412675s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.537274264 (296h17m46.307915599s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.543770743 (296h17m46.314412088s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.562362180 (296h17m46.333003515s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.599523163 (296h17m46.370164498s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.639344807 (296h17m46.409986142s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.657182702 (296h17m46.427824037s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.670611894 (296h17m46.441253229s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.694057187 (296h17m46.464698522s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:29.767976961 (296h18m4.538618326s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:30.958706550 (296h18m5.729347885s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:34.136679007 (296h18m8.907320332s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719142580 (296h18m11.489783905s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719168730 (296h18m11.489810085s) [seg_pos={0 0}, upload=236945]: Segment reached optimal threshold of 13 pieces. Jul 5 17:28:36.719447222 (296h18m11.490088547s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection Jul 5 17:28:36.719487790 (296h18m11.490129126s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Jul 5 17:28:36.719529169 (296h18m11.490170514s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection Jul 5 17:28:36.719580027 (296h18m11.490221362s) [seg_pos={0 0}, upload=236945]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 5 17:28:36.719668395 (296h18m11.49030973s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:28:36.719674027 (296h18m11.490315362s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:28:37.004680607 (296h18m11.775321942s) [upload=236945]: Done uploading segments... Jul 5 17:28:37.004698051 (296h18m11.775339386s) [upload=236945]: Upload finished. err: <nil> Duration: 5.693841061s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.46463283s FAIL (2025-07-05 17:35:56 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.464657157s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.681219653s FAIL (2025-07-05 17:35:44 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ent. successful: 13 optimal: 13 errs: <nil> Jul 5 17:27:16.571809944 (296h16m51.342451279s) [upload=236932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:27:16.571815556 (296h16m51.342456891s) [upload=236932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:27:16.863746763 (296h16m51.634388098s) [upload=236932]: Done uploading segments... Jul 5 17:27:16.863764737 (296h16m51.634406072s) [upload=236932]: Upload finished. err: <nil> Jul 5 17:28:09.347078064 (296h17m44.117719429s) [upload=236945]: Starting upload Jul 5 17:28:09.347155812 (296h17m44.117797177s) [upload=236945]: Done starting upload Jul 5 17:28:09.347274910 (296h17m44.117916235s) [upload=236945]: Uploading segments... Jul 5 17:28:09.347379050 (296h17m44.118020375s) [upload=236945]: Got next segment. Inline: false Jul 5 17:28:09.347407714 (296h17m44.118049049s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 17:28:09.347412954 (296h17m44.118054289s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 5 17:28:09.588206709 (296h17m44.358848034s) [seg_pos={0 0}, upload=236945]: Begin upload segment... Jul 5 17:28:09.588274739 (296h17m44.358916074s) [seg_pos={0 0}, upload=236945]: Done begin upload segment. Jul 5 17:28:09.588323944 (296h17m44.358965279s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588379069 (296h17m44.359020404s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588734989 (296h17m44.359376314s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588935924 (296h17m44.359577259s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589011298 (296h17m44.359652633s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589270053 (296h17m44.359911389s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590002835 (296h17m44.36064416s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590746688 (296h17m44.361388043s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590753250 (296h17m44.361394585s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591032105 (296h17m44.36167344s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591093732 (296h17m44.361735067s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591452879 (296h17m44.362094215s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591644045 (296h17m44.36228538s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591713738 (296h17m44.362355063s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592268069 (296h17m44.362909394s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592567602 (296h17m44.363208937s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:11.227912581 (296h17m45.998553916s) [upload=236945]: Next returned nil segment Jul 5 17:28:11.227925805 (296h17m45.99856714s) [upload=236945]: Waiting for error group managing segments... Jul 5 17:28:11.529771340 (296h17m46.300412675s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.537274264 (296h17m46.307915599s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.543770743 (296h17m46.314412088s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.562362180 (296h17m46.333003515s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.599523163 (296h17m46.370164498s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.639344807 (296h17m46.409986142s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.657182702 (296h17m46.427824037s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.670611894 (296h17m46.441253229s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.694057187 (296h17m46.464698522s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:29.767976961 (296h18m4.538618326s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:30.958706550 (296h18m5.729347885s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:34.136679007 (296h18m8.907320332s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719142580 (296h18m11.489783905s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719168730 (296h18m11.489810085s) [seg_pos={0 0}, upload=236945]: Segment reached optimal threshold of 13 pieces. Jul 5 17:28:36.719447222 (296h18m11.490088547s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection Jul 5 17:28:36.719487790 (296h18m11.490129126s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Jul 5 17:28:36.719529169 (296h18m11.490170514s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection Jul 5 17:28:36.719580027 (296h18m11.490221362s) [seg_pos={0 0}, upload=236945]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 5 17:28:36.719668395 (296h18m11.49030973s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:28:36.719674027 (296h18m11.490315362s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:28:37.004680607 (296h18m11.775321942s) [upload=236945]: Done uploading segments... Jul 5 17:28:37.004698051 (296h18m11.775339386s) [upload=236945]: Upload finished. err: <nil> Duration: 5.681246965s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.674138917s FAIL (2025-07-05 17:35:01 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ent. successful: 13 optimal: 13 errs: <nil> Jul 5 17:27:16.571809944 (296h16m51.342451279s) [upload=236932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:27:16.571815556 (296h16m51.342456891s) [upload=236932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:27:16.863746763 (296h16m51.634388098s) [upload=236932]: Done uploading segments... Jul 5 17:27:16.863764737 (296h16m51.634406072s) [upload=236932]: Upload finished. err: <nil> Jul 5 17:28:09.347078064 (296h17m44.117719429s) [upload=236945]: Starting upload Jul 5 17:28:09.347155812 (296h17m44.117797177s) [upload=236945]: Done starting upload Jul 5 17:28:09.347274910 (296h17m44.117916235s) [upload=236945]: Uploading segments... Jul 5 17:28:09.347379050 (296h17m44.118020375s) [upload=236945]: Got next segment. Inline: false Jul 5 17:28:09.347407714 (296h17m44.118049049s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 17:28:09.347412954 (296h17m44.118054289s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 5 17:28:09.588206709 (296h17m44.358848034s) [seg_pos={0 0}, upload=236945]: Begin upload segment... Jul 5 17:28:09.588274739 (296h17m44.358916074s) [seg_pos={0 0}, upload=236945]: Done begin upload segment. Jul 5 17:28:09.588323944 (296h17m44.358965279s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588379069 (296h17m44.359020404s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588734989 (296h17m44.359376314s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588935924 (296h17m44.359577259s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589011298 (296h17m44.359652633s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589270053 (296h17m44.359911389s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590002835 (296h17m44.36064416s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590746688 (296h17m44.361388043s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590753250 (296h17m44.361394585s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591032105 (296h17m44.36167344s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591093732 (296h17m44.361735067s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591452879 (296h17m44.362094215s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591644045 (296h17m44.36228538s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591713738 (296h17m44.362355063s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592268069 (296h17m44.362909394s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592567602 (296h17m44.363208937s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:11.227912581 (296h17m45.998553916s) [upload=236945]: Next returned nil segment Jul 5 17:28:11.227925805 (296h17m45.99856714s) [upload=236945]: Waiting for error group managing segments... Jul 5 17:28:11.529771340 (296h17m46.300412675s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.537274264 (296h17m46.307915599s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.543770743 (296h17m46.314412088s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.562362180 (296h17m46.333003515s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.599523163 (296h17m46.370164498s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.639344807 (296h17m46.409986142s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.657182702 (296h17m46.427824037s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.670611894 (296h17m46.441253229s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.694057187 (296h17m46.464698522s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:29.767976961 (296h18m4.538618326s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:30.958706550 (296h18m5.729347885s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:34.136679007 (296h18m8.907320332s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719142580 (296h18m11.489783905s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719168730 (296h18m11.489810085s) [seg_pos={0 0}, upload=236945]: Segment reached optimal threshold of 13 pieces. Jul 5 17:28:36.719447222 (296h18m11.490088547s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection Jul 5 17:28:36.719487790 (296h18m11.490129126s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Jul 5 17:28:36.719529169 (296h18m11.490170514s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection Jul 5 17:28:36.719580027 (296h18m11.490221362s) [seg_pos={0 0}, upload=236945]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 5 17:28:36.719668395 (296h18m11.49030973s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:28:36.719674027 (296h18m11.490315362s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:28:37.004680607 (296h18m11.775321942s) [upload=236945]: Done uploading segments... Jul 5 17:28:37.004698051 (296h18m11.775339386s) [upload=236945]: Upload finished. err: <nil> Duration: 5.674171188s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.459272586s FAIL (2025-07-05 17:35:00 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.459293988s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.806617425s FAIL (2025-07-05 17:34:46 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ent. successful: 13 optimal: 13 errs: <nil> Jul 5 17:27:16.571809944 (296h16m51.342451279s) [upload=236932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:27:16.571815556 (296h16m51.342456891s) [upload=236932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:27:16.863746763 (296h16m51.634388098s) [upload=236932]: Done uploading segments... Jul 5 17:27:16.863764737 (296h16m51.634406072s) [upload=236932]: Upload finished. err: <nil> Jul 5 17:28:09.347078064 (296h17m44.117719429s) [upload=236945]: Starting upload Jul 5 17:28:09.347155812 (296h17m44.117797177s) [upload=236945]: Done starting upload Jul 5 17:28:09.347274910 (296h17m44.117916235s) [upload=236945]: Uploading segments... Jul 5 17:28:09.347379050 (296h17m44.118020375s) [upload=236945]: Got next segment. Inline: false Jul 5 17:28:09.347407714 (296h17m44.118049049s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 17:28:09.347412954 (296h17m44.118054289s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 5 17:28:09.588206709 (296h17m44.358848034s) [seg_pos={0 0}, upload=236945]: Begin upload segment... Jul 5 17:28:09.588274739 (296h17m44.358916074s) [seg_pos={0 0}, upload=236945]: Done begin upload segment. Jul 5 17:28:09.588323944 (296h17m44.358965279s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588379069 (296h17m44.359020404s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588734989 (296h17m44.359376314s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588935924 (296h17m44.359577259s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589011298 (296h17m44.359652633s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589270053 (296h17m44.359911389s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590002835 (296h17m44.36064416s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590746688 (296h17m44.361388043s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590753250 (296h17m44.361394585s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591032105 (296h17m44.36167344s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591093732 (296h17m44.361735067s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591452879 (296h17m44.362094215s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591644045 (296h17m44.36228538s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591713738 (296h17m44.362355063s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592268069 (296h17m44.362909394s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592567602 (296h17m44.363208937s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:11.227912581 (296h17m45.998553916s) [upload=236945]: Next returned nil segment Jul 5 17:28:11.227925805 (296h17m45.99856714s) [upload=236945]: Waiting for error group managing segments... Jul 5 17:28:11.529771340 (296h17m46.300412675s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.537274264 (296h17m46.307915599s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.543770743 (296h17m46.314412088s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.562362180 (296h17m46.333003515s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.599523163 (296h17m46.370164498s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.639344807 (296h17m46.409986142s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.657182702 (296h17m46.427824037s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.670611894 (296h17m46.441253229s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.694057187 (296h17m46.464698522s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:29.767976961 (296h18m4.538618326s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:30.958706550 (296h18m5.729347885s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:34.136679007 (296h18m8.907320332s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719142580 (296h18m11.489783905s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719168730 (296h18m11.489810085s) [seg_pos={0 0}, upload=236945]: Segment reached optimal threshold of 13 pieces. Jul 5 17:28:36.719447222 (296h18m11.490088547s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection Jul 5 17:28:36.719487790 (296h18m11.490129126s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Jul 5 17:28:36.719529169 (296h18m11.490170514s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection Jul 5 17:28:36.719580027 (296h18m11.490221362s) [seg_pos={0 0}, upload=236945]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 5 17:28:36.719668395 (296h18m11.49030973s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:28:36.719674027 (296h18m11.490315362s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:28:37.004680607 (296h18m11.775321942s) [upload=236945]: Done uploading segments... Jul 5 17:28:37.004698051 (296h18m11.775339386s) [upload=236945]: Upload finished. err: <nil> Duration: 5.806643796s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.797010674s FAIL (2025-07-05 17:34:10 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ent. successful: 13 optimal: 13 errs: <nil> Jul 5 17:27:16.571809944 (296h16m51.342451279s) [upload=236932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:27:16.571815556 (296h16m51.342456891s) [upload=236932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:27:16.863746763 (296h16m51.634388098s) [upload=236932]: Done uploading segments... Jul 5 17:27:16.863764737 (296h16m51.634406072s) [upload=236932]: Upload finished. err: <nil> Jul 5 17:28:09.347078064 (296h17m44.117719429s) [upload=236945]: Starting upload Jul 5 17:28:09.347155812 (296h17m44.117797177s) [upload=236945]: Done starting upload Jul 5 17:28:09.347274910 (296h17m44.117916235s) [upload=236945]: Uploading segments... Jul 5 17:28:09.347379050 (296h17m44.118020375s) [upload=236945]: Got next segment. Inline: false Jul 5 17:28:09.347407714 (296h17m44.118049049s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 17:28:09.347412954 (296h17m44.118054289s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 5 17:28:09.588206709 (296h17m44.358848034s) [seg_pos={0 0}, upload=236945]: Begin upload segment... Jul 5 17:28:09.588274739 (296h17m44.358916074s) [seg_pos={0 0}, upload=236945]: Done begin upload segment. Jul 5 17:28:09.588323944 (296h17m44.358965279s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588379069 (296h17m44.359020404s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588734989 (296h17m44.359376314s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588935924 (296h17m44.359577259s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589011298 (296h17m44.359652633s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589270053 (296h17m44.359911389s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590002835 (296h17m44.36064416s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590746688 (296h17m44.361388043s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590753250 (296h17m44.361394585s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591032105 (296h17m44.36167344s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591093732 (296h17m44.361735067s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591452879 (296h17m44.362094215s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591644045 (296h17m44.36228538s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591713738 (296h17m44.362355063s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592268069 (296h17m44.362909394s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592567602 (296h17m44.363208937s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:11.227912581 (296h17m45.998553916s) [upload=236945]: Next returned nil segment Jul 5 17:28:11.227925805 (296h17m45.99856714s) [upload=236945]: Waiting for error group managing segments... Jul 5 17:28:11.529771340 (296h17m46.300412675s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.537274264 (296h17m46.307915599s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.543770743 (296h17m46.314412088s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.562362180 (296h17m46.333003515s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.599523163 (296h17m46.370164498s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.639344807 (296h17m46.409986142s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.657182702 (296h17m46.427824037s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.670611894 (296h17m46.441253229s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.694057187 (296h17m46.464698522s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:29.767976961 (296h18m4.538618326s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:30.958706550 (296h18m5.729347885s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:34.136679007 (296h18m8.907320332s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719142580 (296h18m11.489783905s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719168730 (296h18m11.489810085s) [seg_pos={0 0}, upload=236945]: Segment reached optimal threshold of 13 pieces. Jul 5 17:28:36.719447222 (296h18m11.490088547s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection Jul 5 17:28:36.719487790 (296h18m11.490129126s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Jul 5 17:28:36.719529169 (296h18m11.490170514s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection Jul 5 17:28:36.719580027 (296h18m11.490221362s) [seg_pos={0 0}, upload=236945]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 5 17:28:36.719668395 (296h18m11.49030973s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:28:36.719674027 (296h18m11.490315362s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:28:37.004680607 (296h18m11.775321942s) [upload=236945]: Done uploading segments... Jul 5 17:28:37.004698051 (296h18m11.775339386s) [upload=236945]: Upload finished. err: <nil> Duration: 5.797038057s core uplink us-select-1
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.452034568s FAIL (2025-07-05 17:33:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 5.452057031s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.728145688s FAIL (2025-07-05 17:33:43 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ent. successful: 13 optimal: 13 errs: <nil> Jul 5 17:27:16.571809944 (296h16m51.342451279s) [upload=236932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:27:16.571815556 (296h16m51.342456891s) [upload=236932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:27:16.863746763 (296h16m51.634388098s) [upload=236932]: Done uploading segments... Jul 5 17:27:16.863764737 (296h16m51.634406072s) [upload=236932]: Upload finished. err: <nil> Jul 5 17:28:09.347078064 (296h17m44.117719429s) [upload=236945]: Starting upload Jul 5 17:28:09.347155812 (296h17m44.117797177s) [upload=236945]: Done starting upload Jul 5 17:28:09.347274910 (296h17m44.117916235s) [upload=236945]: Uploading segments... Jul 5 17:28:09.347379050 (296h17m44.118020375s) [upload=236945]: Got next segment. Inline: false Jul 5 17:28:09.347407714 (296h17m44.118049049s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 17:28:09.347412954 (296h17m44.118054289s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 5 17:28:09.588206709 (296h17m44.358848034s) [seg_pos={0 0}, upload=236945]: Begin upload segment... Jul 5 17:28:09.588274739 (296h17m44.358916074s) [seg_pos={0 0}, upload=236945]: Done begin upload segment. Jul 5 17:28:09.588323944 (296h17m44.358965279s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588379069 (296h17m44.359020404s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588734989 (296h17m44.359376314s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588935924 (296h17m44.359577259s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589011298 (296h17m44.359652633s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589270053 (296h17m44.359911389s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590002835 (296h17m44.36064416s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590746688 (296h17m44.361388043s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590753250 (296h17m44.361394585s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591032105 (296h17m44.36167344s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591093732 (296h17m44.361735067s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591452879 (296h17m44.362094215s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591644045 (296h17m44.36228538s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591713738 (296h17m44.362355063s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592268069 (296h17m44.362909394s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592567602 (296h17m44.363208937s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:11.227912581 (296h17m45.998553916s) [upload=236945]: Next returned nil segment Jul 5 17:28:11.227925805 (296h17m45.99856714s) [upload=236945]: Waiting for error group managing segments... Jul 5 17:28:11.529771340 (296h17m46.300412675s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.537274264 (296h17m46.307915599s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.543770743 (296h17m46.314412088s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.562362180 (296h17m46.333003515s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.599523163 (296h17m46.370164498s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.639344807 (296h17m46.409986142s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.657182702 (296h17m46.427824037s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.670611894 (296h17m46.441253229s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.694057187 (296h17m46.464698522s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:29.767976961 (296h18m4.538618326s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:30.958706550 (296h18m5.729347885s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:34.136679007 (296h18m8.907320332s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719142580 (296h18m11.489783905s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719168730 (296h18m11.489810085s) [seg_pos={0 0}, upload=236945]: Segment reached optimal threshold of 13 pieces. Jul 5 17:28:36.719447222 (296h18m11.490088547s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection Jul 5 17:28:36.719487790 (296h18m11.490129126s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Jul 5 17:28:36.719529169 (296h18m11.490170514s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection Jul 5 17:28:36.719580027 (296h18m11.490221362s) [seg_pos={0 0}, upload=236945]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 5 17:28:36.719668395 (296h18m11.49030973s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:28:36.719674027 (296h18m11.490315362s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:28:37.004680607 (296h18m11.775321942s) [upload=236945]: Done uploading segments... Jul 5 17:28:37.004698051 (296h18m11.775339386s) [upload=236945]: Upload finished. err: <nil> Duration: 5.728170314s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.724060082s FAIL (2025-07-05 17:33:26 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== ent. successful: 13 optimal: 13 errs: <nil> Jul 5 17:27:16.571809944 (296h16m51.342451279s) [upload=236932]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:27:16.571815556 (296h16m51.342456891s) [upload=236932]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:27:16.863746763 (296h16m51.634388098s) [upload=236932]: Done uploading segments... Jul 5 17:27:16.863764737 (296h16m51.634406072s) [upload=236932]: Upload finished. err: <nil> Jul 5 17:28:09.347078064 (296h17m44.117719429s) [upload=236945]: Starting upload Jul 5 17:28:09.347155812 (296h17m44.117797177s) [upload=236945]: Done starting upload Jul 5 17:28:09.347274910 (296h17m44.117916235s) [upload=236945]: Uploading segments... Jul 5 17:28:09.347379050 (296h17m44.118020375s) [upload=236945]: Got next segment. Inline: false Jul 5 17:28:09.347407714 (296h17m44.118049049s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 5 17:28:09.347412954 (296h17m44.118054289s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 5 17:28:09.588206709 (296h17m44.358848034s) [seg_pos={0 0}, upload=236945]: Begin upload segment... Jul 5 17:28:09.588274739 (296h17m44.358916074s) [seg_pos={0 0}, upload=236945]: Done begin upload segment. Jul 5 17:28:09.588323944 (296h17m44.358965279s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588379069 (296h17m44.359020404s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588734989 (296h17m44.359376314s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.588935924 (296h17m44.359577259s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589011298 (296h17m44.359652633s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.589270053 (296h17m44.359911389s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590002835 (296h17m44.36064416s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590746688 (296h17m44.361388043s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.590753250 (296h17m44.361394585s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591032105 (296h17m44.36167344s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591093732 (296h17m44.361735067s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591452879 (296h17m44.362094215s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591644045 (296h17m44.36228538s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.591713738 (296h17m44.362355063s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592268069 (296h17m44.362909394s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:09.592567602 (296h17m44.363208937s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Uploading piece... Jul 5 17:28:11.227912581 (296h17m45.998553916s) [upload=236945]: Next returned nil segment Jul 5 17:28:11.227925805 (296h17m45.99856714s) [upload=236945]: Waiting for error group managing segments... Jul 5 17:28:11.529771340 (296h17m46.300412675s) [noise=true , address=104.36.82.9:4005 , piece_id=4ROO3D7X5OS2NB5P4LNBO52P3JVDKYNDJ7TGOJKV3ZEXFT246JFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.537274264 (296h17m46.307915599s) [noise=true , address=104.36.82.12:4151 , piece_id=BLFWHYFODXCBQ2SG4EYTUYI7OSL4IJ5TQKQYYSK2QP3JA5W6WLPQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.543770743 (296h17m46.314412088s) [noise=true , address=104.36.82.7:4912 , piece_id=K324RUVW433UI7AVTICBISWFSKBXUHYXEKKH3IYPLKGGMDY3YQRQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.562362180 (296h17m46.333003515s) [noise=true , address=104.36.82.4:4803 , piece_id=NMBPTNHVMDM5YQGKAFUB5WBMUKAXOOI5MZXS7JZREH6FSJT47APQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.599523163 (296h17m46.370164498s) [noise=true , address=104.36.82.10:4078 , piece_id=MZI3RVLAH7S75N7V4XMHUIJWKMXJGGL67PMBGKVKTOOMP5RBT4RQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.639344807 (296h17m46.409986142s) [noise=true , address=104.36.82.7:4911 , piece_id=DOIBVHBW2AWJSTU424AR3DUST7UN5SZF46J354HRGE5YPBJJE6YQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.657182702 (296h17m46.427824037s) [noise=true , address=104.36.82.8:4972 , piece_id=XYB5OPHSXXBWWCB4KR44YD7NETSHCRWVR7AKR3OJLW22FRY6UYFQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.670611894 (296h17m46.441253229s) [noise=true , address=104.36.82.16:4294 , piece_id=CND4SQ3EQZLCLU2X7NRAJCEJKQKGIZ2DTYRP3EJ7WHT6VZP7INCQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:11.694057187 (296h17m46.464698522s) [noise=true , address=104.36.82.6:4875 , piece_id=QGTENLGFP37WXWNGNCCNENEYC4SSMDLS7ULV6KYRJPGPVECG7QBQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:29.767976961 (296h18m4.538618326s) [noise=true , address=45.91.116.9:4263 , piece_id=IOKGELGHJL5D3UG4JU2G5DKQT6QGASJVINCHZ5ES52E5SQBCARWA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:30.958706550 (296h18m5.729347885s) [noise=true , address=45.91.116.11:4117 , piece_id=UZMQT5OX63U3V2NFB5G24TK72OUNELOQXJMFK2QTSSRAHQILSKTA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:34.136679007 (296h18m8.907320332s) [noise=true , address=45.91.116.7:4010 , piece_id=IRLKDHEG6YR457FHUI756H2HDI36BCOLBBGRNXMMLSY4WUQUQ3CQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719142580 (296h18m11.489783905s) [noise=true , address=77.90.31.11:4554 , piece_id=56XVAHSDXTEGBNFWUROD6S652IXZAAAQLVFDSZFDXGY7E7WQOL3Q, seg_pos={0 0}, upload=236945]: Done uploading piece. err: <nil> Jul 5 17:28:36.719168730 (296h18m11.489810085s) [seg_pos={0 0}, upload=236945]: Segment reached optimal threshold of 13 pieces. Jul 5 17:28:36.719447222 (296h18m11.490088547s) [noise=true , address=45.91.116.5:4299 , piece_id=53NIS5Y5LNHPHGKYFDNULTIOQUEXXMRWUWV4DOAFKOG54CJYA6OQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SnvkmRPw7yGAfbNNx6QeZMnpo6NuiVT2PyzBAHuhgMgsxWKWX): protocol: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:56806->45.91.116.5:4299: use of closed network connection Jul 5 17:28:36.719487790 (296h18m11.490129126s) [noise=true , address=77.90.31.12:4590 , piece_id=CV65OM7ZVPVGGAX4LG425RXLJCJH2JQFLCJFTVH7NZEEYHK7UHAQ, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1i9B5aDDfPkgveDvLh7ngsnCJb1Viw2cHYNMmgbjhG5BkWFCMw): protocol: expected piece hash; context canceled; EOF Jul 5 17:28:36.719529169 (296h18m11.490170514s) [noise=true , address=77.90.31.16:4734 , piece_id=4U2342LJM6ETBICXBA6TTJUEV2JNKJZZ76Z2TPECZ52D7GKGLFXA, seg_pos={0 0}, upload=236945]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1srnb2e1ZCtNSpkLsFuMNR6BMdYzH3tqfxZii3qwBnRhbXcee9): protocol: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:45598->77.90.31.16:4734: use of closed network connection Jul 5 17:28:36.719580027 (296h18m11.490221362s) [seg_pos={0 0}, upload=236945]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 5 17:28:36.719668395 (296h18m11.49030973s) [upload=236945]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 5 17:28:36.719674027 (296h18m11.490315362s) [upload=236945]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 5 17:28:37.004680607 (296h18m11.775321942s) [upload=236945]: Done uploading segments... Jul 5 17:28:37.004698051 (296h18m11.775339386s) [upload=236945]: Upload finished. err: <nil> Duration: 5.724091492s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)