Orbiter History

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 925.701096ms remote: "tcp:5.161.37.179:443" response headers: Content-Length=0 Date=Wed, 16 Jul 2025 15:03:45 GMT Access-Control-Allow-Origin=* target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-16 15:08:12 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 925.725673ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 873.695744ms remote: "tcp:5.161.37.179:443" response headers: Content-Length=0 Date=Wed, 16 Jul 2025 15:03:45 GMT Access-Control-Allow-Origin=* target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-16 15:07:27 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 873.717967ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [.......................................................X....] duration: 884.528298ms remote: "tcp:5.161.37.179:443" response headers: Content-Length=0 Date=Wed, 16 Jul 2025 15:03:45 GMT Access-Control-Allow-Origin=* target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-16 15:06:31 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 884.567084ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [........................................................X...] duration: 891.528644ms remote: "tcp:5.161.37.179:443" response headers: Content-Length=0 Date=Wed, 16 Jul 2025 15:03:45 GMT Access-Control-Allow-Origin=* target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-16 15:05:44 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 891.55216ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 5.851526878s FAIL (2025-07-16 15:05:30 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.851554642s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [.........................................................X..] duration: 866.157761ms remote: "tcp:5.161.37.179:443" response headers: Content-Length=0 Date=Wed, 16 Jul 2025 15:03:45 GMT Access-Control-Allow-Origin=* target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-16 15:05:28 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 866.197018ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 5.762031169s FAIL (2025-07-16 15:04:48 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.76206282s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [..........................................................X.] duration: 894.877941ms remote: "tcp:5.161.37.179:443" response headers: Content-Length=0 Date=Wed, 16 Jul 2025 15:03:45 GMT Access-Control-Allow-Origin=* target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-16 15:04:47 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 894.907536ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 5.857389001s FAIL (2025-07-16 15:03:57 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.857417505s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 1 out of 60 is failed (threshold=3) [...........................................................X] duration: 703.15966ms remote: "tcp:5.161.37.179:443" response headers: Content-Length=0 Date=Wed, 16 Jul 2025 15:03:45 GMT Access-Control-Allow-Origin=* target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-16 15:03:45 UTC) orbiter warning: unexpected status code "502 Bad Gateway" "" Duration: 703.182123ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 5.84913527s FAIL (2025-07-16 15:02:55 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.84916223s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 5.85308626s FAIL (2025-07-16 15:02:18 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.853110606s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.675229486s FAIL (2025-07-16 15:01:20 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.675257018s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.784597069s FAIL (2025-07-16 15:00:28 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.784625884s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.91287781s FAIL (2025-07-16 14:59:15 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.912900793s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.962152201s FAIL (2025-07-16 14:58:18 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.962173391s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 5.750752921s FAIL (2025-07-16 14:57:18 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.7507828s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 6.012435346s FAIL (2025-07-16 14:56:35 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 6.012460506s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 5.723119039s FAIL (2025-07-16 14:55:52 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.72315051s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 5.794940526s FAIL (2025-07-16 14:54:37 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.794966546s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 5.777511399s FAIL (2025-07-16 14:53:40 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.777537978s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 5.763469162s FAIL (2025-07-16 14:52:33 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.763513296s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 5.830886749s FAIL (2025-07-16 14:52:17 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.830912629s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.728494382s FAIL (2025-07-16 14:51:56 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.728530421s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.819884185s FAIL (2025-07-16 14:51:18 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.819909342s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.686646004s FAIL (2025-07-16 14:50:44 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.686676954s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.764702456s FAIL (2025-07-16 14:50:25 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.764732395s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 5.75149502s FAIL (2025-07-16 14:50:07 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.751522332s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 5.698968201s FAIL (2025-07-16 14:49:51 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.698992177s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.914965899s FAIL (2025-07-16 14:48:40 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.914993261s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 5.723118578s FAIL (2025-07-16 14:47:43 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.723148736s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 5.794084701s FAIL (2025-07-16 14:46:48 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.794111113s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 5.661503799s FAIL (2025-07-16 14:46:14 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.661533115s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 5.825256653s FAIL (2025-07-16 14:45:42 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.825288111s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 5.694550458s FAIL (2025-07-16 14:44:47 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.694575585s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.763189652s FAIL (2025-07-16 14:43:53 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.763209881s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 5.687016635s FAIL (2025-07-16 14:42:54 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.687052073s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 6.399983197s FAIL (2025-07-16 14:41:43 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 6.400008615s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.764923529s FAIL (2025-07-16 14:41:04 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.764949148s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 5.815470594s FAIL (2025-07-16 14:40:19 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.815492555s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 5.710328314s FAIL (2025-07-16 14:39:37 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.71034692s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.707253257s FAIL (2025-07-16 14:39:02 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.707285658s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.959056786s FAIL (2025-07-16 14:38:23 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.959085731s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 6.418625775s FAIL (2025-07-16 14:37:17 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 6.418650812s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.756640512s FAIL (2025-07-16 14:36:24 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.756667845s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.883645757s FAIL (2025-07-16 14:35:54 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.883673109s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.736531017s FAIL (2025-07-16 14:35:12 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.736557046s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.888123656s FAIL (2025-07-16 14:34:23 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.888150328s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.71425135s FAIL (2025-07-16 14:33:14 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.714270807s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.942239055s FAIL (2025-07-16 14:32:57 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.942266439s core uplink us-select-1

Orbiter Check History

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)