Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 5.675229486s FAIL (2025-07-16 15:01:20 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.675257018s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 5.784597069s FAIL (2025-07-16 15:00:28 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.784625884s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 5.91287781s FAIL (2025-07-16 14:59:15 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.912900793s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 5.962152201s FAIL (2025-07-16 14:58:18 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.962173391s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 5.750752921s FAIL (2025-07-16 14:57:18 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.7507828s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 6.012435346s FAIL (2025-07-16 14:56:35 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 6.012460506s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 5.723119039s FAIL (2025-07-16 14:55:52 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.72315051s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 5.794940526s FAIL (2025-07-16 14:54:37 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.794966546s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 5.777511399s FAIL (2025-07-16 14:53:40 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.777537978s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............X.............................................] duration: 5.763469162s FAIL (2025-07-16 14:52:33 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.763513296s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............X............................................] duration: 5.830886749s FAIL (2025-07-16 14:52:17 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.830912629s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................X...........................................] duration: 5.728494382s FAIL (2025-07-16 14:51:56 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.728530421s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................X..........................................] duration: 5.819884185s FAIL (2025-07-16 14:51:18 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.819909342s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................X.........................................] duration: 5.686646004s FAIL (2025-07-16 14:50:44 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.686676954s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................X........................................] duration: 5.764702456s FAIL (2025-07-16 14:50:25 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.764732395s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................X.......................................] duration: 5.75149502s FAIL (2025-07-16 14:50:07 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.751522332s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................X......................................] duration: 5.698968201s FAIL (2025-07-16 14:49:51 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.698992177s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................X.....................................] duration: 5.914965899s FAIL (2025-07-16 14:48:40 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.914993261s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................X....................................] duration: 5.723118578s FAIL (2025-07-16 14:47:43 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.723148736s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................X...................................] duration: 5.794084701s FAIL (2025-07-16 14:46:48 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.794111113s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................X..................................] duration: 5.661503799s FAIL (2025-07-16 14:46:14 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.661533115s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................X.................................] duration: 5.825256653s FAIL (2025-07-16 14:45:42 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.825288111s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................X................................] duration: 5.694550458s FAIL (2025-07-16 14:44:47 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.694575585s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................X...............................] duration: 5.763189652s FAIL (2025-07-16 14:43:53 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.763209881s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................X..............................] duration: 5.687016635s FAIL (2025-07-16 14:42:54 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.687052073s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................X.............................] duration: 6.399983197s FAIL (2025-07-16 14:41:43 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 6.400008615s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................X............................] duration: 5.764923529s FAIL (2025-07-16 14:41:04 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.764949148s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................X...........................] duration: 5.815470594s FAIL (2025-07-16 14:40:19 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.815492555s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................X..........................] duration: 5.710328314s FAIL (2025-07-16 14:39:37 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.71034692s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................X.........................] duration: 5.707253257s FAIL (2025-07-16 14:39:02 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.707285658s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................X........................] duration: 5.959056786s FAIL (2025-07-16 14:38:23 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.959085731s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................X.......................] duration: 6.418625775s FAIL (2025-07-16 14:37:17 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 6.418650812s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................X......................] duration: 5.756640512s FAIL (2025-07-16 14:36:24 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.756667845s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................X.....................] duration: 5.883645757s FAIL (2025-07-16 14:35:54 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.883673109s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.......................................X....................] duration: 5.736531017s FAIL (2025-07-16 14:35:12 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.736557046s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [........................................X...................] duration: 5.888123656s FAIL (2025-07-16 14:34:23 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.888150328s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.........................................X..................] duration: 5.71425135s FAIL (2025-07-16 14:33:14 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.714270807s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..........................................X.................] duration: 5.942239055s FAIL (2025-07-16 14:32:57 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.942266439s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 6.186340263s FAIL (2025-07-16 14:32:05 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 6.186376091s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 5.775888431s FAIL (2025-07-16 14:31:14 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.775914932s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.913835006s FAIL (2025-07-16 14:30:24 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.91386795s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.706734008s FAIL (2025-07-16 14:29:41 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.706798611s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 5.783355226s FAIL (2025-07-16 14:28:38 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.783379813s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.853362065s FAIL (2025-07-16 14:27:53 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.853394248s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 5.902388395s FAIL (2025-07-16 14:26:49 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.902406611s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 5.681918344s FAIL (2025-07-16 14:25:46 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.681945086s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 5.843396905s FAIL (2025-07-16 14:25:06 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.843421553s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [....................................................X.......] duration: 5.754212141s FAIL (2025-07-16 14:24:31 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.754239082s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.....................................................X......] duration: 5.751568525s FAIL (2025-07-16 14:23:48 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.751598422s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [......................................................X.....] duration: 5.771427251s FAIL (2025-07-16 14:22:36 UTC) orbiter warning: ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== h6m32.606769152s) [upload=445507]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:16:58.312777404 (557h6m33.083418739s) [upload=445507]: Done uploading segments... Jul 16 14:16:58.312798795 (557h6m33.08344012s) [upload=445507]: Upload finished. err: <nil> Jul 16 14:17:42.300645357 (557h7m17.071286682s) [upload=445516]: Starting upload Jul 16 14:17:42.300706263 (557h7m17.071347598s) [upload=445516]: Done starting upload Jul 16 14:17:42.300752422 (557h7m17.071393757s) [upload=445516]: Uploading segments... Jul 16 14:17:42.300970428 (557h7m17.071611763s) [upload=445516]: Got next segment. Inline: false Jul 16 14:17:42.301432272 (557h7m17.072073607s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 16 14:17:42.301439196 (557h7m17.072080531s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 16 14:17:42.535216928 (557h7m17.305858263s) [seg_pos={0 0}, upload=445516]: Begin upload segment... Jul 16 14:17:42.535262425 (557h7m17.30590376s) [seg_pos={0 0}, upload=445516]: Done begin upload segment. Jul 16 14:17:42.535282574 (557h7m17.305923909s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535323772 (557h7m17.305965177s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535629828 (557h7m17.306271153s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.535881640 (557h7m17.306522975s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536144492 (557h7m17.306785827s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536171163 (557h7m17.306812488s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536397718 (557h7m17.307039053s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536671652 (557h7m17.307312977s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536756544 (557h7m17.307397879s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.536940355 (557h7m17.30758169s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537151379 (557h7m17.307792714s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537349518 (557h7m17.307990853s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537535364 (557h7m17.308176699s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537727962 (557h7m17.308369287s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.537937854 (557h7m17.308579189s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:42.538130403 (557h7m17.308771738s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Uploading piece... Jul 16 14:17:44.265319247 (557h7m19.035960573s) [upload=445516]: Next returned nil segment Jul 16 14:17:44.265336069 (557h7m19.035977404s) [upload=445516]: Waiting for error group managing segments... Jul 16 14:17:44.591800233 (557h7m19.362441558s) [noise=true , address=45.91.116.6:4974 , piece_id=2ULVRKHXSNWYDR5XQUJVRPEKXE4LGHZKWJMFFCCE27KUS6D5SSYA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.593443567 (557h7m19.364084902s) [noise=true , address=45.91.116.14:4189 , piece_id=LCKM5PNCIVHDTU5BOMRPH44PEBKFWSESMJMWILTWLBTTJKQPOV2Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.595070710 (557h7m19.365712045s) [noise=true , address=45.91.116.14:4190 , piece_id=CGXLYSHQANTVYVSTNYIP6Q7BJDXNJUO4LAAF3YZFMRWSULR4Z3LQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.614274984 (557h7m19.384916319s) [noise=true , address=45.91.116.7:4010 , piece_id=UXJF4LRMCPYBRMTHXPF55OWETSDXIRRWGXTNM4G4W5O2RSE77BHA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.616058337 (557h7m19.386699672s) [noise=true , address=104.36.82.2:4731 , piece_id=A7L4XXWDO7FM4WDA4NDLTP7GVJDAP6DMQ5P4WU4ESTNK23WPXLMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.659530845 (557h7m19.43017219s) [noise=true , address=45.91.116.6:4973 , piece_id=TUOCF5U7WHVWLJK3WS7T7MFR3PUPXSN3YZZ3L3KUXXVSGMPRNAOQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.661937670 (557h7m19.432579015s) [noise=true , address=104.36.82.7:4910 , piece_id=T3UUAOHE2OX3DJ5S73FHI2RW3BD6B45V2RKQVDQJMPYG7T3BKDRA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.703728920 (557h7m19.474370255s) [noise=true , address=45.91.116.9:4261 , piece_id=SCM4ADAK7YPQ5ZH7JJLX3I7M3EE7M3QOADKYH7CEQ4MNVYKGXMSA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:44.708504346 (557h7m19.479145672s) [noise=true , address=104.36.82.14:4222 , piece_id=J57GCUCRVFJKMYUG26ZBMFZDDSJ22SOXT4PZSGVINWHTRGE2QUSQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:17:52.997887619 (557h7m27.768528954s) [noise=true , address=77.90.31.11:4554 , piece_id=2WMMMRAAWPFGSIJKLCAG5UPQES7VCIVYCLY76JMQEPPJ25RN2IEA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:00.472426529 (557h7m35.243067864s) [noise=true , address=77.90.31.15:4698 , piece_id=P6Z3D44M2D5BYMZN2C5EWULDHU4HDVGUPLQIKN3ZCRA6DVVRLHDQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:01.522706851 (557h7m36.293348186s) [noise=true , address=77.90.31.18:4806 , piece_id=EAO24X6WORE2XT4TSDJL7WJU3WEYMDVFRON3V4PMGLXLNLXER62Q, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370853698 (557h7m44.141495033s) [noise=true , address=77.90.31.14:4661 , piece_id=YPJK4THHH6EWJFEVZ5XHYZ4ZLPEP4WQYJ4FHBRSMWSCD6A3TREBA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: <nil> Jul 16 14:18:09.370885098 (557h7m44.141526433s) [seg_pos={0 0}, upload=445516]: Segment reached optimal threshold of 13 pieces. Jul 16 14:18:09.371101753 (557h7m44.141743078s) [noise=true , address=77.90.31.14:4662 , piece_id=UAENU2RAIFWUSPGARWCSCB6BMCUEW5RNDUEBHLVCQVWRGXTGA7RA, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:138doLw3dLzEZXoSRNbCridRmSCajLgdVZ86vBdAQuWXjaDD8n): protocol: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33630->77.90.31.14:4662: use of closed network connection Jul 16 14:18:09.371141168 (557h7m44.141782503s) [noise=true , address=77.90.31.10:4517 , piece_id=RJFLGHZ7RGNJBNJZT6BOMZG4ZWWZCC3BK226KQPDVQYN5SPAKIIQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:129FbXSqxqTJ99BdhfUePzbNvG8db4bxASiXQjSCbkErTaCEk7A): protocol: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:38172->77.90.31.10:4517: use of closed network connection Jul 16 14:18:09.371203588 (557h7m44.141844913s) [noise=true , address=77.90.31.17:4772 , piece_id=XCJI526XJSLCNPYS4BR32DUNO22SJZIDEW444IYI5GDRBNWHKUMQ, seg_pos={0 0}, upload=445516]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:18CNfMYrF1Gqgabi62fG23CagDZHW2QyZZNYKKTSjWQKLS4ppE): protocol: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:40146->77.90.31.17:4772: use of closed network connection Jul 16 14:18:09.371217634 (557h7m44.141858969s) [seg_pos={0 0}, upload=445516]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 16 14:18:09.371284923 (557h7m44.141926258s) [upload=445516]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 16 14:18:09.371288791 (557h7m44.141930116s) [upload=445516]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 16 14:18:09.658701115 (557h7m44.42934245s) [upload=445516]: Done uploading segments... Jul 16 14:18:09.658718087 (557h7m44.429359422s) [upload=445516]: Upload finished. err: <nil> Duration:* 5.771455996s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)