Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
5.800115996s
FAIL (2025-07-04 10:06:00 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.800141455s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
5.727997299s
FAIL (2025-07-04 10:05:07 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.728025543s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
5.726524352s
FAIL (2025-07-04 10:04:51 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.726551935s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
5.592013148s
FAIL (2025-07-04 10:04:27 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.592039228s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
5.670904184s
FAIL (2025-07-04 10:03:41 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.670935966s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
5.680889136s
FAIL (2025-07-04 10:02:48 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.680917218s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
5.830385219s
FAIL (2025-07-04 10:01:53 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.830409366s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
5.6858201s
FAIL (2025-07-04 10:01:27 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.685845527s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................X.......................] duration:
5.712128109s
FAIL (2025-07-04 10:00:44 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.712141655s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................X......................] duration:
5.695078563s
FAIL (2025-07-04 09:59:32 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.695104021s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................X.....................] duration:
5.763559158s
FAIL (2025-07-04 09:58:23 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.76359118s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................X....................] duration:
5.687757967s
FAIL (2025-07-04 09:57:23 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.687777305s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................X...................] duration:
5.646264674s
FAIL (2025-07-04 09:57:00 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.646290824s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................X..................] duration:
5.6699501s
FAIL (2025-07-04 09:56:29 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.669977533s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................X.................] duration:
5.766561285s
FAIL (2025-07-04 09:55:55 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.766589809s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................X................] duration:
5.797937111s
FAIL (2025-07-04 09:55:19 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.797966577s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................................X...............] duration:
5.670735814s
FAIL (2025-07-04 09:54:23 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.670763347s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................................X..............] duration:
5.851880402s
FAIL (2025-07-04 09:54:05 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.851905981s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................................X.............] duration:
5.706605142s
FAIL (2025-07-04 09:53:30 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.70663055s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................................X............] duration:
5.734182134s
FAIL (2025-07-04 09:52:41 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.734206029s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................................X...........] duration:
5.668839051s
FAIL (2025-07-04 09:51:38 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.668871234s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................................X..........] duration:
5.65955499s
FAIL (2025-07-04 09:51:20 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.65957575s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................................X.........] duration:
5.641441323s
FAIL (2025-07-04 09:50:52 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.641473625s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................................X........] duration:
5.817550154s
FAIL (2025-07-04 09:50:19 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.817580711s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
5.839279004s
FAIL (2025-07-04 09:49:54 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.839306768s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
5.687151475s
FAIL (2025-07-04 09:49:22 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.687300099s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
5.678684082s
FAIL (2025-07-04 09:48:33 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.678710682s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
5.651848226s
FAIL (2025-07-04 09:47:38 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.651880998s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
5.600869743s
FAIL (2025-07-04 09:47:22 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.600901143s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
5.65579469s
FAIL (2025-07-04 09:46:42 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.655839957s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
5.76844653s
FAIL (2025-07-04 09:46:09 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 5.768474583s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.002366259s
FAIL (2025-07-04 09:45:50 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
9:44:49.532338244 (264h34m24.302979579s) [noise=true , address=45.91.116.13:4154 , piece_id=ZXIDO4ZDGP5MKRLPHIO63FFMT2GYB3FA55AYQTRCBKZWAVKQU2OA, seg_pos={0 0}, upload=211553]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1vnK2UMEryJTrW3L6KckWmgWmzueeBkbDqG8AoRBQWHELBruRN): protocol: expected piece hash; context canceled; EOF
Jul 4 09:44:49.532380785 (264h34m24.30302212s) [seg_pos={0 0}, upload=211553]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:44:49.532463513 (264h34m24.303104848s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:44:49.532468273 (264h34m24.303109598s) [upload=211553]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:44:49.835200025 (264h34m24.60584136s) [upload=211553]: Done uploading segments...
Jul 4 09:44:49.835220213 (264h34m24.605861538s) [upload=211553]: Upload finished. err: <nil>
Jul 4 09:45:20.888561003 (264h34m55.659202328s) [upload=211562]: Starting upload
Jul 4 09:45:20.888619606 (264h34m55.659260941s) [upload=211562]: Done starting upload
Jul 4 09:45:20.888709688 (264h34m55.659351023s) [upload=211562]: Uploading segments...
Jul 4 09:45:20.888790152 (264h34m55.659431487s) [upload=211562]: Got next segment. Inline: false
Jul 4 09:45:20.888818907 (264h34m55.659460232s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 4 09:45:20.888823406 (264h34m55.659464741s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 4 09:45:21.120358782 (264h34m55.891000117s) [seg_pos={0 0}, upload=211562]: Begin upload segment...
Jul 4 09:45:21.120408657 (264h34m55.891049993s) [seg_pos={0 0}, upload=211562]: Done begin upload segment.
Jul 4 09:45:21.120432012 (264h34m55.891073347s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.120497517 (264h34m55.891138852s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121293831 (264h34m55.891935166s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121377481 (264h34m55.892018816s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121879170 (264h34m55.892520506s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.121948212 (264h34m55.892589557s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122256483 (264h34m55.892897818s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122582075 (264h34m55.89322341s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.122799321 (264h34m55.893440656s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.123662221 (264h34m55.894303566s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.124798645 (264h34m55.89543998s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125161430 (264h34m55.895802765s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125490799 (264h34m55.896132134s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.125860698 (264h34m55.896502033s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126173075 (264h34m55.89681441s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:21.126474482 (264h34m55.897115817s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Uploading piece...
Jul 4 09:45:22.819727996 (264h34m57.590369321s) [upload=211562]: Next returned nil segment
Jul 4 09:45:22.819748425 (264h34m57.59038979s) [upload=211562]: Waiting for error group managing segments...
Jul 4 09:45:23.107090303 (264h34m57.877731638s) [noise=true , address=104.36.82.8:4970 , piece_id=LESLTOIQ4ZOQUUYATDL6OHAJAJPKFY55YZAWNVEFTOALYFVQEV6Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.109255576 (264h34m57.879896911s) [noise=true , address=104.36.82.2:4730 , piece_id=3JDG7XWYVEMVCYAM444JRZLMGIPHEOZYPILESW6NGFKELZX5JE3A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.150369180 (264h34m57.921010515s) [noise=true , address=104.36.82.16:4295 , piece_id=GYJPYHPLAUXPJF72CAV4F6ACXNVF3OY63SODYRVP3MWGCXUOVBYQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.172864695 (264h34m57.94350603s) [noise=true , address=104.36.82.5:4840 , piece_id=WNOAEUFV7KU45GK7QONOZZUEIUHABLTVO73HYFAEC2KIGG5I7ZXA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.182147795 (264h34m57.95278913s) [noise=true , address=104.36.82.2:4731 , piece_id=6G2OOJVZQXXIBSYY2NORBL4TJFOQFNWGTX5J65OHY4YNZF43AOVA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.190925617 (264h34m57.961566952s) [noise=true , address=45.91.116.11:4118 , piece_id=W5FTWPFIVDHXUIQOA2HB42Q2O6IG3QZKL36ZLP4F3KRV6YUOXYQQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.208781678 (264h34m57.979423013s) [noise=true , address=45.91.116.6:4973 , piece_id=FDI3EWGW5JDK4QMLT3YPRQEEEJEJPJPBV6GZ46R4FQQ3PLFOGSMQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.220373053 (264h34m57.991014388s) [noise=true , address=77.90.31.14:4661 , piece_id=UP2X2RVD65C4TXDN3DQRGP6DQK34C5IRBZUR4OQP3DJQPSWXFFFQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.222591687 (264h34m57.993233023s) [noise=true , address=77.90.31.12:4592 , piece_id=KQAJZ7F6PWNLDYKFPS4KGRRCGBTGFSU5IA3M6MQTDIIJEBPGFS6A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.223558928 (264h34m57.994200263s) [noise=true , address=45.91.116.5:4297 , piece_id=ZMHMXLTE5NQIJNH4COYSKZ2PRC6QK4WIGTZMA3RWJKWF6KJQR7WA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.226570169 (264h34m57.997211504s) [noise=true , address=45.91.116.12:4226 , piece_id=YSA5JIWGZ6GNBXQI4EUNPG2UJJECHMYEGZ5WYMKQYYIEZE2BGAKA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229085010 (264h34m57.999726345s) [noise=true , address=45.91.116.13:4155 , piece_id=WXH755TXLQSSIE72TSHB6HEDPO334ORRCMNVZGRYJIA6TTEJ733Q, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229280273 (264h34m57.999921609s) [noise=true , address=45.91.116.6:4974 , piece_id=VTGANFQFLH5BZAPX2EPQ54DCPM3KCUXSL4QX57YZM6PRGXDWI4VA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: <nil>
Jul 4 09:45:23.229314208 (264h34m57.999955543s) [seg_pos={0 0}, upload=211562]: Segment reached optimal threshold of 13 pieces.
Jul 4 09:45:23.229471660 (264h34m58.000112995s) [noise=true , address=77.90.31.14:4663 , piece_id=R7QXMGSE5XIBRVYUAJ2NFV7HNCRE5PAYJ5MGTL6O6KBLP5555ZWA, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:155F5vnBUAgJYDuEgxwgnHCEVarkUAcdNjqh7V52vx65uHyJfE): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229494743 (264h34m58.000136078s) [noise=true , address=77.90.31.11:4553 , piece_id=ZSP3BX5DTCHAB4AFLKYPQMOX6ECIUNQSUNPQORSLM7SZKMGG4UBQ, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1ULMQbw1PRksy5un9tNpwTQFgZoNsy9PhUn86Ny9itKAkesshz): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229557454 (264h34m58.000198779s) [noise=true , address=77.90.31.13:4626 , piece_id=HNONPFWDNKXWOLSHUUSUL7XKEDEAPVXXXOTJV3O6THBZEIW76N4A, seg_pos={0 0}, upload=211562]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12WpRXtVHj1EPPPhGAgAKVCPtEXQXMESSiVHhamxpy7jgRunmFu): protocol: expected piece hash; context canceled; EOF
Jul 4 09:45:23.229573915 (264h34m58.00021524s) [seg_pos={0 0}, upload=211562]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 4 09:45:23.229655020 (264h34m58.000296355s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 4 09:45:23.229659348 (264h34m58.000300683s) [upload=211562]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 4 09:45:23.520080448 (264h34m58.290721783s) [upload=211562]: Done uploading segments...
Jul 4 09:45:23.520102610 (264h34m58.290743945s) [upload=211562]: Upload finished. err: <nil>
Duration: 30.002386469s
core
uplink
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
6.151744446s
FAIL (2025-07-04 07:30:17 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.151767299s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
6.153437658s
FAIL (2025-07-04 07:29:57 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.153468747s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..X.........................................................] duration:
5.91821643s
FAIL (2025-07-04 07:28:45 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.918236608s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...X........................................................] duration:
6.184084485s
FAIL (2025-07-04 07:27:41 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.184103722s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [....X.......................................................] duration:
5.900965838s
FAIL (2025-07-04 07:26:33 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.900986507s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.....X......................................................] duration:
5.845155896s
FAIL (2025-07-04 07:26:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.845177385s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......X.....................................................] duration:
5.814872217s
FAIL (2025-07-04 07:25:06 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.814891804s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......X....................................................] duration:
5.980900381s
FAIL (2025-07-04 07:24:36 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.980936319s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........X...................................................] duration:
6.014717959s
FAIL (2025-07-04 07:24:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.014798724s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........X..................................................] duration:
5.874281464s
FAIL (2025-07-04 07:22:56 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.874306092s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........X.................................................] duration:
5.930557716s
FAIL (2025-07-04 07:22:12 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.930577304s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........X................................................] duration:
5.842561311s
FAIL (2025-07-04 07:21:46 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.842582844s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............X...............................................] duration:
6.389504292s
FAIL (2025-07-04 07:20:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.389522217s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............X..............................................] duration:
6.112615216s
FAIL (2025-07-04 07:20:24 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.112637017s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............X.............................................] duration:
6.244686432s
FAIL (2025-07-04 07:20:02 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.244712261s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............X............................................] duration:
5.92229294s
FAIL (2025-07-04 07:19:07 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.922317507s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................X...........................................] duration:
6.165127433s
FAIL (2025-07-04 07:17:55 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.165531636s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................X..........................................] duration:
6.114301825s
FAIL (2025-07-04 07:17:09 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.114326122s
edge
gateway
us-select-1
|