Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 4 out of 60 is failed (threshold=3) [.................X..............XX..X.......................] duration: 5.711521442s FAIL (2025-07-18 16:23:24 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== t. successful: 13 optimal: 13 errs: <nil> Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments... Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil> Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments... Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment... Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment. Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments... Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces. Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments... Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil> Duration: 5.711548184s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 46 out of 60 is failed (threshold=3) [..............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 478.075315ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:23:15 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 478.09912ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 43 out of 60 is failed (threshold=3) [.................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 472.897519ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:22:30 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 472.923951ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [X.................X..............XX..X......................] duration: 6.093207805s FAIL (2025-07-18 16:22:19 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== t. successful: 13 optimal: 13 errs: <nil> Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments... Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil> Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments... Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment... Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment. Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments... Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces. Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments... Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil> Duration: 6.093234426s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 45 out of 60 is failed (threshold=3) [...............XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 458.016549ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:22:06 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 458.036186ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.X.................X..............XX..X.....................] duration: 6.143365435s FAIL (2025-07-18 16:21:54 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== t. successful: 13 optimal: 13 errs: <nil> Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments... Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil> Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments... Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment... Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment. Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments... Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces. Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments... Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil> Duration: 6.143390114s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 42 out of 60 is failed (threshold=3) [..................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 466.139689ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:21:40 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 466.162894ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 44 out of 60 is failed (threshold=3) [................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 488.993797ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:21:14 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 489.014868ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 41 out of 60 is failed (threshold=3) [...................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 475.366093ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:21:10 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 475.39063ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 43 out of 60 is failed (threshold=3) [.................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 458.276033ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:20:57 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 458.299991ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [..X.................X..............XX..X....................] duration: 5.800910182s FAIL (2025-07-18 16:20:41 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== t. successful: 13 optimal: 13 errs: <nil> Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments... Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil> Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments... Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment... Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment. Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments... Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces. Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments... Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil> Duration: 5.800938736s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 42 out of 60 is failed (threshold=3) [..................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 462.399783ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:20:37 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 462.426424ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 40 out of 60 is failed (threshold=3) [....................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 466.317088ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:20:27 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 466.340002ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [...X.................X..............XX..X...................] duration: 5.748146627s FAIL (2025-07-18 16:20:21 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== t. successful: 13 optimal: 13 errs: <nil> Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments... Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil> Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments... Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment... Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment. Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments... Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces. Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments... Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil> Duration: 5.748176724s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [....X.................X..............XX..X..................] duration: 5.929274184s FAIL (2025-07-18 16:19:54 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== t. successful: 13 optimal: 13 errs: <nil> Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments... Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil> Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments... Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment... Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment. Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments... Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces. Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments... Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil> Duration: 5.929301264s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 41 out of 60 is failed (threshold=3) [...................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 445.362941ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:19:33 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 445.386595ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 39 out of 60 is failed (threshold=3) [.....................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 537.956008ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:19:19 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 537.980986ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.....X.................X..............XX..X.................] duration: 5.814658228s FAIL (2025-07-18 16:19:12 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== t. successful: 13 optimal: 13 errs: <nil> Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments... Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil> Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments... Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment... Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment. Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments... Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces. Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments... Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil> Duration: 5.814687645s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [......X.................X..............XX..X................] duration: 5.812701815s FAIL (2025-07-18 16:18:51 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== t. successful: 13 optimal: 13 errs: <nil> Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments... Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil> Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments... Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment... Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment. Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments... Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces. Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments... Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil> Duration: 5.812725901s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 38 out of 60 is failed (threshold=3) [......................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 453.147261ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:18:39 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 453.164083ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 40 out of 60 is failed (threshold=3) [....................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 467.110858ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:18:27 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 467.13748ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.......X.................X..............XX..X...............] duration: 5.908541287s FAIL (2025-07-18 16:18:03 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== t. successful: 13 optimal: 13 errs: <nil> Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments... Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil> Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments... Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment... Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment. Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments... Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces. Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments... Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil> Duration: 5.908619557s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [........X.................X..............XX..X..............] duration: 5.777381723s FAIL (2025-07-18 16:17:40 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== t. successful: 13 optimal: 13 errs: <nil> Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments... Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil> Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments... Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment... Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment. Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments... Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces. Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments... Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil> Duration: 5.777413234s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 37 out of 60 is failed (threshold=3) [.......................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 471.339158ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:17:26 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 471.358835ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 39 out of 60 is failed (threshold=3) [.....................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 449.035283ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:17:20 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 449.059388ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 36 out of 60 is failed (threshold=3) [........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 452.290622ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:16:48 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 452.315188ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.........X.................X..............XX..X.............] duration: 5.78743s FAIL (2025-07-18 16:16:38 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== t. successful: 13 optimal: 13 errs: <nil> Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments... Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil> Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments... Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment... Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment. Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments... Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces. Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments... Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil> Duration: 5.787453045s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 38 out of 60 is failed (threshold=3) [......................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 539.465444ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:16:33 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 539.496954ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 35 out of 60 is failed (threshold=3) [.........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 445.100847ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:16:07 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 445.132126ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 37 out of 60 is failed (threshold=3) [.......................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 602.990079ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:16:05 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 603.016259ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [..........X.................X..............XX..X............] duration: 5.978337961s FAIL (2025-07-18 16:15:47 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== t. successful: 13 optimal: 13 errs: <nil> Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments... Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil> Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments... Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment... Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment. Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments... Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces. Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments... Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil> Duration: 5.978367206s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 36 out of 60 is failed (threshold=3) [........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 444.53931ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:15:44 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 444.566443ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 34 out of 60 is failed (threshold=3) [..........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 752.12829ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:15:38 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 752.164449ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 33 out of 60 is failed (threshold=3) [...........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 738.824094ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:14:59 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 738.849173ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 35 out of 60 is failed (threshold=3) [.........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 692.707238ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:14:58 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 692.731805ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [...........X.................X..............XX..X...........] duration: 5.803041079s FAIL (2025-07-18 16:14:48 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== t. successful: 13 optimal: 13 errs: <nil> Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments... Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil> Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments... Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment... Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment. Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments... Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces. Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments... Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil> Duration: 5.803071417s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 32 out of 60 is failed (threshold=3) [............................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 529.20728ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:14:11 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 529.232819ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [............X.................X..............XX..X..........] duration: 5.804666249s FAIL (2025-07-18 16:14:10 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== t. successful: 13 optimal: 13 errs: <nil> Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments... Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil> Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments... Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment... Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment. Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments... Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces. Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments... Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil> Duration: 5.804691326s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 34 out of 60 is failed (threshold=3) [..........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 580.127967ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:14:10 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 580.147665ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 31 out of 60 is failed (threshold=3) [.............................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 519.329459ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:13:45 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 519.357503ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [.............X.................X..............XX..X.........] duration: 5.908604302s FAIL (2025-07-18 16:13:05 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== t. successful: 13 optimal: 13 errs: <nil> Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments... Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil> Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments... Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment... Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment. Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments... Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces. Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments... Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil> Duration: 5.908628106s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 33 out of 60 is failed (threshold=3) [...........................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 447.454478ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:12:59 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 447.503041ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 30 out of 60 is failed (threshold=3) [..............................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 460.043766ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:12:54 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 460.070727ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 29 out of 60 is failed (threshold=3) [...............................XXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 462.074063ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:12:36 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 462.101775ms edge ipfs us1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 32 out of 60 is failed (threshold=3) [............................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 486.488482ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:12:21 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 486.514002ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [..............X.................X..............XX..X........] duration: 5.795106104s FAIL (2025-07-18 16:12:03 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== t. successful: 13 optimal: 13 errs: <nil> Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments... Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil> Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments... Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment... Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment. Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments... Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces. Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments... Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil> Duration: 5.795133027s core uplink us-select-1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 28 out of 60 is failed (threshold=3) [................................XXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 474.646717ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:12:01 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 474.674359ms edge ipfs us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 5 out of 60 is failed (threshold=3) [...............X.................X..............XX..X.......] duration: 6.067900224s FAIL (2025-07-18 16:11:35 UTC) orbiter warning: ======ERROR====== uplink: context deadline exceeded ======LOGS====== t. successful: 13 optimal: 13 errs: <nil> Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments... Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil> Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments... Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectBegin Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentBegin Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment... Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment. Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece... Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments... Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil> Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces. Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: pb.BatchRequestItem_SegmentCommit Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: pb.BatchRequestItem_ObjectCommit Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments... Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil> Duration: 6.067926975s core uplink us-select-1
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get) antiblip: 31 out of 60 is failed (threshold=3) [.............................XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 470.021407ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi FAIL (2025-07-18 16:11:25 UTC) orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF Duration: 470.041054ms edge ipfs us1
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post) antiblip: 27 out of 60 is failed (threshold=3) [.................................XXXXXXXXXXXXXXXXXXXXXXXXXXX] duration: 455.567562ms remote: "tcp:5.161.37.179:443" target: https://www.storj-ipfs.com/api/v0/add FAIL (2025-07-18 16:11:20 UTC) orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF Duration: 455.585938ms edge ipfs us1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)

checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)