Orbiter: EU/US/AP | Code | Config | Playbook | Edge Deployment | Escalation Procedure
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
436.047384ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 16:43:27 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 436.070999ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [......XX..X...............................................X.] duration:
5.784917186s
FAIL (2025-07-18 16:42:45 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
43943061 (607h30m56.014584396s) [upload=485824]: Done uploading segments...
Jul 18 16:41:21.243960926 (607h30m56.014602261s) [upload=485824]: Upload finished. err: <nil>
Jul 18 16:41:46.882293880 (607h31m21.652935215s) [upload=485834]: Starting upload
Jul 18 16:41:46.882408149 (607h31m21.653049514s) [upload=485834]: Done starting upload
Jul 18 16:41:46.882487250 (607h31m21.653128575s) [upload=485834]: Uploading segments...
Jul 18 16:41:46.882712641 (607h31m21.653353976s) [upload=485834]: Got next segment. Inline: false
Jul 18 16:41:46.882774189 (607h31m21.653415534s) [upload=485834]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 16:41:46.882780781 (607h31m21.653422116s) [upload=485834]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 16:41:47.119575499 (607h31m21.890216834s) [seg_pos={0 0}, upload=485834]: Begin upload segment...
Jul 18 16:41:47.119620745 (607h31m21.890262081s) [seg_pos={0 0}, upload=485834]: Done begin upload segment.
Jul 18 16:41:47.119648959 (607h31m21.890290294s) [noise=true , address=104.36.82.16:4294 , piece_id=AL5CBFM7G65APSHQ2VFLJ7ZNCTLG6FTEQW5KVQECJUF5GGW6L64A, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.119652606 (607h31m21.890293961s) [noise=true , address=45.91.116.9:4262 , piece_id=IH6HOZ6Z6OJB5KWUIC754YEVLX4QWSSF6M2SUCCU3DCVEJGENLPQ, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.119949835 (607h31m21.89059117s) [noise=true , address=45.91.116.10:4083 , piece_id=MDJSZ6B4DXTYL6HDNXTMCUAIQ5KLHCYLAGG3N3MCJIP2QNL5RW5Q, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.120180456 (607h31m21.890821791s) [noise=true , address=45.91.116.8:4045 , piece_id=C74KAENMFPMGKUNZNAWBDBOW22H7P5XAMCGRMS4B3XDNVYEISDTA, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.120285036 (607h31m21.890926371s) [noise=true , address=77.90.31.13:4627 , piece_id=BK25LXSZA335BDKA7ECT276LAU4Q3DDMWOGYL3QRHQZGKSFO4OQA, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.120478577 (607h31m21.891119912s) [noise=true , address=45.91.116.5:4297 , piece_id=PUFJXKBYZAZOFCTME7XA6P4RHYGXVR3SUBOZHPVE7OARKCNLYJFQ, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.120603516 (607h31m21.891244851s) [noise=true , address=104.36.82.4:4801 , piece_id=BD2IE6RBWE5P2ONS3YQUXRKVJBPRDYPOJTGHI3GU3WP5DLFI3DNA, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.120735118 (607h31m21.891376453s) [noise=true , address=77.90.31.14:4661 , piece_id=45ACE325BMANQNS2F7GT5UBORIQ2ALIKASO5ITNMRJ35AZMY4TUA, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.120849597 (607h31m21.891490932s) [noise=true , address=104.36.82.10:4077 , piece_id=JTSZYPFMLFPULXEYU6RVAWHZSXUIELBIIPFBXIDSIMWPEYY3RFWA, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.121005264 (607h31m21.891646589s) [noise=true , address=104.36.82.7:4910 , piece_id=MXPIVOGGXL2ZVXTI73SYUA6RS7FJYC7OIARDDFYTVAFBH7BEYNJA, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.121106829 (607h31m21.891748164s) [noise=true , address=45.91.116.4:4939 , piece_id=7CV6VPBN5RA5CRY565LUVSQY7YQYM3ALKSEC73RV5QSTD4VBBL4A, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.121249542 (607h31m21.891890867s) [noise=true , address=77.90.31.11:4555 , piece_id=M3GAYWU63PDQSV5MHAVLGXV53GWYK33JRSXZLHJCWDO4EJ5ZXJZA, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.121592128 (607h31m21.892233463s) [noise=true , address=104.36.82.12:4150 , piece_id=AYI6UITIDNUR7RC5P7LM36PSNIYKBI2U2EBSKD4IRFRPVAKDGIYA, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.121878996 (607h31m21.892520331s) [noise=true , address=104.36.82.16:4295 , piece_id=KCENFMTJTOHVA5XGK5QYF6SW66TMSKW3TCQJKU5EWIJKMKBXFUYA, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.122109017 (607h31m21.892750352s) [noise=true , address=45.91.116.14:4190 , piece_id=MOSOWA7NNLUJNTZAWNEYZMHJD7U6D4ALL4MCJBRM4FCM33TYRGJQ, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.127832217 (607h31m21.898473552s) [noise=true , address=77.90.31.12:4589 , piece_id=LYKG57L6G67IHMKFECMMOCL47FSO2D6A6KTTD6QDWL6D66ARG6KA, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:48.840592792 (607h31m23.611234127s) [upload=485834]: Next returned nil segment
Jul 18 16:41:48.840609223 (607h31m23.611250558s) [upload=485834]: Waiting for error group managing segments...
Jul 18 16:41:49.162427890 (607h31m23.933069235s) [noise=true , address=104.36.82.10:4077 , piece_id=JTSZYPFMLFPULXEYU6RVAWHZSXUIELBIIPFBXIDSIMWPEYY3RFWA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil>
Jul 18 16:41:49.174349590 (607h31m23.944990915s) [noise=true , address=45.91.116.14:4190 , piece_id=MOSOWA7NNLUJNTZAWNEYZMHJD7U6D4ALL4MCJBRM4FCM33TYRGJQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil>
Jul 18 16:41:49.177597726 (607h31m23.948239091s) [noise=true , address=45.91.116.10:4083 , piece_id=MDJSZ6B4DXTYL6HDNXTMCUAIQ5KLHCYLAGG3N3MCJIP2QNL5RW5Q, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil>
Jul 18 16:41:49.178450397 (607h31m23.949091732s) [noise=true , address=45.91.116.5:4297 , piece_id=PUFJXKBYZAZOFCTME7XA6P4RHYGXVR3SUBOZHPVE7OARKCNLYJFQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil>
Jul 18 16:41:49.182076435 (607h31m23.95271777s) [noise=true , address=45.91.116.4:4939 , piece_id=7CV6VPBN5RA5CRY565LUVSQY7YQYM3ALKSEC73RV5QSTD4VBBL4A, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil>
Jul 18 16:41:49.249177562 (607h31m24.019818897s) [noise=true , address=104.36.82.12:4150 , piece_id=AYI6UITIDNUR7RC5P7LM36PSNIYKBI2U2EBSKD4IRFRPVAKDGIYA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil>
Jul 18 16:41:49.254394113 (607h31m24.025035448s) [noise=true , address=104.36.82.16:4294 , piece_id=AL5CBFM7G65APSHQ2VFLJ7ZNCTLG6FTEQW5KVQECJUF5GGW6L64A, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil>
Jul 18 16:41:49.263727842 (607h31m24.034369177s) [noise=true , address=104.36.82.7:4910 , piece_id=MXPIVOGGXL2ZVXTI73SYUA6RS7FJYC7OIARDDFYTVAFBH7BEYNJA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil>
Jul 18 16:41:49.266200353 (607h31m24.036841688s) [noise=true , address=45.91.116.9:4262 , piece_id=IH6HOZ6Z6OJB5KWUIC754YEVLX4QWSSF6M2SUCCU3DCVEJGENLPQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil>
Jul 18 16:41:49.283449276 (607h31m24.054090611s) [noise=true , address=45.91.116.8:4045 , piece_id=C74KAENMFPMGKUNZNAWBDBOW22H7P5XAMCGRMS4B3XDNVYEISDTA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil>
Jul 18 16:41:49.340968690 (607h31m24.111610025s) [noise=true , address=104.36.82.16:4295 , piece_id=KCENFMTJTOHVA5XGK5QYF6SW66TMSKW3TCQJKU5EWIJKMKBXFUYA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil>
Jul 18 16:41:49.360005013 (607h31m24.130646348s) [noise=true , address=104.36.82.4:4801 , piece_id=BD2IE6RBWE5P2ONS3YQUXRKVJBPRDYPOJTGHI3GU3WP5DLFI3DNA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil>
Jul 18 16:42:16.239473886 (607h31m51.010115221s) [noise=true , address=77.90.31.13:4627 , piece_id=BK25LXSZA335BDKA7ECT276LAU4Q3DDMWOGYL3QRHQZGKSFO4OQA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection
Jul 18 16:42:16.239514102 (607h31m51.010155437s) [noise=true , address=77.90.31.14:4661 , piece_id=45ACE325BMANQNS2F7GT5UBORIQ2ALIKASO5ITNMRJ35AZMY4TUA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection; write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection
Jul 18 16:42:16.239543529 (607h31m51.010184864s) [noise=true , address=77.90.31.12:4589 , piece_id=LYKG57L6G67IHMKFECMMOCL47FSO2D6A6KTTD6QDWL6D66ARG6KA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection; write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection
Jul 18 16:42:16.239600097 (607h31m51.010241432s) [noise=true , address=77.90.31.11:4555 , piece_id=M3GAYWU63PDQSV5MHAVLGXV53GWYK33JRSXZLHJCWDO4EJ5ZXJZA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection; write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection
Jul 18 16:42:16.239630144 (607h31m51.010271519s) [seg_pos={0 0}, upload=485834]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Jul 18 16:42:16.479299342 (607h31m51.249940677s) [upload=485834]: Done uploading segments...
Jul 18 16:42:16.479325091 (607h31m51.249966416s) [upload=485834]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 5.784946513s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
448.402464ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 16:42:28 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 448.429014ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
479.609333ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 16:42:25 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 479.630102ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.......XX..X...............................................X] duration:
30.24115165s
FAIL (2025-07-18 16:42:16 UTC)
orbiter warning:
======ERROR======
uplink: failed to upload enough pieces (needed at least 13 but got 12)
======LOGS======
43943061 (607h30m56.014584396s) [upload=485824]: Done uploading segments...
Jul 18 16:41:21.243960926 (607h30m56.014602261s) [upload=485824]: Upload finished. err: <nil>
Jul 18 16:41:46.882293880 (607h31m21.652935215s) [upload=485834]: Starting upload
Jul 18 16:41:46.882408149 (607h31m21.653049514s) [upload=485834]: Done starting upload
Jul 18 16:41:46.882487250 (607h31m21.653128575s) [upload=485834]: Uploading segments...
Jul 18 16:41:46.882712641 (607h31m21.653353976s) [upload=485834]: Got next segment. Inline: false
Jul 18 16:41:46.882774189 (607h31m21.653415534s) [upload=485834]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 16:41:46.882780781 (607h31m21.653422116s) [upload=485834]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 16:41:47.119575499 (607h31m21.890216834s) [seg_pos={0 0}, upload=485834]: Begin upload segment...
Jul 18 16:41:47.119620745 (607h31m21.890262081s) [seg_pos={0 0}, upload=485834]: Done begin upload segment.
Jul 18 16:41:47.119648959 (607h31m21.890290294s) [noise=true , address=104.36.82.16:4294 , piece_id=AL5CBFM7G65APSHQ2VFLJ7ZNCTLG6FTEQW5KVQECJUF5GGW6L64A, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.119652606 (607h31m21.890293961s) [noise=true , address=45.91.116.9:4262 , piece_id=IH6HOZ6Z6OJB5KWUIC754YEVLX4QWSSF6M2SUCCU3DCVEJGENLPQ, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.119949835 (607h31m21.89059117s) [noise=true , address=45.91.116.10:4083 , piece_id=MDJSZ6B4DXTYL6HDNXTMCUAIQ5KLHCYLAGG3N3MCJIP2QNL5RW5Q, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.120180456 (607h31m21.890821791s) [noise=true , address=45.91.116.8:4045 , piece_id=C74KAENMFPMGKUNZNAWBDBOW22H7P5XAMCGRMS4B3XDNVYEISDTA, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.120285036 (607h31m21.890926371s) [noise=true , address=77.90.31.13:4627 , piece_id=BK25LXSZA335BDKA7ECT276LAU4Q3DDMWOGYL3QRHQZGKSFO4OQA, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.120478577 (607h31m21.891119912s) [noise=true , address=45.91.116.5:4297 , piece_id=PUFJXKBYZAZOFCTME7XA6P4RHYGXVR3SUBOZHPVE7OARKCNLYJFQ, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.120603516 (607h31m21.891244851s) [noise=true , address=104.36.82.4:4801 , piece_id=BD2IE6RBWE5P2ONS3YQUXRKVJBPRDYPOJTGHI3GU3WP5DLFI3DNA, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.120735118 (607h31m21.891376453s) [noise=true , address=77.90.31.14:4661 , piece_id=45ACE325BMANQNS2F7GT5UBORIQ2ALIKASO5ITNMRJ35AZMY4TUA, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.120849597 (607h31m21.891490932s) [noise=true , address=104.36.82.10:4077 , piece_id=JTSZYPFMLFPULXEYU6RVAWHZSXUIELBIIPFBXIDSIMWPEYY3RFWA, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.121005264 (607h31m21.891646589s) [noise=true , address=104.36.82.7:4910 , piece_id=MXPIVOGGXL2ZVXTI73SYUA6RS7FJYC7OIARDDFYTVAFBH7BEYNJA, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.121106829 (607h31m21.891748164s) [noise=true , address=45.91.116.4:4939 , piece_id=7CV6VPBN5RA5CRY565LUVSQY7YQYM3ALKSEC73RV5QSTD4VBBL4A, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.121249542 (607h31m21.891890867s) [noise=true , address=77.90.31.11:4555 , piece_id=M3GAYWU63PDQSV5MHAVLGXV53GWYK33JRSXZLHJCWDO4EJ5ZXJZA, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.121592128 (607h31m21.892233463s) [noise=true , address=104.36.82.12:4150 , piece_id=AYI6UITIDNUR7RC5P7LM36PSNIYKBI2U2EBSKD4IRFRPVAKDGIYA, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.121878996 (607h31m21.892520331s) [noise=true , address=104.36.82.16:4295 , piece_id=KCENFMTJTOHVA5XGK5QYF6SW66TMSKW3TCQJKU5EWIJKMKBXFUYA, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.122109017 (607h31m21.892750352s) [noise=true , address=45.91.116.14:4190 , piece_id=MOSOWA7NNLUJNTZAWNEYZMHJD7U6D4ALL4MCJBRM4FCM33TYRGJQ, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:47.127832217 (607h31m21.898473552s) [noise=true , address=77.90.31.12:4589 , piece_id=LYKG57L6G67IHMKFECMMOCL47FSO2D6A6KTTD6QDWL6D66ARG6KA, seg_pos={0 0}, upload=485834]: Uploading piece...
Jul 18 16:41:48.840592792 (607h31m23.611234127s) [upload=485834]: Next returned nil segment
Jul 18 16:41:48.840609223 (607h31m23.611250558s) [upload=485834]: Waiting for error group managing segments...
Jul 18 16:41:49.162427890 (607h31m23.933069235s) [noise=true , address=104.36.82.10:4077 , piece_id=JTSZYPFMLFPULXEYU6RVAWHZSXUIELBIIPFBXIDSIMWPEYY3RFWA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil>
Jul 18 16:41:49.174349590 (607h31m23.944990915s) [noise=true , address=45.91.116.14:4190 , piece_id=MOSOWA7NNLUJNTZAWNEYZMHJD7U6D4ALL4MCJBRM4FCM33TYRGJQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil>
Jul 18 16:41:49.177597726 (607h31m23.948239091s) [noise=true , address=45.91.116.10:4083 , piece_id=MDJSZ6B4DXTYL6HDNXTMCUAIQ5KLHCYLAGG3N3MCJIP2QNL5RW5Q, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil>
Jul 18 16:41:49.178450397 (607h31m23.949091732s) [noise=true , address=45.91.116.5:4297 , piece_id=PUFJXKBYZAZOFCTME7XA6P4RHYGXVR3SUBOZHPVE7OARKCNLYJFQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil>
Jul 18 16:41:49.182076435 (607h31m23.95271777s) [noise=true , address=45.91.116.4:4939 , piece_id=7CV6VPBN5RA5CRY565LUVSQY7YQYM3ALKSEC73RV5QSTD4VBBL4A, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil>
Jul 18 16:41:49.249177562 (607h31m24.019818897s) [noise=true , address=104.36.82.12:4150 , piece_id=AYI6UITIDNUR7RC5P7LM36PSNIYKBI2U2EBSKD4IRFRPVAKDGIYA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil>
Jul 18 16:41:49.254394113 (607h31m24.025035448s) [noise=true , address=104.36.82.16:4294 , piece_id=AL5CBFM7G65APSHQ2VFLJ7ZNCTLG6FTEQW5KVQECJUF5GGW6L64A, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil>
Jul 18 16:41:49.263727842 (607h31m24.034369177s) [noise=true , address=104.36.82.7:4910 , piece_id=MXPIVOGGXL2ZVXTI73SYUA6RS7FJYC7OIARDDFYTVAFBH7BEYNJA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil>
Jul 18 16:41:49.266200353 (607h31m24.036841688s) [noise=true , address=45.91.116.9:4262 , piece_id=IH6HOZ6Z6OJB5KWUIC754YEVLX4QWSSF6M2SUCCU3DCVEJGENLPQ, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil>
Jul 18 16:41:49.283449276 (607h31m24.054090611s) [noise=true , address=45.91.116.8:4045 , piece_id=C74KAENMFPMGKUNZNAWBDBOW22H7P5XAMCGRMS4B3XDNVYEISDTA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil>
Jul 18 16:41:49.340968690 (607h31m24.111610025s) [noise=true , address=104.36.82.16:4295 , piece_id=KCENFMTJTOHVA5XGK5QYF6SW66TMSKW3TCQJKU5EWIJKMKBXFUYA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil>
Jul 18 16:41:49.360005013 (607h31m24.130646348s) [noise=true , address=104.36.82.4:4801 , piece_id=BD2IE6RBWE5P2ONS3YQUXRKVJBPRDYPOJTGHI3GU3WP5DLFI3DNA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: <nil>
Jul 18 16:42:16.239473886 (607h31m51.010115221s) [noise=true , address=77.90.31.13:4627 , piece_id=BK25LXSZA335BDKA7ECT276LAU4Q3DDMWOGYL3QRHQZGKSFO4OQA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB, address:77.90.31.13:4627): protocol: write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54866->77.90.31.13:4627: use of closed network connection
Jul 18 16:42:16.239514102 (607h31m51.010155437s) [noise=true , address=77.90.31.14:4661 , piece_id=45ACE325BMANQNS2F7GT5UBORIQ2ALIKASO5ITNMRJ35AZMY4TUA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:12faSN2qTnzvZquF4ekHA6PX5tDSAyrVTkWuy1Z3FxgByxZ4jue, address:77.90.31.14:4661): protocol: write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection; write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59048->77.90.31.14:4661: use of closed network connection
Jul 18 16:42:16.239543529 (607h31m51.010184864s) [noise=true , address=77.90.31.12:4589 , piece_id=LYKG57L6G67IHMKFECMMOCL47FSO2D6A6KTTD6QDWL6D66ARG6KA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1jHm28wBr3S4P5omoHpbVbyYpnXvxakxkkmgVm5fthtj4HZbv, address:77.90.31.12:4589): protocol: write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection; write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:54478->77.90.31.12:4589: use of closed network connection
Jul 18 16:42:16.239600097 (607h31m51.010241432s) [noise=true , address=77.90.31.11:4555 , piece_id=M3GAYWU63PDQSV5MHAVLGXV53GWYK33JRSXZLHJCWDO4EJ5ZXJZA, seg_pos={0 0}, upload=485834]: Done uploading piece. err: ecclient: upload failed (node:1aRnwUHwyB11FpSDzQWDikCaEu6YCnvKwy9VRFYq8sbm7K6jgQ, address:77.90.31.11:4555): protocol: write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection; write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:33186->77.90.31.11:4555: use of closed network connection
Jul 18 16:42:16.239630144 (607h31m51.010271519s) [seg_pos={0 0}, upload=485834]: Done waiting for segment. successful: 12 optimal: 13 errs: <nil>
Jul 18 16:42:16.479299342 (607h31m51.249940677s) [upload=485834]: Done uploading segments...
Jul 18 16:42:16.479325091 (607h31m51.249966416s) [upload=485834]: Upload finished. err: failed to upload enough pieces (needed at least 13 but got 12)
Duration: 30.241170738s
core
uplink
us-select-1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
480.37978ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 16:42:06 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 480.399127ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
447.001855ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 16:41:49 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 447.022224ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
463.508257ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 16:41:32 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 463.524869ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [........XX..X...............................................] duration:
24.603096975s
FAIL (2025-07-18 16:41:23 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
t. successful: 13 optimal: 13 errs: <nil>
Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments...
Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil>
Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload
Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload
Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments...
Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false
Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment...
Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment.
Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment
Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments...
Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces.
Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection
Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection
Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments...
Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil>
Duration: 24.603130177s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
446.516837ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 16:41:15 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 446.589346ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
473.559377ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 16:41:13 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 473.587982ms
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
450.288385ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 16:40:20 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 450.31178ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
484.918932ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 16:40:10 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 484.943801ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.........XX..X..............................................] duration:
5.748613271s
FAIL (2025-07-18 16:39:55 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
t. successful: 13 optimal: 13 errs: <nil>
Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments...
Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil>
Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload
Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload
Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments...
Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false
Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment...
Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment.
Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment
Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments...
Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces.
Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection
Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection
Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments...
Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil>
Duration: 5.748642306s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
483.404327ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 16:39:45 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 483.426499ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
443.774723ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 16:39:36 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 443.801073ms
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
455.118505ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 16:39:30 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 455.135247ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [..........XX..X.............................................] duration:
5.837052063s
FAIL (2025-07-18 16:39:23 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
t. successful: 13 optimal: 13 errs: <nil>
Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments...
Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil>
Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload
Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload
Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments...
Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false
Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment...
Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment.
Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment
Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments...
Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces.
Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection
Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection
Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments...
Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil>
Duration: 5.837081359s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [...........XX..X............................................] duration:
5.798722768s
FAIL (2025-07-18 16:38:35 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
t. successful: 13 optimal: 13 errs: <nil>
Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments...
Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil>
Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload
Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload
Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments...
Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false
Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment...
Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment.
Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment
Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments...
Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces.
Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection
Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection
Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments...
Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil>
Duration: 5.798749098s
core
uplink
us-select-1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
459.329593ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 16:38:24 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 459.355952ms
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
469.373788ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 16:38:19 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 469.401702ms
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
437.483773ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 16:37:25 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 437.506877ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [............XX..X...........................................] duration:
6.019544492s
FAIL (2025-07-18 16:37:21 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
t. successful: 13 optimal: 13 errs: <nil>
Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments...
Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil>
Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload
Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload
Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments...
Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false
Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment...
Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment.
Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment
Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments...
Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces.
Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection
Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection
Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments...
Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil>
Duration: 6.019569609s
core
uplink
us-select-1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
440.673907ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 16:37:18 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 440.688927ms
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
456.066069ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 16:36:58 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 456.083663ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [.............XX..X..........................................] duration:
5.921593443s
FAIL (2025-07-18 16:36:43 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
t. successful: 13 optimal: 13 errs: <nil>
Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments...
Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil>
Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload
Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload
Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments...
Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false
Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment...
Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment.
Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment
Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments...
Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces.
Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection
Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection
Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments...
Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil>
Duration: 5.921619643s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
467.070031ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 16:36:35 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 467.092395ms
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
458.779249ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 16:36:16 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 458.802063ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
445.484743ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 16:36:15 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 445.50476ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
3 out of 60 is failed (threshold=3) [..............XX..X.........................................] duration:
5.934827111s
FAIL (2025-07-18 16:36:05 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
t. successful: 13 optimal: 13 errs: <nil>
Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments...
Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil>
Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload
Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload
Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments...
Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false
Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment...
Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment.
Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment
Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments...
Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces.
Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection
Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection
Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments...
Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil>
Duration: 5.934849855s
core
uplink
us-select-1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
436.913212ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 16:35:57 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 436.937809ms
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
444.909804ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 16:35:38 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 444.925252ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [X..............XX..X........................................] duration:
5.684856043s
FAIL (2025-07-18 16:35:28 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
t. successful: 13 optimal: 13 errs: <nil>
Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments...
Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil>
Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload
Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload
Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments...
Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false
Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment...
Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment.
Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment
Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments...
Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces.
Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection
Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection
Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments...
Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil>
Duration: 5.684890629s
core
uplink
us-select-1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
469.13855ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 16:35:04 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 469.16453ms
edge
ipfs
us1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
567.108218ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 16:34:56 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 567.160047ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.X..............XX..X.......................................] duration:
5.805288732s
FAIL (2025-07-18 16:34:45 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
t. successful: 13 optimal: 13 errs: <nil>
Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments...
Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil>
Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload
Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload
Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments...
Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false
Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment...
Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment.
Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment
Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments...
Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces.
Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection
Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection
Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments...
Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil>
Duration: 5.80530908s
core
uplink
us-select-1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
60 out of 60 is failed (threshold=3) [XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
447.791425ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 16:34:42 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 447.824139ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [..X..............XX..X......................................] duration:
5.704496281s
FAIL (2025-07-18 16:34:04 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
t. successful: 13 optimal: 13 errs: <nil>
Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments...
Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil>
Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload
Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload
Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments...
Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false
Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment...
Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment.
Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment
Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments...
Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces.
Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection
Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection
Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments...
Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil>
Duration: 5.704524164s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
59 out of 60 is failed (threshold=3) [.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
441.614177ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 16:33:51 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 441.63204ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
59 out of 60 is failed (threshold=3) [.XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
441.263165ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 16:33:41 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 441.28162ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [...X..............XX..X.....................................] duration:
5.960456205s
FAIL (2025-07-18 16:33:10 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
t. successful: 13 optimal: 13 errs: <nil>
Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments...
Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil>
Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload
Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload
Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments...
Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false
Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment...
Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment.
Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment
Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments...
Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces.
Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection
Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection
Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments...
Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil>
Duration: 5.960477806s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
58 out of 60 is failed (threshold=3) [..XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
521.961347ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 16:32:55 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 521.979032ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
58 out of 60 is failed (threshold=3) [..XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
476.639ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 16:32:35 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 476.656695ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
57 out of 60 is failed (threshold=3) [...XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
455.082997ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 16:32:00 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 455.10563ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [....X..............XX..X....................................] duration:
6.033831178s
FAIL (2025-07-18 16:31:59 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
t. successful: 13 optimal: 13 errs: <nil>
Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments...
Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil>
Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload
Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload
Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments...
Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false
Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment...
Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment.
Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment
Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments...
Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces.
Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection
Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection
Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments...
Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil>
Duration: 6.033874691s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
57 out of 60 is failed (threshold=3) [...XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
495.017585ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 16:31:40 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 495.041832ms
edge
ipfs
us1
|
checkers.HTTP{"POST" "https://www.storj-ipfs.com/api/v0/add", authorization: <redacted>, ExpectedContent: "Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi"} failure (antiblip window 3/60): (ipfs.post)antiblip:
56 out of 60 is failed (threshold=3) [....XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
438.445403ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/api/v0/add
FAIL (2025-07-18 16:31:25 UTC)
orbiter warning: Post "https://www.storj-ipfs.com/api/v0/add": EOF
Duration: 438.469699ms
edge
ipfs
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [.....X..............XX..X...................................] duration:
5.867598488s
FAIL (2025-07-18 16:31:23 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
t. successful: 13 optimal: 13 errs: <nil>
Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments...
Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil>
Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload
Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload
Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments...
Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false
Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment...
Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment.
Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment
Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments...
Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces.
Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection
Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection
Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments...
Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil>
Duration: 5.867625049s
core
uplink
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)antiblip:
4 out of 60 is failed (threshold=3) [......X..............XX..X..................................] duration:
5.831338844s
FAIL (2025-07-18 16:30:37 UTC)
orbiter warning:
======ERROR======
uplink: context deadline exceeded
======LOGS======
t. successful: 13 optimal: 13 errs: <nil>
Jul 18 16:06:18.845001877 (606h55m53.615643212s) [upload=485361]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 16:06:18.845006165 (606h55m53.6156475s) [upload=485361]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 16:06:19.157561958 (606h55m53.928203293s) [upload=485361]: Done uploading segments...
Jul 18 16:06:19.157582608 (606h55m53.928223943s) [upload=485361]: Upload finished. err: <nil>
Jul 18 16:06:55.979000814 (606h56m30.749642139s) [upload=485368]: Starting upload
Jul 18 16:06:55.979053775 (606h56m30.74969511s) [upload=485368]: Done starting upload
Jul 18 16:06:55.979233018 (606h56m30.749874353s) [upload=485368]: Uploading segments...
Jul 18 16:06:55.979263957 (606h56m30.749905293s) [upload=485368]: Got next segment. Inline: false
Jul 18 16:06:55.979287382 (606h56m30.749928717s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Jul 18 16:06:55.979292632 (606h56m30.749934027s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Jul 18 16:06:56.217934771 (606h56m30.988576106s) [seg_pos={0 0}, upload=485368]: Begin upload segment...
Jul 18 16:06:56.217977824 (606h56m30.988619159s) [seg_pos={0 0}, upload=485368]: Done begin upload segment.
Jul 18 16:06:56.217991239 (606h56m30.988632574s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218000678 (606h56m30.988642003s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218330519 (606h56m30.988971844s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218336801 (606h56m30.988978126s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218596978 (606h56m30.989238313s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.218863308 (606h56m30.989504643s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219124377 (606h56m30.989765712s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219378003 (606h56m30.990019328s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219633421 (606h56m30.990274756s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.219891254 (606h56m30.990532589s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220079655 (606h56m30.99072098s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220311018 (606h56m30.990952343s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220508075 (606h56m30.99114941s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220704761 (606h56m30.991346096s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.220895797 (606h56m30.991537122s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:56.221097532 (606h56m30.991738868s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Uploading piece...
Jul 18 16:06:57.945205002 (606h56m32.715846337s) [upload=485368]: Next returned nil segment
Jul 18 16:06:57.945222375 (606h56m32.71586371s) [upload=485368]: Waiting for error group managing segments...
Jul 18 16:06:58.266188848 (606h56m33.036830183s) [noise=true , address=104.36.82.9:4005 , piece_id=SYRH5SK3HGDJ7QQ5GO4HNCLCMC6HZ2ZXZJYT5HFJJMDHCWOTRWLQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.272456410 (606h56m33.043097745s) [noise=true , address=45.91.116.4:4940 , piece_id=Q5FLVW432KCFKTMFHWKMFP5KC4LKGG6KANL6ONWP4S6TDUOPTTYA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.285873141 (606h56m33.056514476s) [noise=true , address=45.91.116.11:4117 , piece_id=YVJI2IBVQCDUCP7GHOM62337VNYBQVPLEUDIWN6DFPXBOQAIZTUQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.287055714 (606h56m33.057697049s) [noise=true , address=45.91.116.6:4975 , piece_id=Z4GKO5ZR7U2NGA656D72BZAVLQHCPVZYZIY54IZCHNMBHX4JNZ3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.336661226 (606h56m33.107302561s) [noise=true , address=104.36.82.7:4909 , piece_id=URCEY76T3LNHW23QPMXVNFKA724LSN7POVMZGZFAWZEHIIZCGWZQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.344106782 (606h56m33.114748117s) [noise=true , address=104.36.82.15:4257 , piece_id=2XWRGTQ55GXFXZ54EUPG64HVTFZALTN6FG7KN3STN5KQX24MN64A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.352868976 (606h56m33.123510311s) [noise=true , address=104.36.82.4:4802 , piece_id=LZWLY2AWBB534UEY3JNK25W7MVO4WGJSRRTY66KLUIQMZZVGCKNA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.361102590 (606h56m33.131743925s) [noise=true , address=104.36.82.2:4730 , piece_id=4W565QZNLMOYV45PT5OSXAZ2GCS76GJWYMG3NOVSUZ2OOBNC2ITQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.455342762 (606h56m33.225984097s) [noise=true , address=45.91.116.7:4010 , piece_id=DTLOUADNDTKIMONNDIZTMZCBGP2E62DKEPBKC3LMUXIG67LHNQLA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:06:58.556891579 (606h56m33.327532914s) [noise=true , address=45.91.116.5:4297 , piece_id=5OE2XAXO6N6GDQPALET26SYSSRW7TB5R6S36SWMDKYTE5VNZ6OJA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:16.016577380 (606h56m50.787218716s) [noise=true , address=77.90.31.15:4698 , piece_id=FTNZZBLGWZP6T5XRLSVHMYXDPF4VHN6NKPQLMCCTDOM265BS4MQQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:22.174568900 (606h56m56.945210235s) [noise=true , address=77.90.31.11:4554 , piece_id=CRJCVEOJLOWNX4KO2R7JPIBN5SKWFTV2AP747TXQ7NVW4X25GO3A, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:23.130640334 (606h56m57.901281669s) [noise=true , address=77.90.31.19:4841 , piece_id=SJAR2P7L3FAFKPPHMJSTQYZZA5DN2TNMOAXBOJ34VZ7EIGHKCLWA, seg_pos={0 0}, upload=485368]: Done uploading piece. err: <nil>
Jul 18 16:07:23.130689748 (606h56m57.901331083s) [seg_pos={0 0}, upload=485368]: Segment reached optimal threshold of 13 pieces.
Jul 18 16:07:23.130847831 (606h56m57.901489166s) [noise=true , address=77.90.31.12:4592 , piece_id=FLMWNZVEKBMQ5KDPK5G5VOCXTEYA6GNWUXE3QZJD26JBHISYLZ5Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12dBQJ4Q1FVnvhYDRb9JrgVFPyQew4z7jfWgSsF7qxif5Mm8ai3): protocol: expected piece hash; context canceled; EOF
Jul 18 16:07:23.130952721 (606h56m57.901594056s) [noise=true , address=77.90.31.13:4627 , piece_id=BA54UYJWN3FXMV463AJTS3JCUMIQFPURCQIXHVZG72A2A4CJE74Q, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1VawvPHa7gM65pn3kxPmaMjmXqMNrutEKXTmbDxdeNP9WCgLSB): protocol: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:59190->77.90.31.13:4627: use of closed network connection
Jul 18 16:07:23.130991406 (606h56m57.901632741s) [noise=true , address=77.90.31.17:4770 , piece_id=VD3PX2BXC5E4MRAZNVWMSH5EYRPCQTGIP5BV4QZXJ5MCIEX3K2IQ, seg_pos={0 0}, upload=485368]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:125ivanwRPxZhNW6ryony9FCETtFegxPRZg18B3AB2B9ch8865R): protocol: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:53164->77.90.31.17:4770: use of closed network connection
Jul 18 16:07:23.131029738 (606h56m57.901671074s) [seg_pos={0 0}, upload=485368]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil>
Jul 18 16:07:23.131108710 (606h56m57.901750045s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Jul 18 16:07:23.131113358 (606h56m57.901754693s) [upload=485368]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Jul 18 16:07:23.425535035 (606h56m58.19617637s) [upload=485368]: Done uploading segments...
Jul 18 16:07:23.425546817 (606h56m58.196188142s) [upload=485368]: Upload finished. err: <nil>
Duration: 5.831375705s
core
uplink
us-select-1
|
checkers.HTTP{"GET" "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi", ExpectedContent: "Storj IPFS!"} failure (antiblip window 3/60): (ipfs.get)antiblip:
56 out of 60 is failed (threshold=3) [....XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX] duration:
467.512999ms remote:
"tcp:5.161.37.179:443" target:
https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi
FAIL (2025-07-18 16:30:36 UTC)
orbiter warning: Get "https://www.storj-ipfs.com/ipfs/Qmbj74UUMUGDe4TES4fEbWEEe5fiwqJEjQ8CHaLJUF9dSi": EOF
Duration: 467.536525ms
edge
ipfs
us1
|