Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [....................................................X.......] duration:
6.468250376s
FAIL (2025-08-19 09:06:39 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 207.211.208.129:443: i/o timeout
Duration: 6.468275784s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
5.855084168s
FAIL (2025-08-19 09:06:18 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.855113905s
core
uplink
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [......................X.....................................] duration:
5.980808112s
FAIL (2025-08-19 09:06:18 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.980830574s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [....X.........X............X......X......X.........X.....X..] duration:
5.802709102s
FAIL (2025-08-19 09:06:17 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 09:05:21.386438602 (255h39m15.817518773s) [upload=265857]: Starting upload
Aug 19 09:05:21.386559594 (255h39m15.817639745s) [upload=265857]: Done starting upload
Aug 19 09:05:21.386679683 (255h39m15.817759844s) [upload=265857]: Uploading segments...
Aug 19 09:05:21.386995678 (255h39m15.818075829s) [upload=265857]: Got next segment. Inline: false
Aug 19 09:05:21.387047998 (255h39m15.818128159s) [upload=265857]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 09:05:21.387055593 (255h39m15.818135764s) [upload=265857]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 09:05:21.839112567 (255h39m16.270192698s) [seg_pos={0 0}, upload=265857]: Begin upload segment...
Aug 19 09:05:21.839163405 (255h39m16.270243536s) [seg_pos={0 0}, upload=265857]: Done begin upload segment.
Aug 19 09:05:21.839195306 (255h39m16.270275437s) [noise=true , address=79.127.220.101:4041 , piece_id=AY4RMLD4FDEHVLR4CQRWU525U4Y5UYNCJYA4AYY5ZC6MSOK5H64Q, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.839204955 (255h39m16.270285096s) [noise=true , address=45.91.116.7:4021 , piece_id=FL2LFAFVWHUMWUXBUHLG5GNE3JXSFNW66DLMCELFBGSLS2GONKKQ, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.839572277 (255h39m16.270652398s) [noise=true , address=104.36.82.23:4451 , piece_id=HBATATUY3DLSDRJFHWEN3WMPMBPQDNJFNYYN7HG2BIMZEUXNCEMA, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.839591324 (255h39m16.270671455s) [noise=true , address=45.91.116.5:4327 , piece_id=FPD5MNHTRL52KEKQSHI5MZR42ZBMTNTAYLBZMA7GZCV22SDYDHMA, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.839913881 (255h39m16.270994012s) [noise=true , address=79.127.201.215:4358 , piece_id=4QD4KQTWTBIVSPUU6IXBZXEODOLHERQOWGFO5LOMCLIFZLPKM5VA, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.840186824 (255h39m16.271266955s) [noise=true , address=77.90.31.16:4755 , piece_id=AUGTCHWTIH3UX4JIFDNSR7LWBZ3UVWOIWMY2FKMTKGFSL27KV4IQ, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.840494562 (255h39m16.271574693s) [noise=true , address=77.90.31.14:4665 , piece_id=XRRH4NWFGVB3TSZTMVQNWXLGPDZX7M4NGVFZEGUUQGBEXE2CAJ3A, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.840759619 (255h39m16.27183975s) [noise=true , address=45.91.116.11:4127 , piece_id=CQ2HIBJ5WQKS5GUH75YQIVEMRX2UAB2NH5SJ3L4XDTWSBYOEK6XQ, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.840996422 (255h39m16.272076543s) [noise=true , address=104.36.82.60:4355 , piece_id=MYLLXIEJU4GTBCLEQBWT3XE2LEKQZWQS7DMCP47I4EJ4XUUYCZZA, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.841206204 (255h39m16.272286325s) [noise=true , address=77.90.31.19:4863 , piece_id=DNAB3QDGD6MVNC5B7ATB5A2ANQNQQGN3OG7MS6Y4Q5LDFILEGJYA, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.841449870 (255h39m16.272529991s) [noise=true , address=77.90.31.21:4902 , piece_id=5G7ESRY3V7NIFGMGBBWBPFDWI7LNKSABDB7XWNAXNHSNMJOTDFEQ, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.841647629 (255h39m16.27272776s) [noise=true , address=79.127.219.38:4023 , piece_id=FMLGKM37SQTJUVJFWNPF2N32CNDF3D4M2YGPMTQT73UPKBLLKBIA, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.841882698 (255h39m16.272962829s) [noise=true , address=104.36.82.13:4220 , piece_id=B4LUPTDK367WY4SZBP7DFQFY3YARY3OHVU3OKDURATIUA2YC6ZDA, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.842073643 (255h39m16.273153774s) [noise=true , address=79.127.201.215:4347 , piece_id=IO3QJ6SBXLTUIGKWAK32OFN2UPJOOKYUMFP3VIBHGKM67BLJ76DQ, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.842278255 (255h39m16.273358386s) [noise=true , address=104.36.82.60:4345 , piece_id=WAFZ5QVCJOQ65CDGQTUCEG5SHA3E4MXRYIA4RN5ILOFSZV2Q53GA, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.842468028 (255h39m16.273548159s) [noise=true , address=45.91.116.13:4163 , piece_id=EUHVJKQCBFG4ZGWTADKIKUA6HTWMGJNKMACKKZW6O7TKAI47IOMQ, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.844254927 (255h39m16.275335058s) [noise=true , address=79.127.219.47:4050 , piece_id=3J5VP45UI2E2NBADG6GZO6XAIBZODLEDCBTTR6WRE5T6H74HD24A, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.853147723 (255h39m16.284227865s) [noise=true , address=77.90.31.11:4575 , piece_id=X3JWBFNYRF2RKJRGQYA2OWPBTNAHMB4FC3NHEMT3LP55FN2V5BMA, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:23.294292552 (255h39m17.725372693s) [upload=265857]: Next returned nil segment
Aug 19 09:05:23.294311959 (255h39m17.72539209s) [upload=265857]: Waiting for error group managing segments...
Aug 19 09:05:23.684512468 (255h39m18.115592599s) [noise=true , address=79.127.220.101:4041 , piece_id=AY4RMLD4FDEHVLR4CQRWU525U4Y5UYNCJYA4AYY5ZC6MSOK5H64Q, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.744831714 (255h39m18.175911845s) [noise=true , address=45.91.116.5:4327 , piece_id=FPD5MNHTRL52KEKQSHI5MZR42ZBMTNTAYLBZMA7GZCV22SDYDHMA, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.778764021 (255h39m18.209844152s) [noise=true , address=45.91.116.11:4127 , piece_id=CQ2HIBJ5WQKS5GUH75YQIVEMRX2UAB2NH5SJ3L4XDTWSBYOEK6XQ, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.803306191 (255h39m18.234386322s) [noise=true , address=79.127.219.47:4050 , piece_id=3J5VP45UI2E2NBADG6GZO6XAIBZODLEDCBTTR6WRE5T6H74HD24A, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.817327660 (255h39m18.248407791s) [noise=true , address=79.127.201.215:4347 , piece_id=IO3QJ6SBXLTUIGKWAK32OFN2UPJOOKYUMFP3VIBHGKM67BLJ76DQ, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.819388343 (255h39m18.250468474s) [noise=true , address=79.127.201.215:4358 , piece_id=4QD4KQTWTBIVSPUU6IXBZXEODOLHERQOWGFO5LOMCLIFZLPKM5VA, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.825396278 (255h39m18.256476409s) [noise=true , address=45.91.116.13:4163 , piece_id=EUHVJKQCBFG4ZGWTADKIKUA6HTWMGJNKMACKKZW6O7TKAI47IOMQ, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.825697725 (255h39m18.256777846s) [noise=true , address=77.90.31.19:4863 , piece_id=DNAB3QDGD6MVNC5B7ATB5A2ANQNQQGN3OG7MS6Y4Q5LDFILEGJYA, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.833275474 (255h39m18.264355615s) [noise=true , address=45.91.116.7:4021 , piece_id=FL2LFAFVWHUMWUXBUHLG5GNE3JXSFNW66DLMCELFBGSLS2GONKKQ, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.839237001 (255h39m18.270317142s) [noise=true , address=77.90.31.11:4575 , piece_id=X3JWBFNYRF2RKJRGQYA2OWPBTNAHMB4FC3NHEMT3LP55FN2V5BMA, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.860377381 (255h39m18.291457512s) [noise=true , address=104.36.82.23:4451 , piece_id=HBATATUY3DLSDRJFHWEN3WMPMBPQDNJFNYYN7HG2BIMZEUXNCEMA, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.902524857 (255h39m18.333604988s) [noise=true , address=77.90.31.21:4902 , piece_id=5G7ESRY3V7NIFGMGBBWBPFDWI7LNKSABDB7XWNAXNHSNMJOTDFEQ, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.903870151 (255h39m18.334950292s) [noise=true , address=104.36.82.60:4345 , piece_id=WAFZ5QVCJOQ65CDGQTUCEG5SHA3E4MXRYIA4RN5ILOFSZV2Q53GA, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.945073361 (255h39m18.376153492s) [noise=true , address=77.90.31.14:4665 , piece_id=XRRH4NWFGVB3TSZTMVQNWXLGPDZX7M4NGVFZEGUUQGBEXE2CAJ3A, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.945099120 (255h39m18.376179241s) [seg_pos={0 0}, upload=265857]: Segment reached optimal threshold of 14 pieces.
Aug 19 09:05:23.945271399 (255h39m18.37635153s) [noise=true , address=104.36.82.60:4355 , piece_id=MYLLXIEJU4GTBCLEQBWT3XE2LEKQZWQS7DMCP47I4EJ4XUUYCZZA, seg_pos={0 0}, upload=265857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eA7ZLTkgGyCRsnQSEC8oYM3y9oeB5MQ4FUueJNMb4FLZueNv2): protocol: expected piece hash; context canceled; EOF
Aug 19 09:05:23.945357034 (255h39m18.376437165s) [noise=true , address=79.127.219.38:4023 , piece_id=FMLGKM37SQTJUVJFWNPF2N32CNDF3D4M2YGPMTQT73UPKBLLKBIA, seg_pos={0 0}, upload=265857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eznpLbftyLUaT3C6P8AvJHZ753784rW4JQ84pv4Z847eVH4Qn): protocol: write tcp 188.166.225.170:43272->79.127.219.38:4023: use of closed network connection; write tcp 188.166.225.170:43272->79.127.219.38:4023: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43272->79.127.219.38:4023: use of closed network connection
Aug 19 09:05:23.945383054 (255h39m18.376463185s) [noise=true , address=104.36.82.13:4220 , piece_id=B4LUPTDK367WY4SZBP7DFQFY3YARY3OHVU3OKDURATIUA2YC6ZDA, seg_pos={0 0}, upload=265857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6): protocol: expected piece hash; context canceled; EOF
Aug 19 09:05:23.945437428 (255h39m18.376517559s) [noise=true , address=77.90.31.16:4755 , piece_id=AUGTCHWTIH3UX4JIFDNSR7LWBZ3UVWOIWMY2FKMTKGFSL27KV4IQ, seg_pos={0 0}, upload=265857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF
Aug 19 09:05:23.945495599 (255h39m18.37657573s) [seg_pos={0 0}, upload=265857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 09:05:23.945577867 (255h39m18.376657998s) [upload=265857]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 09:05:23.945582405 (255h39m18.376662536s) [upload=265857]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 09:05:24.229584741 (255h39m18.660664872s) [upload=265857]: Done uploading segments...
Aug 19 09:05:24.229603748 (255h39m18.660683879s) [upload=265857]: Upload finished. err: <nil>
Duration: 5.80273382s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.....................................................X......] duration:
6.279900807s
FAIL (2025-08-19 09:05:47 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 207.211.208.129:443: i/o timeout
Duration: 6.280625284s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.....X.........X............X......X......X.........X.....X.] duration:
5.683413584s
FAIL (2025-08-19 09:05:42 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 09:05:21.386438602 (255h39m15.817518773s) [upload=265857]: Starting upload
Aug 19 09:05:21.386559594 (255h39m15.817639745s) [upload=265857]: Done starting upload
Aug 19 09:05:21.386679683 (255h39m15.817759844s) [upload=265857]: Uploading segments...
Aug 19 09:05:21.386995678 (255h39m15.818075829s) [upload=265857]: Got next segment. Inline: false
Aug 19 09:05:21.387047998 (255h39m15.818128159s) [upload=265857]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 09:05:21.387055593 (255h39m15.818135764s) [upload=265857]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 09:05:21.839112567 (255h39m16.270192698s) [seg_pos={0 0}, upload=265857]: Begin upload segment...
Aug 19 09:05:21.839163405 (255h39m16.270243536s) [seg_pos={0 0}, upload=265857]: Done begin upload segment.
Aug 19 09:05:21.839195306 (255h39m16.270275437s) [noise=true , address=79.127.220.101:4041 , piece_id=AY4RMLD4FDEHVLR4CQRWU525U4Y5UYNCJYA4AYY5ZC6MSOK5H64Q, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.839204955 (255h39m16.270285096s) [noise=true , address=45.91.116.7:4021 , piece_id=FL2LFAFVWHUMWUXBUHLG5GNE3JXSFNW66DLMCELFBGSLS2GONKKQ, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.839572277 (255h39m16.270652398s) [noise=true , address=104.36.82.23:4451 , piece_id=HBATATUY3DLSDRJFHWEN3WMPMBPQDNJFNYYN7HG2BIMZEUXNCEMA, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.839591324 (255h39m16.270671455s) [noise=true , address=45.91.116.5:4327 , piece_id=FPD5MNHTRL52KEKQSHI5MZR42ZBMTNTAYLBZMA7GZCV22SDYDHMA, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.839913881 (255h39m16.270994012s) [noise=true , address=79.127.201.215:4358 , piece_id=4QD4KQTWTBIVSPUU6IXBZXEODOLHERQOWGFO5LOMCLIFZLPKM5VA, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.840186824 (255h39m16.271266955s) [noise=true , address=77.90.31.16:4755 , piece_id=AUGTCHWTIH3UX4JIFDNSR7LWBZ3UVWOIWMY2FKMTKGFSL27KV4IQ, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.840494562 (255h39m16.271574693s) [noise=true , address=77.90.31.14:4665 , piece_id=XRRH4NWFGVB3TSZTMVQNWXLGPDZX7M4NGVFZEGUUQGBEXE2CAJ3A, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.840759619 (255h39m16.27183975s) [noise=true , address=45.91.116.11:4127 , piece_id=CQ2HIBJ5WQKS5GUH75YQIVEMRX2UAB2NH5SJ3L4XDTWSBYOEK6XQ, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.840996422 (255h39m16.272076543s) [noise=true , address=104.36.82.60:4355 , piece_id=MYLLXIEJU4GTBCLEQBWT3XE2LEKQZWQS7DMCP47I4EJ4XUUYCZZA, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.841206204 (255h39m16.272286325s) [noise=true , address=77.90.31.19:4863 , piece_id=DNAB3QDGD6MVNC5B7ATB5A2ANQNQQGN3OG7MS6Y4Q5LDFILEGJYA, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.841449870 (255h39m16.272529991s) [noise=true , address=77.90.31.21:4902 , piece_id=5G7ESRY3V7NIFGMGBBWBPFDWI7LNKSABDB7XWNAXNHSNMJOTDFEQ, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.841647629 (255h39m16.27272776s) [noise=true , address=79.127.219.38:4023 , piece_id=FMLGKM37SQTJUVJFWNPF2N32CNDF3D4M2YGPMTQT73UPKBLLKBIA, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.841882698 (255h39m16.272962829s) [noise=true , address=104.36.82.13:4220 , piece_id=B4LUPTDK367WY4SZBP7DFQFY3YARY3OHVU3OKDURATIUA2YC6ZDA, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.842073643 (255h39m16.273153774s) [noise=true , address=79.127.201.215:4347 , piece_id=IO3QJ6SBXLTUIGKWAK32OFN2UPJOOKYUMFP3VIBHGKM67BLJ76DQ, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.842278255 (255h39m16.273358386s) [noise=true , address=104.36.82.60:4345 , piece_id=WAFZ5QVCJOQ65CDGQTUCEG5SHA3E4MXRYIA4RN5ILOFSZV2Q53GA, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.842468028 (255h39m16.273548159s) [noise=true , address=45.91.116.13:4163 , piece_id=EUHVJKQCBFG4ZGWTADKIKUA6HTWMGJNKMACKKZW6O7TKAI47IOMQ, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.844254927 (255h39m16.275335058s) [noise=true , address=79.127.219.47:4050 , piece_id=3J5VP45UI2E2NBADG6GZO6XAIBZODLEDCBTTR6WRE5T6H74HD24A, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.853147723 (255h39m16.284227865s) [noise=true , address=77.90.31.11:4575 , piece_id=X3JWBFNYRF2RKJRGQYA2OWPBTNAHMB4FC3NHEMT3LP55FN2V5BMA, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:23.294292552 (255h39m17.725372693s) [upload=265857]: Next returned nil segment
Aug 19 09:05:23.294311959 (255h39m17.72539209s) [upload=265857]: Waiting for error group managing segments...
Aug 19 09:05:23.684512468 (255h39m18.115592599s) [noise=true , address=79.127.220.101:4041 , piece_id=AY4RMLD4FDEHVLR4CQRWU525U4Y5UYNCJYA4AYY5ZC6MSOK5H64Q, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.744831714 (255h39m18.175911845s) [noise=true , address=45.91.116.5:4327 , piece_id=FPD5MNHTRL52KEKQSHI5MZR42ZBMTNTAYLBZMA7GZCV22SDYDHMA, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.778764021 (255h39m18.209844152s) [noise=true , address=45.91.116.11:4127 , piece_id=CQ2HIBJ5WQKS5GUH75YQIVEMRX2UAB2NH5SJ3L4XDTWSBYOEK6XQ, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.803306191 (255h39m18.234386322s) [noise=true , address=79.127.219.47:4050 , piece_id=3J5VP45UI2E2NBADG6GZO6XAIBZODLEDCBTTR6WRE5T6H74HD24A, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.817327660 (255h39m18.248407791s) [noise=true , address=79.127.201.215:4347 , piece_id=IO3QJ6SBXLTUIGKWAK32OFN2UPJOOKYUMFP3VIBHGKM67BLJ76DQ, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.819388343 (255h39m18.250468474s) [noise=true , address=79.127.201.215:4358 , piece_id=4QD4KQTWTBIVSPUU6IXBZXEODOLHERQOWGFO5LOMCLIFZLPKM5VA, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.825396278 (255h39m18.256476409s) [noise=true , address=45.91.116.13:4163 , piece_id=EUHVJKQCBFG4ZGWTADKIKUA6HTWMGJNKMACKKZW6O7TKAI47IOMQ, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.825697725 (255h39m18.256777846s) [noise=true , address=77.90.31.19:4863 , piece_id=DNAB3QDGD6MVNC5B7ATB5A2ANQNQQGN3OG7MS6Y4Q5LDFILEGJYA, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.833275474 (255h39m18.264355615s) [noise=true , address=45.91.116.7:4021 , piece_id=FL2LFAFVWHUMWUXBUHLG5GNE3JXSFNW66DLMCELFBGSLS2GONKKQ, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.839237001 (255h39m18.270317142s) [noise=true , address=77.90.31.11:4575 , piece_id=X3JWBFNYRF2RKJRGQYA2OWPBTNAHMB4FC3NHEMT3LP55FN2V5BMA, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.860377381 (255h39m18.291457512s) [noise=true , address=104.36.82.23:4451 , piece_id=HBATATUY3DLSDRJFHWEN3WMPMBPQDNJFNYYN7HG2BIMZEUXNCEMA, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.902524857 (255h39m18.333604988s) [noise=true , address=77.90.31.21:4902 , piece_id=5G7ESRY3V7NIFGMGBBWBPFDWI7LNKSABDB7XWNAXNHSNMJOTDFEQ, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.903870151 (255h39m18.334950292s) [noise=true , address=104.36.82.60:4345 , piece_id=WAFZ5QVCJOQ65CDGQTUCEG5SHA3E4MXRYIA4RN5ILOFSZV2Q53GA, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.945073361 (255h39m18.376153492s) [noise=true , address=77.90.31.14:4665 , piece_id=XRRH4NWFGVB3TSZTMVQNWXLGPDZX7M4NGVFZEGUUQGBEXE2CAJ3A, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.945099120 (255h39m18.376179241s) [seg_pos={0 0}, upload=265857]: Segment reached optimal threshold of 14 pieces.
Aug 19 09:05:23.945271399 (255h39m18.37635153s) [noise=true , address=104.36.82.60:4355 , piece_id=MYLLXIEJU4GTBCLEQBWT3XE2LEKQZWQS7DMCP47I4EJ4XUUYCZZA, seg_pos={0 0}, upload=265857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eA7ZLTkgGyCRsnQSEC8oYM3y9oeB5MQ4FUueJNMb4FLZueNv2): protocol: expected piece hash; context canceled; EOF
Aug 19 09:05:23.945357034 (255h39m18.376437165s) [noise=true , address=79.127.219.38:4023 , piece_id=FMLGKM37SQTJUVJFWNPF2N32CNDF3D4M2YGPMTQT73UPKBLLKBIA, seg_pos={0 0}, upload=265857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eznpLbftyLUaT3C6P8AvJHZ753784rW4JQ84pv4Z847eVH4Qn): protocol: write tcp 188.166.225.170:43272->79.127.219.38:4023: use of closed network connection; write tcp 188.166.225.170:43272->79.127.219.38:4023: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43272->79.127.219.38:4023: use of closed network connection
Aug 19 09:05:23.945383054 (255h39m18.376463185s) [noise=true , address=104.36.82.13:4220 , piece_id=B4LUPTDK367WY4SZBP7DFQFY3YARY3OHVU3OKDURATIUA2YC6ZDA, seg_pos={0 0}, upload=265857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6): protocol: expected piece hash; context canceled; EOF
Aug 19 09:05:23.945437428 (255h39m18.376517559s) [noise=true , address=77.90.31.16:4755 , piece_id=AUGTCHWTIH3UX4JIFDNSR7LWBZ3UVWOIWMY2FKMTKGFSL27KV4IQ, seg_pos={0 0}, upload=265857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF
Aug 19 09:05:23.945495599 (255h39m18.37657573s) [seg_pos={0 0}, upload=265857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 09:05:23.945577867 (255h39m18.376657998s) [upload=265857]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 09:05:23.945582405 (255h39m18.376662536s) [upload=265857]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 09:05:24.229584741 (255h39m18.660664872s) [upload=265857]: Done uploading segments...
Aug 19 09:05:24.229603748 (255h39m18.660683879s) [upload=265857]: Upload finished. err: <nil>
Duration: 5.683437862s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.......................X....................................] duration:
5.835116372s
FAIL (2025-08-19 09:05:27 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.835155096s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [......X.........X............X......X......X.........X.....X] duration:
4.156141766s
FAIL (2025-08-19 09:05:24 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 19 09:05:21.386438602 (255h39m15.817518773s) [upload=265857]: Starting upload
Aug 19 09:05:21.386559594 (255h39m15.817639745s) [upload=265857]: Done starting upload
Aug 19 09:05:21.386679683 (255h39m15.817759844s) [upload=265857]: Uploading segments...
Aug 19 09:05:21.386995678 (255h39m15.818075829s) [upload=265857]: Got next segment. Inline: false
Aug 19 09:05:21.387047998 (255h39m15.818128159s) [upload=265857]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 19 09:05:21.387055593 (255h39m15.818135764s) [upload=265857]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 19 09:05:21.839112567 (255h39m16.270192698s) [seg_pos={0 0}, upload=265857]: Begin upload segment...
Aug 19 09:05:21.839163405 (255h39m16.270243536s) [seg_pos={0 0}, upload=265857]: Done begin upload segment.
Aug 19 09:05:21.839195306 (255h39m16.270275437s) [noise=true , address=79.127.220.101:4041 , piece_id=AY4RMLD4FDEHVLR4CQRWU525U4Y5UYNCJYA4AYY5ZC6MSOK5H64Q, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.839204955 (255h39m16.270285096s) [noise=true , address=45.91.116.7:4021 , piece_id=FL2LFAFVWHUMWUXBUHLG5GNE3JXSFNW66DLMCELFBGSLS2GONKKQ, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.839572277 (255h39m16.270652398s) [noise=true , address=104.36.82.23:4451 , piece_id=HBATATUY3DLSDRJFHWEN3WMPMBPQDNJFNYYN7HG2BIMZEUXNCEMA, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.839591324 (255h39m16.270671455s) [noise=true , address=45.91.116.5:4327 , piece_id=FPD5MNHTRL52KEKQSHI5MZR42ZBMTNTAYLBZMA7GZCV22SDYDHMA, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.839913881 (255h39m16.270994012s) [noise=true , address=79.127.201.215:4358 , piece_id=4QD4KQTWTBIVSPUU6IXBZXEODOLHERQOWGFO5LOMCLIFZLPKM5VA, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.840186824 (255h39m16.271266955s) [noise=true , address=77.90.31.16:4755 , piece_id=AUGTCHWTIH3UX4JIFDNSR7LWBZ3UVWOIWMY2FKMTKGFSL27KV4IQ, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.840494562 (255h39m16.271574693s) [noise=true , address=77.90.31.14:4665 , piece_id=XRRH4NWFGVB3TSZTMVQNWXLGPDZX7M4NGVFZEGUUQGBEXE2CAJ3A, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.840759619 (255h39m16.27183975s) [noise=true , address=45.91.116.11:4127 , piece_id=CQ2HIBJ5WQKS5GUH75YQIVEMRX2UAB2NH5SJ3L4XDTWSBYOEK6XQ, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.840996422 (255h39m16.272076543s) [noise=true , address=104.36.82.60:4355 , piece_id=MYLLXIEJU4GTBCLEQBWT3XE2LEKQZWQS7DMCP47I4EJ4XUUYCZZA, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.841206204 (255h39m16.272286325s) [noise=true , address=77.90.31.19:4863 , piece_id=DNAB3QDGD6MVNC5B7ATB5A2ANQNQQGN3OG7MS6Y4Q5LDFILEGJYA, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.841449870 (255h39m16.272529991s) [noise=true , address=77.90.31.21:4902 , piece_id=5G7ESRY3V7NIFGMGBBWBPFDWI7LNKSABDB7XWNAXNHSNMJOTDFEQ, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.841647629 (255h39m16.27272776s) [noise=true , address=79.127.219.38:4023 , piece_id=FMLGKM37SQTJUVJFWNPF2N32CNDF3D4M2YGPMTQT73UPKBLLKBIA, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.841882698 (255h39m16.272962829s) [noise=true , address=104.36.82.13:4220 , piece_id=B4LUPTDK367WY4SZBP7DFQFY3YARY3OHVU3OKDURATIUA2YC6ZDA, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.842073643 (255h39m16.273153774s) [noise=true , address=79.127.201.215:4347 , piece_id=IO3QJ6SBXLTUIGKWAK32OFN2UPJOOKYUMFP3VIBHGKM67BLJ76DQ, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.842278255 (255h39m16.273358386s) [noise=true , address=104.36.82.60:4345 , piece_id=WAFZ5QVCJOQ65CDGQTUCEG5SHA3E4MXRYIA4RN5ILOFSZV2Q53GA, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.842468028 (255h39m16.273548159s) [noise=true , address=45.91.116.13:4163 , piece_id=EUHVJKQCBFG4ZGWTADKIKUA6HTWMGJNKMACKKZW6O7TKAI47IOMQ, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.844254927 (255h39m16.275335058s) [noise=true , address=79.127.219.47:4050 , piece_id=3J5VP45UI2E2NBADG6GZO6XAIBZODLEDCBTTR6WRE5T6H74HD24A, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:21.853147723 (255h39m16.284227865s) [noise=true , address=77.90.31.11:4575 , piece_id=X3JWBFNYRF2RKJRGQYA2OWPBTNAHMB4FC3NHEMT3LP55FN2V5BMA, seg_pos={0 0}, upload=265857]: Uploading piece...
Aug 19 09:05:23.294292552 (255h39m17.725372693s) [upload=265857]: Next returned nil segment
Aug 19 09:05:23.294311959 (255h39m17.72539209s) [upload=265857]: Waiting for error group managing segments...
Aug 19 09:05:23.684512468 (255h39m18.115592599s) [noise=true , address=79.127.220.101:4041 , piece_id=AY4RMLD4FDEHVLR4CQRWU525U4Y5UYNCJYA4AYY5ZC6MSOK5H64Q, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.744831714 (255h39m18.175911845s) [noise=true , address=45.91.116.5:4327 , piece_id=FPD5MNHTRL52KEKQSHI5MZR42ZBMTNTAYLBZMA7GZCV22SDYDHMA, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.778764021 (255h39m18.209844152s) [noise=true , address=45.91.116.11:4127 , piece_id=CQ2HIBJ5WQKS5GUH75YQIVEMRX2UAB2NH5SJ3L4XDTWSBYOEK6XQ, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.803306191 (255h39m18.234386322s) [noise=true , address=79.127.219.47:4050 , piece_id=3J5VP45UI2E2NBADG6GZO6XAIBZODLEDCBTTR6WRE5T6H74HD24A, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.817327660 (255h39m18.248407791s) [noise=true , address=79.127.201.215:4347 , piece_id=IO3QJ6SBXLTUIGKWAK32OFN2UPJOOKYUMFP3VIBHGKM67BLJ76DQ, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.819388343 (255h39m18.250468474s) [noise=true , address=79.127.201.215:4358 , piece_id=4QD4KQTWTBIVSPUU6IXBZXEODOLHERQOWGFO5LOMCLIFZLPKM5VA, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.825396278 (255h39m18.256476409s) [noise=true , address=45.91.116.13:4163 , piece_id=EUHVJKQCBFG4ZGWTADKIKUA6HTWMGJNKMACKKZW6O7TKAI47IOMQ, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.825697725 (255h39m18.256777846s) [noise=true , address=77.90.31.19:4863 , piece_id=DNAB3QDGD6MVNC5B7ATB5A2ANQNQQGN3OG7MS6Y4Q5LDFILEGJYA, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.833275474 (255h39m18.264355615s) [noise=true , address=45.91.116.7:4021 , piece_id=FL2LFAFVWHUMWUXBUHLG5GNE3JXSFNW66DLMCELFBGSLS2GONKKQ, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.839237001 (255h39m18.270317142s) [noise=true , address=77.90.31.11:4575 , piece_id=X3JWBFNYRF2RKJRGQYA2OWPBTNAHMB4FC3NHEMT3LP55FN2V5BMA, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.860377381 (255h39m18.291457512s) [noise=true , address=104.36.82.23:4451 , piece_id=HBATATUY3DLSDRJFHWEN3WMPMBPQDNJFNYYN7HG2BIMZEUXNCEMA, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.902524857 (255h39m18.333604988s) [noise=true , address=77.90.31.21:4902 , piece_id=5G7ESRY3V7NIFGMGBBWBPFDWI7LNKSABDB7XWNAXNHSNMJOTDFEQ, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.903870151 (255h39m18.334950292s) [noise=true , address=104.36.82.60:4345 , piece_id=WAFZ5QVCJOQ65CDGQTUCEG5SHA3E4MXRYIA4RN5ILOFSZV2Q53GA, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.945073361 (255h39m18.376153492s) [noise=true , address=77.90.31.14:4665 , piece_id=XRRH4NWFGVB3TSZTMVQNWXLGPDZX7M4NGVFZEGUUQGBEXE2CAJ3A, seg_pos={0 0}, upload=265857]: Done uploading piece. err: <nil>
Aug 19 09:05:23.945099120 (255h39m18.376179241s) [seg_pos={0 0}, upload=265857]: Segment reached optimal threshold of 14 pieces.
Aug 19 09:05:23.945271399 (255h39m18.37635153s) [noise=true , address=104.36.82.60:4355 , piece_id=MYLLXIEJU4GTBCLEQBWT3XE2LEKQZWQS7DMCP47I4EJ4XUUYCZZA, seg_pos={0 0}, upload=265857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12eA7ZLTkgGyCRsnQSEC8oYM3y9oeB5MQ4FUueJNMb4FLZueNv2): protocol: expected piece hash; context canceled; EOF
Aug 19 09:05:23.945357034 (255h39m18.376437165s) [noise=true , address=79.127.219.38:4023 , piece_id=FMLGKM37SQTJUVJFWNPF2N32CNDF3D4M2YGPMTQT73UPKBLLKBIA, seg_pos={0 0}, upload=265857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1eznpLbftyLUaT3C6P8AvJHZ753784rW4JQ84pv4Z847eVH4Qn): protocol: write tcp 188.166.225.170:43272->79.127.219.38:4023: use of closed network connection; write tcp 188.166.225.170:43272->79.127.219.38:4023: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:43272->79.127.219.38:4023: use of closed network connection
Aug 19 09:05:23.945383054 (255h39m18.376463185s) [noise=true , address=104.36.82.13:4220 , piece_id=B4LUPTDK367WY4SZBP7DFQFY3YARY3OHVU3OKDURATIUA2YC6ZDA, seg_pos={0 0}, upload=265857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1AjQmw3H58hTwr2389cmMcwy1gBavBrZB8AWB1gqfoFRUkCpH6): protocol: expected piece hash; context canceled; EOF
Aug 19 09:05:23.945437428 (255h39m18.376517559s) [noise=true , address=77.90.31.16:4755 , piece_id=AUGTCHWTIH3UX4JIFDNSR7LWBZ3UVWOIWMY2FKMTKGFSL27KV4IQ, seg_pos={0 0}, upload=265857]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JsnHuhQhM4rWLTLEuSSHLNE24m7tSW9qMSf48j7yMrAVPWVyV): protocol: expected piece hash; context canceled; EOF
Aug 19 09:05:23.945495599 (255h39m18.37657573s) [seg_pos={0 0}, upload=265857]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 19 09:05:23.945577867 (255h39m18.376657998s) [upload=265857]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 19 09:05:23.945582405 (255h39m18.376662536s) [upload=265857]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 19 09:05:24.229584741 (255h39m18.660664872s) [upload=265857]: Done uploading segments...
Aug 19 09:05:24.229603748 (255h39m18.660683879s) [upload=265857]: Upload finished. err: <nil>
Duration: 4.156165731s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
6.114420733s
FAIL (2025-08-19 09:05:16 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 6.114449577s
core
uplink
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [......................................................X.....] duration:
6.423455955s
FAIL (2025-08-19 09:05:08 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 207.211.208.129:443: i/o timeout
Duration: 6.423486274s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.......X.........X............X......X......X.........X.....] duration:
5.733605706s
FAIL (2025-08-19 09:05:02 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:01:47.208825624 (255h35m41.639905755s) [upload=265791]: Starting upload Aug 19 09:01:47.208906088 (255h35m41.639986219s) [upload=265791]: Done starting upload Aug 19 09:01:47.208995539 (255h35m41.64007567s) [upload=265791]: Uploading segments... Aug 19 09:01:47.209081964 (255h35m41.640162085s) [upload=265791]: Got next segment. Inline: false Aug 19 09:01:47.209106100 (255h35m41.640186232s) [upload=265791]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:01:47.209109978 (255h35m41.640190099s) [upload=265791]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:01:47.443409801 (255h35m41.874489942s) [upload=265791]: Next segment err: metaclient: Too Many Requests Aug 19 09:01:47.443430351 (255h35m41.874510482s) [upload=265791]: Done uploading segments... Aug 19 09:01:47.443441473 (255h35m41.874521604s) [upload=265791]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.733631254s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
7.88848825s
FAIL (2025-08-19 09:04:54 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 7.888516695s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [........X.........X............X......X......X.........X....] duration:
5.797514689s
FAIL (2025-08-19 09:04:37 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:01:47.208825624 (255h35m41.639905755s) [upload=265791]: Starting upload Aug 19 09:01:47.208906088 (255h35m41.639986219s) [upload=265791]: Done starting upload Aug 19 09:01:47.208995539 (255h35m41.64007567s) [upload=265791]: Uploading segments... Aug 19 09:01:47.209081964 (255h35m41.640162085s) [upload=265791]: Got next segment. Inline: false Aug 19 09:01:47.209106100 (255h35m41.640186232s) [upload=265791]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:01:47.209109978 (255h35m41.640190099s) [upload=265791]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:01:47.443409801 (255h35m41.874489942s) [upload=265791]: Next segment err: metaclient: Too Many Requests Aug 19 09:01:47.443430351 (255h35m41.874510482s) [upload=265791]: Done uploading segments... Aug 19 09:01:47.443441473 (255h35m41.874521604s) [upload=265791]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.797544407s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
5.674303175s
FAIL (2025-08-19 09:04:27 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.674325828s
core
uplink
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [........................X...................................] duration:
5.864399108s
FAIL (2025-08-19 09:04:19 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.8644208s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.........................X..................................] duration:
6.105357201s
FAIL (2025-08-19 09:04:01 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.10537745s
edge
gateway
us-select-1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.......................................................X....] duration:
6.451121993s
FAIL (2025-08-19 09:03:57 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 207.211.208.129:443: i/o timeout
Duration: 6.451144215s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
5.580403837s
FAIL (2025-08-19 09:03:43 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.580430727s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.........X.........X............X......X......X.........X...] duration:
6.639660977s
FAIL (2025-08-19 09:03:27 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:01:47.208825624 (255h35m41.639905755s) [upload=265791]: Starting upload Aug 19 09:01:47.208906088 (255h35m41.639986219s) [upload=265791]: Done starting upload Aug 19 09:01:47.208995539 (255h35m41.64007567s) [upload=265791]: Uploading segments... Aug 19 09:01:47.209081964 (255h35m41.640162085s) [upload=265791]: Got next segment. Inline: false Aug 19 09:01:47.209106100 (255h35m41.640186232s) [upload=265791]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:01:47.209109978 (255h35m41.640190099s) [upload=265791]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:01:47.443409801 (255h35m41.874489942s) [upload=265791]: Next segment err: metaclient: Too Many Requests Aug 19 09:01:47.443430351 (255h35m41.874510482s) [upload=265791]: Done uploading segments... Aug 19 09:01:47.443441473 (255h35m41.874521604s) [upload=265791]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.639684553s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [........................................................X...] duration:
6.547495349s
FAIL (2025-08-19 09:03:01 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 207.211.208.129:443: i/o timeout
Duration: 6.547535495s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..........................X.................................] duration:
6.102379703s
FAIL (2025-08-19 09:02:54 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.102943251s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
8.752718546s
FAIL (2025-08-19 09:02:47 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 8.752744755s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..........X.........X............X......X......X.........X..] duration:
6.684722951s
FAIL (2025-08-19 09:02:40 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:01:47.208825624 (255h35m41.639905755s) [upload=265791]: Starting upload Aug 19 09:01:47.208906088 (255h35m41.639986219s) [upload=265791]: Done starting upload Aug 19 09:01:47.208995539 (255h35m41.64007567s) [upload=265791]: Uploading segments... Aug 19 09:01:47.209081964 (255h35m41.640162085s) [upload=265791]: Got next segment. Inline: false Aug 19 09:01:47.209106100 (255h35m41.640186232s) [upload=265791]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:01:47.209109978 (255h35m41.640190099s) [upload=265791]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:01:47.443409801 (255h35m41.874489942s) [upload=265791]: Next segment err: metaclient: Too Many Requests Aug 19 09:01:47.443430351 (255h35m41.874510482s) [upload=265791]: Done uploading segments... Aug 19 09:01:47.443441473 (255h35m41.874521604s) [upload=265791]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.684768399s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...........X.........X............X......X......X.........X.] duration:
5.679309295s
FAIL (2025-08-19 09:02:20 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:01:47.208825624 (255h35m41.639905755s) [upload=265791]: Starting upload Aug 19 09:01:47.208906088 (255h35m41.639986219s) [upload=265791]: Done starting upload Aug 19 09:01:47.208995539 (255h35m41.64007567s) [upload=265791]: Uploading segments... Aug 19 09:01:47.209081964 (255h35m41.640162085s) [upload=265791]: Got next segment. Inline: false Aug 19 09:01:47.209106100 (255h35m41.640186232s) [upload=265791]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:01:47.209109978 (255h35m41.640190099s) [upload=265791]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:01:47.443409801 (255h35m41.874489942s) [upload=265791]: Next segment err: metaclient: Too Many Requests Aug 19 09:01:47.443430351 (255h35m41.874510482s) [upload=265791]: Done uploading segments... Aug 19 09:01:47.443441473 (255h35m41.874521604s) [upload=265791]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.679334232s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [.........................................................X..] duration:
7.481635223s
FAIL (2025-08-19 09:02:19 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 207.211.208.129:443: i/o timeout
Duration: 7.48167119s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [..........................................................X.] duration:
7.187194639s
FAIL (2025-08-19 09:02:03 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 207.211.208.129:443: i/o timeout
Duration: 7.187207784s
core
uplink
us-select-1
us1-placement-20
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
5.713746652s
FAIL (2025-08-19 09:02:01 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.713779156s
core
uplink
us1
|
checkers.Gateway{"https://s3.de2eae4e.storjapi.io/", AuthURL: "https://auth.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us1.placement_20)antiblip:
1 out of 60 is failed (threshold=3) [...........................................................X] duration:
30.000474377s
FAIL (2025-08-19 09:01:56 UTC)
orbiter warning: Post "https://auth.storjshare.io/v1/access": dial tcp 207.211.208.129:443: i/o timeout
Duration: 30.000546305s
core
uplink
us-select-1
us1-placement-20
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...........................X................................] duration:
6.15127953s
FAIL (2025-08-19 09:01:50 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.151466568s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [............X.........X............X......X......X.........X] duration:
962.344159ms
FAIL (2025-08-19 09:01:47 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 09:01:47.208825624 (255h35m41.639905755s) [upload=265791]: Starting upload Aug 19 09:01:47.208906088 (255h35m41.639986219s) [upload=265791]: Done starting upload Aug 19 09:01:47.208995539 (255h35m41.64007567s) [upload=265791]: Uploading segments... Aug 19 09:01:47.209081964 (255h35m41.640162085s) [upload=265791]: Got next segment. Inline: false Aug 19 09:01:47.209106100 (255h35m41.640186232s) [upload=265791]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 09:01:47.209109978 (255h35m41.640190099s) [upload=265791]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 09:01:47.443409801 (255h35m41.874489942s) [upload=265791]: Next segment err: metaclient: Too Many Requests Aug 19 09:01:47.443430351 (255h35m41.874510482s) [upload=265791]: Done uploading segments... Aug 19 09:01:47.443441473 (255h35m41.874521604s) [upload=265791]: Upload finished. err: metaclient: Too Many Requests
Duration: 962.364076ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.............X.........X............X......X......X.........] duration:
8.056008376s
FAIL (2025-08-19 09:01:14 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 08:54:27.154617895 (255h28m21.585698026s) [upload=265665]: Starting upload Aug 19 08:54:27.154677290 (255h28m21.585757421s) [upload=265665]: Done starting upload Aug 19 08:54:27.154825543 (255h28m21.585905674s) [upload=265665]: Uploading segments... Aug 19 08:54:27.154969548 (255h28m21.586049679s) [upload=265665]: Got next segment. Inline: false Aug 19 08:54:27.155015116 (255h28m21.586095247s) [upload=265665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 08:54:27.155021257 (255h28m21.586101388s) [upload=265665]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 08:54:27.371785709 (255h28m21.80286584s) [upload=265665]: Next segment err: metaclient: Too Many Requests Aug 19 08:54:27.371806920 (255h28m21.802887051s) [upload=265665]: Done uploading segments... Aug 19 08:54:27.371822129 (255h28m21.80290226s) [upload=265665]: Upload finished. err: metaclient: Too Many Requests
Duration: 8.056030387s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
5.743472574s
FAIL (2025-08-19 09:00:55 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.743499234s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [X.............X.........X............X......X......X........] duration:
5.596786s
FAIL (2025-08-19 09:00:39 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 08:54:27.154617895 (255h28m21.585698026s) [upload=265665]: Starting upload Aug 19 08:54:27.154677290 (255h28m21.585757421s) [upload=265665]: Done starting upload Aug 19 08:54:27.154825543 (255h28m21.585905674s) [upload=265665]: Uploading segments... Aug 19 08:54:27.154969548 (255h28m21.586049679s) [upload=265665]: Got next segment. Inline: false Aug 19 08:54:27.155015116 (255h28m21.586095247s) [upload=265665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 08:54:27.155021257 (255h28m21.586101388s) [upload=265665]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 08:54:27.371785709 (255h28m21.80286584s) [upload=265665]: Next segment err: metaclient: Too Many Requests Aug 19 08:54:27.371806920 (255h28m21.802887051s) [upload=265665]: Done uploading segments... Aug 19 08:54:27.371822129 (255h28m21.80290226s) [upload=265665]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.596809144s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [............................X...............................] duration:
6.131411112s
FAIL (2025-08-19 09:00:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.131435869s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.X.............X.........X............X......X......X.......] duration:
5.828278939s
FAIL (2025-08-19 09:00:21 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 08:54:27.154617895 (255h28m21.585698026s) [upload=265665]: Starting upload Aug 19 08:54:27.154677290 (255h28m21.585757421s) [upload=265665]: Done starting upload Aug 19 08:54:27.154825543 (255h28m21.585905674s) [upload=265665]: Uploading segments... Aug 19 08:54:27.154969548 (255h28m21.586049679s) [upload=265665]: Got next segment. Inline: false Aug 19 08:54:27.155015116 (255h28m21.586095247s) [upload=265665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 08:54:27.155021257 (255h28m21.586101388s) [upload=265665]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 08:54:27.371785709 (255h28m21.80286584s) [upload=265665]: Next segment err: metaclient: Too Many Requests Aug 19 08:54:27.371806920 (255h28m21.802887051s) [upload=265665]: Done uploading segments... Aug 19 08:54:27.371822129 (255h28m21.80290226s) [upload=265665]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.828312473s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
5.667604277s
FAIL (2025-08-19 09:00:15 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.667651968s
core
uplink
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.............................X..............................] duration:
6.933866764s
FAIL (2025-08-19 09:00:11 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.933895607s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..X.............X.........X............X......X......X......] duration:
6.176153301s
FAIL (2025-08-19 08:59:46 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 08:54:27.154617895 (255h28m21.585698026s) [upload=265665]: Starting upload Aug 19 08:54:27.154677290 (255h28m21.585757421s) [upload=265665]: Done starting upload Aug 19 08:54:27.154825543 (255h28m21.585905674s) [upload=265665]: Uploading segments... Aug 19 08:54:27.154969548 (255h28m21.586049679s) [upload=265665]: Got next segment. Inline: false Aug 19 08:54:27.155015116 (255h28m21.586095247s) [upload=265665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 08:54:27.155021257 (255h28m21.586101388s) [upload=265665]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 08:54:27.371785709 (255h28m21.80286584s) [upload=265665]: Next segment err: metaclient: Too Many Requests Aug 19 08:54:27.371806920 (255h28m21.802887051s) [upload=265665]: Done uploading segments... Aug 19 08:54:27.371822129 (255h28m21.80290226s) [upload=265665]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.176177579s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [X...........................................................] duration:
1.841774146s
FAIL (2025-08-19 08:59:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 08:12:21.770696128 (254h46m16.201776259s) [upload=264940]: Starting upload Aug 19 08:12:21.770757987 (254h46m16.201838108s) [upload=264940]: Done starting upload Aug 19 08:12:21.770820176 (254h46m16.201900307s) [upload=264940]: Uploading segments... Aug 19 08:12:21.770863408 (254h46m16.201943539s) [upload=264940]: Got next segment. Inline: true Aug 19 08:12:21.770866965 (254h46m16.201947086s) [upload=264940]: Waiting for error group managing segments... Aug 19 08:12:21.770897073 (254h46m16.201977194s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 08:12:21.770900720 (254h46m16.201980851s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 08:12:21.770903125 (254h46m16.201983246s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 08:12:21.983071451 (254h46m16.414151582s) [upload=264940]: Done uploading segments... Aug 19 08:12:21.983087682 (254h46m16.414167814s) [upload=264940]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.841821358s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..............................X.............................] duration:
5.828770076s
FAIL (2025-08-19 08:59:11 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 5.828794013s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
1 out of 60 is failed (threshold=3) [.X..........................................................] duration:
1.835124755s
FAIL (2025-08-19 08:59:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 08:12:21.770696128 (254h46m16.201776259s) [upload=264940]: Starting upload Aug 19 08:12:21.770757987 (254h46m16.201838108s) [upload=264940]: Done starting upload Aug 19 08:12:21.770820176 (254h46m16.201900307s) [upload=264940]: Uploading segments... Aug 19 08:12:21.770863408 (254h46m16.201943539s) [upload=264940]: Got next segment. Inline: true Aug 19 08:12:21.770866965 (254h46m16.201947086s) [upload=264940]: Waiting for error group managing segments... Aug 19 08:12:21.770897073 (254h46m16.201977194s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 08:12:21.770900720 (254h46m16.201980851s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 08:12:21.770903125 (254h46m16.201983246s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 08:12:21.983071451 (254h46m16.414151582s) [upload=264940]: Done uploading segments... Aug 19 08:12:21.983087682 (254h46m16.414167814s) [upload=264940]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.835153731s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [.................................X..........................] duration:
6.665675605s
FAIL (2025-08-19 08:59:01 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 6.665709118s
core
uplink
us1
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...............................X............................] duration:
6.118475324s
FAIL (2025-08-19 08:58:51 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.118495953s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...X.............X.........X............X......X......X.....] duration:
5.641078164s
FAIL (2025-08-19 08:58:50 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 08:54:27.154617895 (255h28m21.585698026s) [upload=265665]: Starting upload Aug 19 08:54:27.154677290 (255h28m21.585757421s) [upload=265665]: Done starting upload Aug 19 08:54:27.154825543 (255h28m21.585905674s) [upload=265665]: Uploading segments... Aug 19 08:54:27.154969548 (255h28m21.586049679s) [upload=265665]: Got next segment. Inline: false Aug 19 08:54:27.155015116 (255h28m21.586095247s) [upload=265665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 08:54:27.155021257 (255h28m21.586101388s) [upload=265665]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 08:54:27.371785709 (255h28m21.80286584s) [upload=265665]: Next segment err: metaclient: Too Many Requests Aug 19 08:54:27.371806920 (255h28m21.802887051s) [upload=265665]: Done uploading segments... Aug 19 08:54:27.371822129 (255h28m21.80290226s) [upload=265665]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.641101207s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [X.X.........................................................] duration:
1.814541809s
FAIL (2025-08-19 08:58:23 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 08:12:21.770696128 (254h46m16.201776259s) [upload=264940]: Starting upload Aug 19 08:12:21.770757987 (254h46m16.201838108s) [upload=264940]: Done starting upload Aug 19 08:12:21.770820176 (254h46m16.201900307s) [upload=264940]: Uploading segments... Aug 19 08:12:21.770863408 (254h46m16.201943539s) [upload=264940]: Got next segment. Inline: true Aug 19 08:12:21.770866965 (254h46m16.201947086s) [upload=264940]: Waiting for error group managing segments... Aug 19 08:12:21.770897073 (254h46m16.201977194s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 08:12:21.770900720 (254h46m16.201980851s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 08:12:21.770903125 (254h46m16.201983246s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 08:12:21.983071451 (254h46m16.414151582s) [upload=264940]: Done uploading segments... Aug 19 08:12:21.983087682 (254h46m16.414167814s) [upload=264940]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.814566866s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [..................................X.........................] duration:
6.502332409s
FAIL (2025-08-19 08:58:16 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 6.502357055s
core
uplink
us1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [X...X.............X.........X............X......X......X....] duration:
6.037297421s
FAIL (2025-08-19 08:57:56 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 08:54:27.154617895 (255h28m21.585698026s) [upload=265665]: Starting upload Aug 19 08:54:27.154677290 (255h28m21.585757421s) [upload=265665]: Done starting upload Aug 19 08:54:27.154825543 (255h28m21.585905674s) [upload=265665]: Uploading segments... Aug 19 08:54:27.154969548 (255h28m21.586049679s) [upload=265665]: Got next segment. Inline: false Aug 19 08:54:27.155015116 (255h28m21.586095247s) [upload=265665]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 08:54:27.155021257 (255h28m21.586101388s) [upload=265665]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 19 08:54:27.371785709 (255h28m21.80286584s) [upload=265665]: Next segment err: metaclient: Too Many Requests Aug 19 08:54:27.371806920 (255h28m21.802887051s) [upload=265665]: Done uploading segments... Aug 19 08:54:27.371822129 (255h28m21.80290226s) [upload=265665]: Upload finished. err: metaclient: Too Many Requests
Duration: 6.037325265s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote)antiblip:
1 out of 60 is failed (threshold=3) [................................X...........................] duration:
6.310385056s
FAIL (2025-08-19 08:57:39 UTC)
orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded
Duration: 6.310398982s
edge
gateway
us-select-1
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X.X........................................................] duration:
2.060874319s
FAIL (2025-08-19 08:57:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 08:12:21.770696128 (254h46m16.201776259s) [upload=264940]: Starting upload Aug 19 08:12:21.770757987 (254h46m16.201838108s) [upload=264940]: Done starting upload Aug 19 08:12:21.770820176 (254h46m16.201900307s) [upload=264940]: Uploading segments... Aug 19 08:12:21.770863408 (254h46m16.201943539s) [upload=264940]: Got next segment. Inline: true Aug 19 08:12:21.770866965 (254h46m16.201947086s) [upload=264940]: Waiting for error group managing segments... Aug 19 08:12:21.770897073 (254h46m16.201977194s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 19 08:12:21.770900720 (254h46m16.201980851s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 19 08:12:21.770903125 (254h46m16.201983246s) [upload=264940]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 19 08:12:21.983071451 (254h46m16.414151582s) [upload=264940]: Done uploading segments... Aug 19 08:12:21.983087682 (254h46m16.414167814s) [upload=264940]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.060902542s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)antiblip:
1 out of 60 is failed (threshold=3) [...................................X........................] duration:
5.546281835s
FAIL (2025-08-19 08:57:10 UTC)
orbiter warning: operation: Commit uplink: metaclient: context deadline exceeded
Duration: 5.546307996s
core
uplink
us1
|