Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..........................X.....X............X..............] duration: 5.78333957s FAIL (2025-08-19 05:20:51 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 19 05:09:11.386254861 (251h43m5.817334982s) [upload=261787]: Starting upload Aug 19 05:09:11.386321348 (251h43m5.817401469s) [upload=261787]: Done starting upload Aug 19 05:09:11.386407303 (251h43m5.817487434s) [upload=261787]: Uploading segments... Aug 19 05:09:11.386516612 (251h43m5.817596743s) [upload=261787]: Got next segment. Inline: false Aug 19 05:09:11.386552742 (251h43m5.817632863s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:09:11.386559414 (251h43m5.817639545s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 05:09:11.834890261 (251h43m6.265970392s) [seg_pos={0 0}, upload=261787]: Begin upload segment... Aug 19 05:09:11.834930347 (251h43m6.266010478s) [seg_pos={0 0}, upload=261787]: Done begin upload segment. Aug 19 05:09:11.834974011 (251h43m6.266054142s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835375028 (251h43m6.266455159s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835538070 (251h43m6.266618201s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835705821 (251h43m6.266785952s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835973453 (251h43m6.267053584s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836265933 (251h43m6.267346064s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836276182 (251h43m6.267356313s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836598940 (251h43m6.267679071s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836634258 (251h43m6.267714389s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836912620 (251h43m6.267992751s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837172388 (251h43m6.268252509s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837390996 (251h43m6.268471127s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837598462 (251h43m6.268678593s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837826179 (251h43m6.26890631s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838040359 (251h43m6.26912049s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838241463 (251h43m6.269321594s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838462406 (251h43m6.269542537s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838913720 (251h43m6.269993851s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:13.313230483 (251h43m7.744310624s) [upload=261787]: Next returned nil segment Aug 19 05:09:13.313249379 (251h43m7.74432952s) [upload=261787]: Waiting for error group managing segments... Aug 19 05:09:13.687728957 (251h43m8.118809089s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.709661914 (251h43m8.140742035s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.721922564 (251h43m8.153002695s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.756509633 (251h43m8.187589754s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.789161020 (251h43m8.220241151s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.803244097 (251h43m8.234324218s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.834984259 (251h43m8.26606438s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.842943449 (251h43m8.27402358s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.874788291 (251h43m8.305868422s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.875188526 (251h43m8.306268657s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.883263788 (251h43m8.314343919s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.898508016 (251h43m8.329588148s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.899690921 (251h43m8.330771052s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961706813 (251h43m8.392786934s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961733925 (251h43m8.392814056s) [seg_pos={0 0}, upload=261787]: Segment reached optimal threshold of 14 pieces. Aug 19 05:09:13.961909691 (251h43m8.392989832s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bCw4Dx7aFbxT7TeUKezRzHD4yQWYXXNJVgFfF3FGhnkVVk9Jb): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962008531 (251h43m8.393088662s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hRpjHEvHzBoYqq6DXKC5Z3SPsP4HEZz2tAiuheHkgzzcnsVU2): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962017918 (251h43m8.393098049s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2cXhqd5EWbNPTXem83jQUjYq5ZaGKBidbVCQzxYfR3rWddGR): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962068645 (251h43m8.393148776s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962084104 (251h43m8.393164235s) [seg_pos={0 0}, upload=261787]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 05:09:13.962142396 (251h43m8.393222527s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 05:09:13.962145853 (251h43m8.393225984s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:09:14.249509942 (251h43m8.680590073s) [upload=261787]: Done uploading segments... Aug 19 05:09:14.249531253 (251h43m8.680611384s) [upload=261787]: Upload finished. err: <nil> Duration: 5.783372664s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 4 out of 60 is failed (threshold=3) [..................XX.........................X.............X] duration: 1.350309836s FAIL (2025-08-19 05:20:22 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 05:20:22.069231941 (251h54m16.500312072s) [upload=261974]: Starting upload Aug 19 05:20:22.069283741 (251h54m16.500363872s) [upload=261974]: Done starting upload Aug 19 05:20:22.069353864 (251h54m16.500433995s) [upload=261974]: Uploading segments... Aug 19 05:20:22.069416694 (251h54m16.500496825s) [upload=261974]: Got next segment. Inline: true Aug 19 05:20:22.069422556 (251h54m16.500502687s) [upload=261974]: Waiting for error group managing segments... Aug 19 05:20:22.069459416 (251h54m16.500539537s) [upload=261974]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:20:22.069463564 (251h54m16.500543705s) [upload=261974]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 05:20:22.069466660 (251h54m16.500546801s) [upload=261974]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:20:22.331040090 (251h54m16.762120221s) [upload=261974]: Done uploading segments... Aug 19 05:20:22.331057784 (251h54m16.762137915s) [upload=261974]: Upload finished. err: <nil> Duration:* 1.350377685s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...................XX.........................X.............] duration: 1.821418778s FAIL (2025-08-19 05:20:03 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 05:10:32.899846928 (251h44m27.330927059s) [upload=261809]: Starting upload Aug 19 05:10:32.899910309 (251h44m27.33099044s) [upload=261809]: Done starting upload Aug 19 05:10:32.899974994 (251h44m27.331055125s) [upload=261809]: Uploading segments... Aug 19 05:10:32.900021041 (251h44m27.331101192s) [upload=261809]: Got next segment. Inline: true Aug 19 05:10:32.900027745 (251h44m27.331107866s) [upload=261809]: Waiting for error group managing segments... Aug 19 05:10:32.900070356 (251h44m27.331150487s) [upload=261809]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:10:32.900075816 (251h44m27.331155947s) [upload=261809]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 05:10:32.900078782 (251h44m27.331158913s) [upload=261809]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:10:33.182135206 (251h44m27.613215337s) [upload=261809]: Done uploading segments... Aug 19 05:10:33.182159463 (251h44m27.613239624s) [upload=261809]: Upload finished. err: <nil> Duration:* 1.821448195s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...........................X.....X............X.............] duration: 5.716246262s FAIL (2025-08-19 05:19:46 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 19 05:09:11.386254861 (251h43m5.817334982s) [upload=261787]: Starting upload Aug 19 05:09:11.386321348 (251h43m5.817401469s) [upload=261787]: Done starting upload Aug 19 05:09:11.386407303 (251h43m5.817487434s) [upload=261787]: Uploading segments... Aug 19 05:09:11.386516612 (251h43m5.817596743s) [upload=261787]: Got next segment. Inline: false Aug 19 05:09:11.386552742 (251h43m5.817632863s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:09:11.386559414 (251h43m5.817639545s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 05:09:11.834890261 (251h43m6.265970392s) [seg_pos={0 0}, upload=261787]: Begin upload segment... Aug 19 05:09:11.834930347 (251h43m6.266010478s) [seg_pos={0 0}, upload=261787]: Done begin upload segment. Aug 19 05:09:11.834974011 (251h43m6.266054142s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835375028 (251h43m6.266455159s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835538070 (251h43m6.266618201s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835705821 (251h43m6.266785952s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835973453 (251h43m6.267053584s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836265933 (251h43m6.267346064s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836276182 (251h43m6.267356313s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836598940 (251h43m6.267679071s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836634258 (251h43m6.267714389s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836912620 (251h43m6.267992751s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837172388 (251h43m6.268252509s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837390996 (251h43m6.268471127s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837598462 (251h43m6.268678593s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837826179 (251h43m6.26890631s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838040359 (251h43m6.26912049s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838241463 (251h43m6.269321594s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838462406 (251h43m6.269542537s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838913720 (251h43m6.269993851s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:13.313230483 (251h43m7.744310624s) [upload=261787]: Next returned nil segment Aug 19 05:09:13.313249379 (251h43m7.74432952s) [upload=261787]: Waiting for error group managing segments... Aug 19 05:09:13.687728957 (251h43m8.118809089s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.709661914 (251h43m8.140742035s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.721922564 (251h43m8.153002695s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.756509633 (251h43m8.187589754s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.789161020 (251h43m8.220241151s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.803244097 (251h43m8.234324218s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.834984259 (251h43m8.26606438s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.842943449 (251h43m8.27402358s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.874788291 (251h43m8.305868422s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.875188526 (251h43m8.306268657s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.883263788 (251h43m8.314343919s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.898508016 (251h43m8.329588148s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.899690921 (251h43m8.330771052s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961706813 (251h43m8.392786934s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961733925 (251h43m8.392814056s) [seg_pos={0 0}, upload=261787]: Segment reached optimal threshold of 14 pieces. Aug 19 05:09:13.961909691 (251h43m8.392989832s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bCw4Dx7aFbxT7TeUKezRzHD4yQWYXXNJVgFfF3FGhnkVVk9Jb): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962008531 (251h43m8.393088662s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hRpjHEvHzBoYqq6DXKC5Z3SPsP4HEZz2tAiuheHkgzzcnsVU2): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962017918 (251h43m8.393098049s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2cXhqd5EWbNPTXem83jQUjYq5ZaGKBidbVCQzxYfR3rWddGR): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962068645 (251h43m8.393148776s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962084104 (251h43m8.393164235s) [seg_pos={0 0}, upload=261787]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 05:09:13.962142396 (251h43m8.393222527s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 05:09:13.962145853 (251h43m8.393225984s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:09:14.249509942 (251h43m8.680590073s) [upload=261787]: Done uploading segments... Aug 19 05:09:14.249531253 (251h43m8.680611384s) [upload=261787]: Upload finished. err: <nil> Duration: 5.716275299s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [....................XX.........................X............] duration: 1.968464035s FAIL (2025-08-19 05:19:12 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 05:10:32.899846928 (251h44m27.330927059s) [upload=261809]: Starting upload Aug 19 05:10:32.899910309 (251h44m27.33099044s) [upload=261809]: Done starting upload Aug 19 05:10:32.899974994 (251h44m27.331055125s) [upload=261809]: Uploading segments... Aug 19 05:10:32.900021041 (251h44m27.331101192s) [upload=261809]: Got next segment. Inline: true Aug 19 05:10:32.900027745 (251h44m27.331107866s) [upload=261809]: Waiting for error group managing segments... Aug 19 05:10:32.900070356 (251h44m27.331150487s) [upload=261809]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:10:32.900075816 (251h44m27.331155947s) [upload=261809]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 05:10:32.900078782 (251h44m27.331158913s) [upload=261809]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:10:33.182135206 (251h44m27.613215337s) [upload=261809]: Done uploading segments... Aug 19 05:10:33.182159463 (251h44m27.613239624s) [upload=261809]: Upload finished. err: <nil> Duration:* 1.968491938s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [............................X.....X............X............] duration: 5.901693982s FAIL (2025-08-19 05:18:46 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 19 05:09:11.386254861 (251h43m5.817334982s) [upload=261787]: Starting upload Aug 19 05:09:11.386321348 (251h43m5.817401469s) [upload=261787]: Done starting upload Aug 19 05:09:11.386407303 (251h43m5.817487434s) [upload=261787]: Uploading segments... Aug 19 05:09:11.386516612 (251h43m5.817596743s) [upload=261787]: Got next segment. Inline: false Aug 19 05:09:11.386552742 (251h43m5.817632863s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:09:11.386559414 (251h43m5.817639545s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 05:09:11.834890261 (251h43m6.265970392s) [seg_pos={0 0}, upload=261787]: Begin upload segment... Aug 19 05:09:11.834930347 (251h43m6.266010478s) [seg_pos={0 0}, upload=261787]: Done begin upload segment. Aug 19 05:09:11.834974011 (251h43m6.266054142s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835375028 (251h43m6.266455159s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835538070 (251h43m6.266618201s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835705821 (251h43m6.266785952s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835973453 (251h43m6.267053584s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836265933 (251h43m6.267346064s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836276182 (251h43m6.267356313s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836598940 (251h43m6.267679071s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836634258 (251h43m6.267714389s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836912620 (251h43m6.267992751s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837172388 (251h43m6.268252509s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837390996 (251h43m6.268471127s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837598462 (251h43m6.268678593s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837826179 (251h43m6.26890631s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838040359 (251h43m6.26912049s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838241463 (251h43m6.269321594s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838462406 (251h43m6.269542537s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838913720 (251h43m6.269993851s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:13.313230483 (251h43m7.744310624s) [upload=261787]: Next returned nil segment Aug 19 05:09:13.313249379 (251h43m7.74432952s) [upload=261787]: Waiting for error group managing segments... Aug 19 05:09:13.687728957 (251h43m8.118809089s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.709661914 (251h43m8.140742035s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.721922564 (251h43m8.153002695s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.756509633 (251h43m8.187589754s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.789161020 (251h43m8.220241151s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.803244097 (251h43m8.234324218s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.834984259 (251h43m8.26606438s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.842943449 (251h43m8.27402358s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.874788291 (251h43m8.305868422s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.875188526 (251h43m8.306268657s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.883263788 (251h43m8.314343919s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.898508016 (251h43m8.329588148s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.899690921 (251h43m8.330771052s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961706813 (251h43m8.392786934s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961733925 (251h43m8.392814056s) [seg_pos={0 0}, upload=261787]: Segment reached optimal threshold of 14 pieces. Aug 19 05:09:13.961909691 (251h43m8.392989832s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bCw4Dx7aFbxT7TeUKezRzHD4yQWYXXNJVgFfF3FGhnkVVk9Jb): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962008531 (251h43m8.393088662s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hRpjHEvHzBoYqq6DXKC5Z3SPsP4HEZz2tAiuheHkgzzcnsVU2): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962017918 (251h43m8.393098049s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2cXhqd5EWbNPTXem83jQUjYq5ZaGKBidbVCQzxYfR3rWddGR): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962068645 (251h43m8.393148776s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962084104 (251h43m8.393164235s) [seg_pos={0 0}, upload=261787]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 05:09:13.962142396 (251h43m8.393222527s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 05:09:13.962145853 (251h43m8.393225984s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:09:14.249509942 (251h43m8.680590073s) [upload=261787]: Done uploading segments... Aug 19 05:09:14.249531253 (251h43m8.680611384s) [upload=261787]: Upload finished. err: <nil> Duration: 5.901718558s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.....................XX.........................X...........] duration: 2.05104016s FAIL (2025-08-19 05:18:22 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 05:10:32.899846928 (251h44m27.330927059s) [upload=261809]: Starting upload Aug 19 05:10:32.899910309 (251h44m27.33099044s) [upload=261809]: Done starting upload Aug 19 05:10:32.899974994 (251h44m27.331055125s) [upload=261809]: Uploading segments... Aug 19 05:10:32.900021041 (251h44m27.331101192s) [upload=261809]: Got next segment. Inline: true Aug 19 05:10:32.900027745 (251h44m27.331107866s) [upload=261809]: Waiting for error group managing segments... Aug 19 05:10:32.900070356 (251h44m27.331150487s) [upload=261809]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:10:32.900075816 (251h44m27.331155947s) [upload=261809]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 05:10:32.900078782 (251h44m27.331158913s) [upload=261809]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:10:33.182135206 (251h44m27.613215337s) [upload=261809]: Done uploading segments... Aug 19 05:10:33.182159463 (251h44m27.613239624s) [upload=261809]: Upload finished. err: <nil> Duration:* 2.051068564s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.............................X.....X............X...........] duration: 5.874470613s FAIL (2025-08-19 05:18:09 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 19 05:09:11.386254861 (251h43m5.817334982s) [upload=261787]: Starting upload Aug 19 05:09:11.386321348 (251h43m5.817401469s) [upload=261787]: Done starting upload Aug 19 05:09:11.386407303 (251h43m5.817487434s) [upload=261787]: Uploading segments... Aug 19 05:09:11.386516612 (251h43m5.817596743s) [upload=261787]: Got next segment. Inline: false Aug 19 05:09:11.386552742 (251h43m5.817632863s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:09:11.386559414 (251h43m5.817639545s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 05:09:11.834890261 (251h43m6.265970392s) [seg_pos={0 0}, upload=261787]: Begin upload segment... Aug 19 05:09:11.834930347 (251h43m6.266010478s) [seg_pos={0 0}, upload=261787]: Done begin upload segment. Aug 19 05:09:11.834974011 (251h43m6.266054142s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835375028 (251h43m6.266455159s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835538070 (251h43m6.266618201s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835705821 (251h43m6.266785952s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835973453 (251h43m6.267053584s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836265933 (251h43m6.267346064s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836276182 (251h43m6.267356313s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836598940 (251h43m6.267679071s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836634258 (251h43m6.267714389s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836912620 (251h43m6.267992751s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837172388 (251h43m6.268252509s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837390996 (251h43m6.268471127s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837598462 (251h43m6.268678593s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837826179 (251h43m6.26890631s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838040359 (251h43m6.26912049s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838241463 (251h43m6.269321594s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838462406 (251h43m6.269542537s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838913720 (251h43m6.269993851s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:13.313230483 (251h43m7.744310624s) [upload=261787]: Next returned nil segment Aug 19 05:09:13.313249379 (251h43m7.74432952s) [upload=261787]: Waiting for error group managing segments... Aug 19 05:09:13.687728957 (251h43m8.118809089s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.709661914 (251h43m8.140742035s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.721922564 (251h43m8.153002695s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.756509633 (251h43m8.187589754s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.789161020 (251h43m8.220241151s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.803244097 (251h43m8.234324218s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.834984259 (251h43m8.26606438s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.842943449 (251h43m8.27402358s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.874788291 (251h43m8.305868422s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.875188526 (251h43m8.306268657s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.883263788 (251h43m8.314343919s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.898508016 (251h43m8.329588148s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.899690921 (251h43m8.330771052s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961706813 (251h43m8.392786934s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961733925 (251h43m8.392814056s) [seg_pos={0 0}, upload=261787]: Segment reached optimal threshold of 14 pieces. Aug 19 05:09:13.961909691 (251h43m8.392989832s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bCw4Dx7aFbxT7TeUKezRzHD4yQWYXXNJVgFfF3FGhnkVVk9Jb): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962008531 (251h43m8.393088662s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hRpjHEvHzBoYqq6DXKC5Z3SPsP4HEZz2tAiuheHkgzzcnsVU2): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962017918 (251h43m8.393098049s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2cXhqd5EWbNPTXem83jQUjYq5ZaGKBidbVCQzxYfR3rWddGR): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962068645 (251h43m8.393148776s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962084104 (251h43m8.393164235s) [seg_pos={0 0}, upload=261787]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 05:09:13.962142396 (251h43m8.393222527s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 05:09:13.962145853 (251h43m8.393225984s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:09:14.249509942 (251h43m8.680590073s) [upload=261787]: Done uploading segments... Aug 19 05:09:14.249531253 (251h43m8.680611384s) [upload=261787]: Upload finished. err: <nil> Duration: 5.874500772s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [......................XX.........................X..........] duration: 1.944211892s FAIL (2025-08-19 05:18:05 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 05:10:32.899846928 (251h44m27.330927059s) [upload=261809]: Starting upload Aug 19 05:10:32.899910309 (251h44m27.33099044s) [upload=261809]: Done starting upload Aug 19 05:10:32.899974994 (251h44m27.331055125s) [upload=261809]: Uploading segments... Aug 19 05:10:32.900021041 (251h44m27.331101192s) [upload=261809]: Got next segment. Inline: true Aug 19 05:10:32.900027745 (251h44m27.331107866s) [upload=261809]: Waiting for error group managing segments... Aug 19 05:10:32.900070356 (251h44m27.331150487s) [upload=261809]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:10:32.900075816 (251h44m27.331155947s) [upload=261809]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 05:10:32.900078782 (251h44m27.331158913s) [upload=261809]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:10:33.182135206 (251h44m27.613215337s) [upload=261809]: Done uploading segments... Aug 19 05:10:33.182159463 (251h44m27.613239624s) [upload=261809]: Upload finished. err: <nil> Duration:* 1.944237972s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.......................XX.........................X.........] duration: 1.847184857s FAIL (2025-08-19 05:17:33 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 05:10:32.899846928 (251h44m27.330927059s) [upload=261809]: Starting upload Aug 19 05:10:32.899910309 (251h44m27.33099044s) [upload=261809]: Done starting upload Aug 19 05:10:32.899974994 (251h44m27.331055125s) [upload=261809]: Uploading segments... Aug 19 05:10:32.900021041 (251h44m27.331101192s) [upload=261809]: Got next segment. Inline: true Aug 19 05:10:32.900027745 (251h44m27.331107866s) [upload=261809]: Waiting for error group managing segments... Aug 19 05:10:32.900070356 (251h44m27.331150487s) [upload=261809]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:10:32.900075816 (251h44m27.331155947s) [upload=261809]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 05:10:32.900078782 (251h44m27.331158913s) [upload=261809]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:10:33.182135206 (251h44m27.613215337s) [upload=261809]: Done uploading segments... Aug 19 05:10:33.182159463 (251h44m27.613239624s) [upload=261809]: Upload finished. err: <nil> Duration:* 1.847211427s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [X...........................................................] duration: 2.261864056s FAIL (2025-08-19 05:17:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.261883844s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [........................XX.........................X........] duration: 2.012401727s FAIL (2025-08-19 05:17:12 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 05:10:32.899846928 (251h44m27.330927059s) [upload=261809]: Starting upload Aug 19 05:10:32.899910309 (251h44m27.33099044s) [upload=261809]: Done starting upload Aug 19 05:10:32.899974994 (251h44m27.331055125s) [upload=261809]: Uploading segments... Aug 19 05:10:32.900021041 (251h44m27.331101192s) [upload=261809]: Got next segment. Inline: true Aug 19 05:10:32.900027745 (251h44m27.331107866s) [upload=261809]: Waiting for error group managing segments... Aug 19 05:10:32.900070356 (251h44m27.331150487s) [upload=261809]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:10:32.900075816 (251h44m27.331155947s) [upload=261809]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 05:10:32.900078782 (251h44m27.331158913s) [upload=261809]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:10:33.182135206 (251h44m27.613215337s) [upload=261809]: Done uploading segments... Aug 19 05:10:33.182159463 (251h44m27.613239624s) [upload=261809]: Upload finished. err: <nil> Duration:* 2.012447666s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..............................X.....X............X..........] duration: 5.880929763s FAIL (2025-08-19 05:17:03 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 19 05:09:11.386254861 (251h43m5.817334982s) [upload=261787]: Starting upload Aug 19 05:09:11.386321348 (251h43m5.817401469s) [upload=261787]: Done starting upload Aug 19 05:09:11.386407303 (251h43m5.817487434s) [upload=261787]: Uploading segments... Aug 19 05:09:11.386516612 (251h43m5.817596743s) [upload=261787]: Got next segment. Inline: false Aug 19 05:09:11.386552742 (251h43m5.817632863s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:09:11.386559414 (251h43m5.817639545s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 05:09:11.834890261 (251h43m6.265970392s) [seg_pos={0 0}, upload=261787]: Begin upload segment... Aug 19 05:09:11.834930347 (251h43m6.266010478s) [seg_pos={0 0}, upload=261787]: Done begin upload segment. Aug 19 05:09:11.834974011 (251h43m6.266054142s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835375028 (251h43m6.266455159s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835538070 (251h43m6.266618201s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835705821 (251h43m6.266785952s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835973453 (251h43m6.267053584s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836265933 (251h43m6.267346064s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836276182 (251h43m6.267356313s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836598940 (251h43m6.267679071s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836634258 (251h43m6.267714389s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836912620 (251h43m6.267992751s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837172388 (251h43m6.268252509s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837390996 (251h43m6.268471127s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837598462 (251h43m6.268678593s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837826179 (251h43m6.26890631s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838040359 (251h43m6.26912049s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838241463 (251h43m6.269321594s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838462406 (251h43m6.269542537s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838913720 (251h43m6.269993851s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:13.313230483 (251h43m7.744310624s) [upload=261787]: Next returned nil segment Aug 19 05:09:13.313249379 (251h43m7.74432952s) [upload=261787]: Waiting for error group managing segments... Aug 19 05:09:13.687728957 (251h43m8.118809089s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.709661914 (251h43m8.140742035s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.721922564 (251h43m8.153002695s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.756509633 (251h43m8.187589754s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.789161020 (251h43m8.220241151s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.803244097 (251h43m8.234324218s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.834984259 (251h43m8.26606438s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.842943449 (251h43m8.27402358s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.874788291 (251h43m8.305868422s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.875188526 (251h43m8.306268657s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.883263788 (251h43m8.314343919s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.898508016 (251h43m8.329588148s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.899690921 (251h43m8.330771052s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961706813 (251h43m8.392786934s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961733925 (251h43m8.392814056s) [seg_pos={0 0}, upload=261787]: Segment reached optimal threshold of 14 pieces. Aug 19 05:09:13.961909691 (251h43m8.392989832s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bCw4Dx7aFbxT7TeUKezRzHD4yQWYXXNJVgFfF3FGhnkVVk9Jb): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962008531 (251h43m8.393088662s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hRpjHEvHzBoYqq6DXKC5Z3SPsP4HEZz2tAiuheHkgzzcnsVU2): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962017918 (251h43m8.393098049s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2cXhqd5EWbNPTXem83jQUjYq5ZaGKBidbVCQzxYfR3rWddGR): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962068645 (251h43m8.393148776s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962084104 (251h43m8.393164235s) [seg_pos={0 0}, upload=261787]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 05:09:13.962142396 (251h43m8.393222527s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 05:09:13.962145853 (251h43m8.393225984s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:09:14.249509942 (251h43m8.680590073s) [upload=261787]: Done uploading segments... Aug 19 05:09:14.249531253 (251h43m8.680611384s) [upload=261787]: Upload finished. err: <nil> Duration: 5.880955842s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.X..........................................................] duration: 2.354670893s FAIL (2025-08-19 05:17:01 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.35469499s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...............................X.....X............X.........] duration: 5.806743852s FAIL (2025-08-19 05:16:40 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 19 05:09:11.386254861 (251h43m5.817334982s) [upload=261787]: Starting upload Aug 19 05:09:11.386321348 (251h43m5.817401469s) [upload=261787]: Done starting upload Aug 19 05:09:11.386407303 (251h43m5.817487434s) [upload=261787]: Uploading segments... Aug 19 05:09:11.386516612 (251h43m5.817596743s) [upload=261787]: Got next segment. Inline: false Aug 19 05:09:11.386552742 (251h43m5.817632863s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:09:11.386559414 (251h43m5.817639545s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 05:09:11.834890261 (251h43m6.265970392s) [seg_pos={0 0}, upload=261787]: Begin upload segment... Aug 19 05:09:11.834930347 (251h43m6.266010478s) [seg_pos={0 0}, upload=261787]: Done begin upload segment. Aug 19 05:09:11.834974011 (251h43m6.266054142s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835375028 (251h43m6.266455159s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835538070 (251h43m6.266618201s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835705821 (251h43m6.266785952s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835973453 (251h43m6.267053584s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836265933 (251h43m6.267346064s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836276182 (251h43m6.267356313s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836598940 (251h43m6.267679071s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836634258 (251h43m6.267714389s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836912620 (251h43m6.267992751s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837172388 (251h43m6.268252509s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837390996 (251h43m6.268471127s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837598462 (251h43m6.268678593s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837826179 (251h43m6.26890631s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838040359 (251h43m6.26912049s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838241463 (251h43m6.269321594s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838462406 (251h43m6.269542537s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838913720 (251h43m6.269993851s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:13.313230483 (251h43m7.744310624s) [upload=261787]: Next returned nil segment Aug 19 05:09:13.313249379 (251h43m7.74432952s) [upload=261787]: Waiting for error group managing segments... Aug 19 05:09:13.687728957 (251h43m8.118809089s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.709661914 (251h43m8.140742035s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.721922564 (251h43m8.153002695s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.756509633 (251h43m8.187589754s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.789161020 (251h43m8.220241151s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.803244097 (251h43m8.234324218s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.834984259 (251h43m8.26606438s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.842943449 (251h43m8.27402358s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.874788291 (251h43m8.305868422s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.875188526 (251h43m8.306268657s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.883263788 (251h43m8.314343919s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.898508016 (251h43m8.329588148s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.899690921 (251h43m8.330771052s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961706813 (251h43m8.392786934s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961733925 (251h43m8.392814056s) [seg_pos={0 0}, upload=261787]: Segment reached optimal threshold of 14 pieces. Aug 19 05:09:13.961909691 (251h43m8.392989832s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bCw4Dx7aFbxT7TeUKezRzHD4yQWYXXNJVgFfF3FGhnkVVk9Jb): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962008531 (251h43m8.393088662s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hRpjHEvHzBoYqq6DXKC5Z3SPsP4HEZz2tAiuheHkgzzcnsVU2): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962017918 (251h43m8.393098049s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2cXhqd5EWbNPTXem83jQUjYq5ZaGKBidbVCQzxYfR3rWddGR): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962068645 (251h43m8.393148776s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962084104 (251h43m8.393164235s) [seg_pos={0 0}, upload=261787]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 05:09:13.962142396 (251h43m8.393222527s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 05:09:13.962145853 (251h43m8.393225984s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:09:14.249509942 (251h43m8.680590073s) [upload=261787]: Done uploading segments... Aug 19 05:09:14.249531253 (251h43m8.680611384s) [upload=261787]: Upload finished. err: <nil> Duration: 5.806773039s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..X.........................................................] duration: 2.339435392s FAIL (2025-08-19 05:16:10 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.339457074s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [................................X.....X............X........] duration: 5.842315567s FAIL (2025-08-19 05:16:02 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 19 05:09:11.386254861 (251h43m5.817334982s) [upload=261787]: Starting upload Aug 19 05:09:11.386321348 (251h43m5.817401469s) [upload=261787]: Done starting upload Aug 19 05:09:11.386407303 (251h43m5.817487434s) [upload=261787]: Uploading segments... Aug 19 05:09:11.386516612 (251h43m5.817596743s) [upload=261787]: Got next segment. Inline: false Aug 19 05:09:11.386552742 (251h43m5.817632863s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:09:11.386559414 (251h43m5.817639545s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 05:09:11.834890261 (251h43m6.265970392s) [seg_pos={0 0}, upload=261787]: Begin upload segment... Aug 19 05:09:11.834930347 (251h43m6.266010478s) [seg_pos={0 0}, upload=261787]: Done begin upload segment. Aug 19 05:09:11.834974011 (251h43m6.266054142s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835375028 (251h43m6.266455159s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835538070 (251h43m6.266618201s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835705821 (251h43m6.266785952s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835973453 (251h43m6.267053584s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836265933 (251h43m6.267346064s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836276182 (251h43m6.267356313s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836598940 (251h43m6.267679071s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836634258 (251h43m6.267714389s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836912620 (251h43m6.267992751s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837172388 (251h43m6.268252509s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837390996 (251h43m6.268471127s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837598462 (251h43m6.268678593s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837826179 (251h43m6.26890631s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838040359 (251h43m6.26912049s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838241463 (251h43m6.269321594s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838462406 (251h43m6.269542537s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838913720 (251h43m6.269993851s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:13.313230483 (251h43m7.744310624s) [upload=261787]: Next returned nil segment Aug 19 05:09:13.313249379 (251h43m7.74432952s) [upload=261787]: Waiting for error group managing segments... Aug 19 05:09:13.687728957 (251h43m8.118809089s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.709661914 (251h43m8.140742035s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.721922564 (251h43m8.153002695s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.756509633 (251h43m8.187589754s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.789161020 (251h43m8.220241151s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.803244097 (251h43m8.234324218s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.834984259 (251h43m8.26606438s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.842943449 (251h43m8.27402358s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.874788291 (251h43m8.305868422s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.875188526 (251h43m8.306268657s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.883263788 (251h43m8.314343919s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.898508016 (251h43m8.329588148s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.899690921 (251h43m8.330771052s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961706813 (251h43m8.392786934s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961733925 (251h43m8.392814056s) [seg_pos={0 0}, upload=261787]: Segment reached optimal threshold of 14 pieces. Aug 19 05:09:13.961909691 (251h43m8.392989832s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bCw4Dx7aFbxT7TeUKezRzHD4yQWYXXNJVgFfF3FGhnkVVk9Jb): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962008531 (251h43m8.393088662s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hRpjHEvHzBoYqq6DXKC5Z3SPsP4HEZz2tAiuheHkgzzcnsVU2): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962017918 (251h43m8.393098049s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2cXhqd5EWbNPTXem83jQUjYq5ZaGKBidbVCQzxYfR3rWddGR): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962068645 (251h43m8.393148776s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962084104 (251h43m8.393164235s) [seg_pos={0 0}, upload=261787]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 05:09:13.962142396 (251h43m8.393222527s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 05:09:13.962145853 (251h43m8.393225984s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:09:14.249509942 (251h43m8.680590073s) [upload=261787]: Done uploading segments... Aug 19 05:09:14.249531253 (251h43m8.680611384s) [upload=261787]: Upload finished. err: <nil> Duration: 5.842342328s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.........................XX.........................X.......] duration: 1.812323074s FAIL (2025-08-19 05:15:59 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 05:10:32.899846928 (251h44m27.330927059s) [upload=261809]: Starting upload Aug 19 05:10:32.899910309 (251h44m27.33099044s) [upload=261809]: Done starting upload Aug 19 05:10:32.899974994 (251h44m27.331055125s) [upload=261809]: Uploading segments... Aug 19 05:10:32.900021041 (251h44m27.331101192s) [upload=261809]: Got next segment. Inline: true Aug 19 05:10:32.900027745 (251h44m27.331107866s) [upload=261809]: Waiting for error group managing segments... Aug 19 05:10:32.900070356 (251h44m27.331150487s) [upload=261809]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:10:32.900075816 (251h44m27.331155947s) [upload=261809]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 05:10:32.900078782 (251h44m27.331158913s) [upload=261809]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:10:33.182135206 (251h44m27.613215337s) [upload=261809]: Done uploading segments... Aug 19 05:10:33.182159463 (251h44m27.613239624s) [upload=261809]: Upload finished. err: <nil> Duration:* 1.812347971s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...X........................................................] duration: 2.282186722s FAIL (2025-08-19 05:15:30 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.282208413s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.................................X.....X............X.......] duration: 5.948000154s FAIL (2025-08-19 05:15:05 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 19 05:09:11.386254861 (251h43m5.817334982s) [upload=261787]: Starting upload Aug 19 05:09:11.386321348 (251h43m5.817401469s) [upload=261787]: Done starting upload Aug 19 05:09:11.386407303 (251h43m5.817487434s) [upload=261787]: Uploading segments... Aug 19 05:09:11.386516612 (251h43m5.817596743s) [upload=261787]: Got next segment. Inline: false Aug 19 05:09:11.386552742 (251h43m5.817632863s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:09:11.386559414 (251h43m5.817639545s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 05:09:11.834890261 (251h43m6.265970392s) [seg_pos={0 0}, upload=261787]: Begin upload segment... Aug 19 05:09:11.834930347 (251h43m6.266010478s) [seg_pos={0 0}, upload=261787]: Done begin upload segment. Aug 19 05:09:11.834974011 (251h43m6.266054142s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835375028 (251h43m6.266455159s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835538070 (251h43m6.266618201s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835705821 (251h43m6.266785952s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835973453 (251h43m6.267053584s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836265933 (251h43m6.267346064s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836276182 (251h43m6.267356313s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836598940 (251h43m6.267679071s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836634258 (251h43m6.267714389s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836912620 (251h43m6.267992751s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837172388 (251h43m6.268252509s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837390996 (251h43m6.268471127s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837598462 (251h43m6.268678593s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837826179 (251h43m6.26890631s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838040359 (251h43m6.26912049s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838241463 (251h43m6.269321594s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838462406 (251h43m6.269542537s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838913720 (251h43m6.269993851s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:13.313230483 (251h43m7.744310624s) [upload=261787]: Next returned nil segment Aug 19 05:09:13.313249379 (251h43m7.74432952s) [upload=261787]: Waiting for error group managing segments... Aug 19 05:09:13.687728957 (251h43m8.118809089s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.709661914 (251h43m8.140742035s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.721922564 (251h43m8.153002695s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.756509633 (251h43m8.187589754s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.789161020 (251h43m8.220241151s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.803244097 (251h43m8.234324218s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.834984259 (251h43m8.26606438s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.842943449 (251h43m8.27402358s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.874788291 (251h43m8.305868422s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.875188526 (251h43m8.306268657s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.883263788 (251h43m8.314343919s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.898508016 (251h43m8.329588148s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.899690921 (251h43m8.330771052s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961706813 (251h43m8.392786934s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961733925 (251h43m8.392814056s) [seg_pos={0 0}, upload=261787]: Segment reached optimal threshold of 14 pieces. Aug 19 05:09:13.961909691 (251h43m8.392989832s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bCw4Dx7aFbxT7TeUKezRzHD4yQWYXXNJVgFfF3FGhnkVVk9Jb): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962008531 (251h43m8.393088662s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hRpjHEvHzBoYqq6DXKC5Z3SPsP4HEZz2tAiuheHkgzzcnsVU2): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962017918 (251h43m8.393098049s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2cXhqd5EWbNPTXem83jQUjYq5ZaGKBidbVCQzxYfR3rWddGR): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962068645 (251h43m8.393148776s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962084104 (251h43m8.393164235s) [seg_pos={0 0}, upload=261787]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 05:09:13.962142396 (251h43m8.393222527s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 05:09:13.962145853 (251h43m8.393225984s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:09:14.249509942 (251h43m8.680590073s) [upload=261787]: Done uploading segments... Aug 19 05:09:14.249531253 (251h43m8.680611384s) [upload=261787]: Upload finished. err: <nil> Duration: 5.948032857s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [....X.......................................................] duration: 2.209541188s FAIL (2025-08-19 05:14:58 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.209557971s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..........................XX.........................X......] duration: 1.814729176s FAIL (2025-08-19 05:14:48 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 05:10:32.899846928 (251h44m27.330927059s) [upload=261809]: Starting upload Aug 19 05:10:32.899910309 (251h44m27.33099044s) [upload=261809]: Done starting upload Aug 19 05:10:32.899974994 (251h44m27.331055125s) [upload=261809]: Uploading segments... Aug 19 05:10:32.900021041 (251h44m27.331101192s) [upload=261809]: Got next segment. Inline: true Aug 19 05:10:32.900027745 (251h44m27.331107866s) [upload=261809]: Waiting for error group managing segments... Aug 19 05:10:32.900070356 (251h44m27.331150487s) [upload=261809]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:10:32.900075816 (251h44m27.331155947s) [upload=261809]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 05:10:32.900078782 (251h44m27.331158913s) [upload=261809]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:10:33.182135206 (251h44m27.613215337s) [upload=261809]: Done uploading segments... Aug 19 05:10:33.182159463 (251h44m27.613239624s) [upload=261809]: Upload finished. err: <nil> Duration:* 1.814759465s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.....X......................................................] duration: 2.581889148s FAIL (2025-08-19 05:14:21 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.581909726s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [..................................X.....X............X......] duration: 5.8115239s FAIL (2025-08-19 05:14:10 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 19 05:09:11.386254861 (251h43m5.817334982s) [upload=261787]: Starting upload Aug 19 05:09:11.386321348 (251h43m5.817401469s) [upload=261787]: Done starting upload Aug 19 05:09:11.386407303 (251h43m5.817487434s) [upload=261787]: Uploading segments... Aug 19 05:09:11.386516612 (251h43m5.817596743s) [upload=261787]: Got next segment. Inline: false Aug 19 05:09:11.386552742 (251h43m5.817632863s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:09:11.386559414 (251h43m5.817639545s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 05:09:11.834890261 (251h43m6.265970392s) [seg_pos={0 0}, upload=261787]: Begin upload segment... Aug 19 05:09:11.834930347 (251h43m6.266010478s) [seg_pos={0 0}, upload=261787]: Done begin upload segment. Aug 19 05:09:11.834974011 (251h43m6.266054142s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835375028 (251h43m6.266455159s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835538070 (251h43m6.266618201s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835705821 (251h43m6.266785952s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835973453 (251h43m6.267053584s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836265933 (251h43m6.267346064s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836276182 (251h43m6.267356313s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836598940 (251h43m6.267679071s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836634258 (251h43m6.267714389s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836912620 (251h43m6.267992751s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837172388 (251h43m6.268252509s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837390996 (251h43m6.268471127s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837598462 (251h43m6.268678593s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837826179 (251h43m6.26890631s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838040359 (251h43m6.26912049s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838241463 (251h43m6.269321594s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838462406 (251h43m6.269542537s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838913720 (251h43m6.269993851s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:13.313230483 (251h43m7.744310624s) [upload=261787]: Next returned nil segment Aug 19 05:09:13.313249379 (251h43m7.74432952s) [upload=261787]: Waiting for error group managing segments... Aug 19 05:09:13.687728957 (251h43m8.118809089s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.709661914 (251h43m8.140742035s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.721922564 (251h43m8.153002695s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.756509633 (251h43m8.187589754s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.789161020 (251h43m8.220241151s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.803244097 (251h43m8.234324218s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.834984259 (251h43m8.26606438s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.842943449 (251h43m8.27402358s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.874788291 (251h43m8.305868422s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.875188526 (251h43m8.306268657s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.883263788 (251h43m8.314343919s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.898508016 (251h43m8.329588148s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.899690921 (251h43m8.330771052s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961706813 (251h43m8.392786934s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961733925 (251h43m8.392814056s) [seg_pos={0 0}, upload=261787]: Segment reached optimal threshold of 14 pieces. Aug 19 05:09:13.961909691 (251h43m8.392989832s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bCw4Dx7aFbxT7TeUKezRzHD4yQWYXXNJVgFfF3FGhnkVVk9Jb): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962008531 (251h43m8.393088662s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hRpjHEvHzBoYqq6DXKC5Z3SPsP4HEZz2tAiuheHkgzzcnsVU2): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962017918 (251h43m8.393098049s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2cXhqd5EWbNPTXem83jQUjYq5ZaGKBidbVCQzxYfR3rWddGR): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962068645 (251h43m8.393148776s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962084104 (251h43m8.393164235s) [seg_pos={0 0}, upload=261787]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 05:09:13.962142396 (251h43m8.393222527s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 05:09:13.962145853 (251h43m8.393225984s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:09:14.249509942 (251h43m8.680590073s) [upload=261787]: Done uploading segments... Aug 19 05:09:14.249531253 (251h43m8.680611384s) [upload=261787]: Upload finished. err: <nil> Duration: 5.811545182s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [......X.....................................................] duration: 2.234710619s FAIL (2025-08-19 05:13:57 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.23472696s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...........................XX.........................X.....] duration: 1.862376265s FAIL (2025-08-19 05:13:51 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 05:10:32.899846928 (251h44m27.330927059s) [upload=261809]: Starting upload Aug 19 05:10:32.899910309 (251h44m27.33099044s) [upload=261809]: Done starting upload Aug 19 05:10:32.899974994 (251h44m27.331055125s) [upload=261809]: Uploading segments... Aug 19 05:10:32.900021041 (251h44m27.331101192s) [upload=261809]: Got next segment. Inline: true Aug 19 05:10:32.900027745 (251h44m27.331107866s) [upload=261809]: Waiting for error group managing segments... Aug 19 05:10:32.900070356 (251h44m27.331150487s) [upload=261809]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:10:32.900075816 (251h44m27.331155947s) [upload=261809]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 05:10:32.900078782 (251h44m27.331158913s) [upload=261809]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:10:33.182135206 (251h44m27.613215337s) [upload=261809]: Done uploading segments... Aug 19 05:10:33.182159463 (251h44m27.613239624s) [upload=261809]: Upload finished. err: <nil> Duration:* 1.862405773s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [...................................X.....X............X.....] duration: 5.727402215s FAIL (2025-08-19 05:13:43 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 19 05:09:11.386254861 (251h43m5.817334982s) [upload=261787]: Starting upload Aug 19 05:09:11.386321348 (251h43m5.817401469s) [upload=261787]: Done starting upload Aug 19 05:09:11.386407303 (251h43m5.817487434s) [upload=261787]: Uploading segments... Aug 19 05:09:11.386516612 (251h43m5.817596743s) [upload=261787]: Got next segment. Inline: false Aug 19 05:09:11.386552742 (251h43m5.817632863s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:09:11.386559414 (251h43m5.817639545s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 05:09:11.834890261 (251h43m6.265970392s) [seg_pos={0 0}, upload=261787]: Begin upload segment... Aug 19 05:09:11.834930347 (251h43m6.266010478s) [seg_pos={0 0}, upload=261787]: Done begin upload segment. Aug 19 05:09:11.834974011 (251h43m6.266054142s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835375028 (251h43m6.266455159s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835538070 (251h43m6.266618201s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835705821 (251h43m6.266785952s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835973453 (251h43m6.267053584s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836265933 (251h43m6.267346064s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836276182 (251h43m6.267356313s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836598940 (251h43m6.267679071s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836634258 (251h43m6.267714389s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836912620 (251h43m6.267992751s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837172388 (251h43m6.268252509s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837390996 (251h43m6.268471127s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837598462 (251h43m6.268678593s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837826179 (251h43m6.26890631s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838040359 (251h43m6.26912049s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838241463 (251h43m6.269321594s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838462406 (251h43m6.269542537s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838913720 (251h43m6.269993851s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:13.313230483 (251h43m7.744310624s) [upload=261787]: Next returned nil segment Aug 19 05:09:13.313249379 (251h43m7.74432952s) [upload=261787]: Waiting for error group managing segments... Aug 19 05:09:13.687728957 (251h43m8.118809089s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.709661914 (251h43m8.140742035s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.721922564 (251h43m8.153002695s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.756509633 (251h43m8.187589754s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.789161020 (251h43m8.220241151s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.803244097 (251h43m8.234324218s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.834984259 (251h43m8.26606438s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.842943449 (251h43m8.27402358s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.874788291 (251h43m8.305868422s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.875188526 (251h43m8.306268657s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.883263788 (251h43m8.314343919s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.898508016 (251h43m8.329588148s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.899690921 (251h43m8.330771052s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961706813 (251h43m8.392786934s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961733925 (251h43m8.392814056s) [seg_pos={0 0}, upload=261787]: Segment reached optimal threshold of 14 pieces. Aug 19 05:09:13.961909691 (251h43m8.392989832s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bCw4Dx7aFbxT7TeUKezRzHD4yQWYXXNJVgFfF3FGhnkVVk9Jb): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962008531 (251h43m8.393088662s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hRpjHEvHzBoYqq6DXKC5Z3SPsP4HEZz2tAiuheHkgzzcnsVU2): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962017918 (251h43m8.393098049s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2cXhqd5EWbNPTXem83jQUjYq5ZaGKBidbVCQzxYfR3rWddGR): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962068645 (251h43m8.393148776s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962084104 (251h43m8.393164235s) [seg_pos={0 0}, upload=261787]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 05:09:13.962142396 (251h43m8.393222527s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 05:09:13.962145853 (251h43m8.393225984s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:09:14.249509942 (251h43m8.680590073s) [upload=261787]: Done uploading segments... Aug 19 05:09:14.249531253 (251h43m8.680611384s) [upload=261787]: Upload finished. err: <nil> Duration: 5.727428384s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [............................XX.........................X....] duration: 1.791630589s FAIL (2025-08-19 05:13:30 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 05:10:32.899846928 (251h44m27.330927059s) [upload=261809]: Starting upload Aug 19 05:10:32.899910309 (251h44m27.33099044s) [upload=261809]: Done starting upload Aug 19 05:10:32.899974994 (251h44m27.331055125s) [upload=261809]: Uploading segments... Aug 19 05:10:32.900021041 (251h44m27.331101192s) [upload=261809]: Got next segment. Inline: true Aug 19 05:10:32.900027745 (251h44m27.331107866s) [upload=261809]: Waiting for error group managing segments... Aug 19 05:10:32.900070356 (251h44m27.331150487s) [upload=261809]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:10:32.900075816 (251h44m27.331155947s) [upload=261809]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 05:10:32.900078782 (251h44m27.331158913s) [upload=261809]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:10:33.182135206 (251h44m27.613215337s) [upload=261809]: Done uploading segments... Aug 19 05:10:33.182159463 (251h44m27.613239624s) [upload=261809]: Upload finished. err: <nil> Duration:* 1.791658623s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.......X....................................................] duration: 2.211052441s FAIL (2025-08-19 05:13:18 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.211072419s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [....................................X.....X............X....] duration: 5.674619284s FAIL (2025-08-19 05:12:43 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 19 05:09:11.386254861 (251h43m5.817334982s) [upload=261787]: Starting upload Aug 19 05:09:11.386321348 (251h43m5.817401469s) [upload=261787]: Done starting upload Aug 19 05:09:11.386407303 (251h43m5.817487434s) [upload=261787]: Uploading segments... Aug 19 05:09:11.386516612 (251h43m5.817596743s) [upload=261787]: Got next segment. Inline: false Aug 19 05:09:11.386552742 (251h43m5.817632863s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:09:11.386559414 (251h43m5.817639545s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 05:09:11.834890261 (251h43m6.265970392s) [seg_pos={0 0}, upload=261787]: Begin upload segment... Aug 19 05:09:11.834930347 (251h43m6.266010478s) [seg_pos={0 0}, upload=261787]: Done begin upload segment. Aug 19 05:09:11.834974011 (251h43m6.266054142s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835375028 (251h43m6.266455159s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835538070 (251h43m6.266618201s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835705821 (251h43m6.266785952s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835973453 (251h43m6.267053584s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836265933 (251h43m6.267346064s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836276182 (251h43m6.267356313s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836598940 (251h43m6.267679071s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836634258 (251h43m6.267714389s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836912620 (251h43m6.267992751s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837172388 (251h43m6.268252509s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837390996 (251h43m6.268471127s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837598462 (251h43m6.268678593s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837826179 (251h43m6.26890631s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838040359 (251h43m6.26912049s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838241463 (251h43m6.269321594s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838462406 (251h43m6.269542537s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838913720 (251h43m6.269993851s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:13.313230483 (251h43m7.744310624s) [upload=261787]: Next returned nil segment Aug 19 05:09:13.313249379 (251h43m7.74432952s) [upload=261787]: Waiting for error group managing segments... Aug 19 05:09:13.687728957 (251h43m8.118809089s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.709661914 (251h43m8.140742035s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.721922564 (251h43m8.153002695s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.756509633 (251h43m8.187589754s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.789161020 (251h43m8.220241151s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.803244097 (251h43m8.234324218s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.834984259 (251h43m8.26606438s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.842943449 (251h43m8.27402358s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.874788291 (251h43m8.305868422s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.875188526 (251h43m8.306268657s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.883263788 (251h43m8.314343919s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.898508016 (251h43m8.329588148s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.899690921 (251h43m8.330771052s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961706813 (251h43m8.392786934s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961733925 (251h43m8.392814056s) [seg_pos={0 0}, upload=261787]: Segment reached optimal threshold of 14 pieces. Aug 19 05:09:13.961909691 (251h43m8.392989832s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bCw4Dx7aFbxT7TeUKezRzHD4yQWYXXNJVgFfF3FGhnkVVk9Jb): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962008531 (251h43m8.393088662s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hRpjHEvHzBoYqq6DXKC5Z3SPsP4HEZz2tAiuheHkgzzcnsVU2): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962017918 (251h43m8.393098049s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2cXhqd5EWbNPTXem83jQUjYq5ZaGKBidbVCQzxYfR3rWddGR): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962068645 (251h43m8.393148776s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962084104 (251h43m8.393164235s) [seg_pos={0 0}, upload=261787]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 05:09:13.962142396 (251h43m8.393222527s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 05:09:13.962145853 (251h43m8.393225984s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:09:14.249509942 (251h43m8.680590073s) [upload=261787]: Done uploading segments... Aug 19 05:09:14.249531253 (251h43m8.680611384s) [upload=261787]: Upload finished. err: <nil> Duration: 5.674650222s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [.............................XX.........................X...] duration: 1.8496362s FAIL (2025-08-19 05:12:33 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 05:10:32.899846928 (251h44m27.330927059s) [upload=261809]: Starting upload Aug 19 05:10:32.899910309 (251h44m27.33099044s) [upload=261809]: Done starting upload Aug 19 05:10:32.899974994 (251h44m27.331055125s) [upload=261809]: Uploading segments... Aug 19 05:10:32.900021041 (251h44m27.331101192s) [upload=261809]: Got next segment. Inline: true Aug 19 05:10:32.900027745 (251h44m27.331107866s) [upload=261809]: Waiting for error group managing segments... Aug 19 05:10:32.900070356 (251h44m27.331150487s) [upload=261809]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:10:32.900075816 (251h44m27.331155947s) [upload=261809]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 05:10:32.900078782 (251h44m27.331158913s) [upload=261809]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:10:33.182135206 (251h44m27.613215337s) [upload=261809]: Done uploading segments... Aug 19 05:10:33.182159463 (251h44m27.613239624s) [upload=261809]: Upload finished. err: <nil> Duration:* 1.849655077s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [........X...................................................] duration: 2.214328821s FAIL (2025-08-19 05:12:32 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.214371612s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.....................................X.....X............X...] duration: 5.799839439s FAIL (2025-08-19 05:11:58 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 19 05:09:11.386254861 (251h43m5.817334982s) [upload=261787]: Starting upload Aug 19 05:09:11.386321348 (251h43m5.817401469s) [upload=261787]: Done starting upload Aug 19 05:09:11.386407303 (251h43m5.817487434s) [upload=261787]: Uploading segments... Aug 19 05:09:11.386516612 (251h43m5.817596743s) [upload=261787]: Got next segment. Inline: false Aug 19 05:09:11.386552742 (251h43m5.817632863s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:09:11.386559414 (251h43m5.817639545s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 05:09:11.834890261 (251h43m6.265970392s) [seg_pos={0 0}, upload=261787]: Begin upload segment... Aug 19 05:09:11.834930347 (251h43m6.266010478s) [seg_pos={0 0}, upload=261787]: Done begin upload segment. Aug 19 05:09:11.834974011 (251h43m6.266054142s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835375028 (251h43m6.266455159s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835538070 (251h43m6.266618201s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835705821 (251h43m6.266785952s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835973453 (251h43m6.267053584s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836265933 (251h43m6.267346064s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836276182 (251h43m6.267356313s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836598940 (251h43m6.267679071s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836634258 (251h43m6.267714389s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836912620 (251h43m6.267992751s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837172388 (251h43m6.268252509s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837390996 (251h43m6.268471127s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837598462 (251h43m6.268678593s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837826179 (251h43m6.26890631s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838040359 (251h43m6.26912049s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838241463 (251h43m6.269321594s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838462406 (251h43m6.269542537s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838913720 (251h43m6.269993851s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:13.313230483 (251h43m7.744310624s) [upload=261787]: Next returned nil segment Aug 19 05:09:13.313249379 (251h43m7.74432952s) [upload=261787]: Waiting for error group managing segments... Aug 19 05:09:13.687728957 (251h43m8.118809089s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.709661914 (251h43m8.140742035s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.721922564 (251h43m8.153002695s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.756509633 (251h43m8.187589754s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.789161020 (251h43m8.220241151s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.803244097 (251h43m8.234324218s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.834984259 (251h43m8.26606438s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.842943449 (251h43m8.27402358s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.874788291 (251h43m8.305868422s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.875188526 (251h43m8.306268657s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.883263788 (251h43m8.314343919s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.898508016 (251h43m8.329588148s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.899690921 (251h43m8.330771052s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961706813 (251h43m8.392786934s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961733925 (251h43m8.392814056s) [seg_pos={0 0}, upload=261787]: Segment reached optimal threshold of 14 pieces. Aug 19 05:09:13.961909691 (251h43m8.392989832s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bCw4Dx7aFbxT7TeUKezRzHD4yQWYXXNJVgFfF3FGhnkVVk9Jb): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962008531 (251h43m8.393088662s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hRpjHEvHzBoYqq6DXKC5Z3SPsP4HEZz2tAiuheHkgzzcnsVU2): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962017918 (251h43m8.393098049s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2cXhqd5EWbNPTXem83jQUjYq5ZaGKBidbVCQzxYfR3rWddGR): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962068645 (251h43m8.393148776s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962084104 (251h43m8.393164235s) [seg_pos={0 0}, upload=261787]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 05:09:13.962142396 (251h43m8.393222527s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 05:09:13.962145853 (251h43m8.393225984s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:09:14.249509942 (251h43m8.680590073s) [upload=261787]: Done uploading segments... Aug 19 05:09:14.249531253 (251h43m8.680611384s) [upload=261787]: Upload finished. err: <nil> Duration: 5.79986096s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [..............................XX.........................X..] duration: 1.816656042s FAIL (2025-08-19 05:11:38 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 05:10:32.899846928 (251h44m27.330927059s) [upload=261809]: Starting upload Aug 19 05:10:32.899910309 (251h44m27.33099044s) [upload=261809]: Done starting upload Aug 19 05:10:32.899974994 (251h44m27.331055125s) [upload=261809]: Uploading segments... Aug 19 05:10:32.900021041 (251h44m27.331101192s) [upload=261809]: Got next segment. Inline: true Aug 19 05:10:32.900027745 (251h44m27.331107866s) [upload=261809]: Waiting for error group managing segments... Aug 19 05:10:32.900070356 (251h44m27.331150487s) [upload=261809]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:10:32.900075816 (251h44m27.331155947s) [upload=261809]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 05:10:32.900078782 (251h44m27.331158913s) [upload=261809]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:10:33.182135206 (251h44m27.613215337s) [upload=261809]: Done uploading segments... Aug 19 05:10:33.182159463 (251h44m27.613239624s) [upload=261809]: Upload finished. err: <nil> Duration:* 1.816682413s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.........X..................................................] duration: 2.237064232s FAIL (2025-08-19 05:11:28 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.237089319s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [...............................XX.........................X.] duration: 1.951944748s FAIL (2025-08-19 05:11:02 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 05:10:32.899846928 (251h44m27.330927059s) [upload=261809]: Starting upload Aug 19 05:10:32.899910309 (251h44m27.33099044s) [upload=261809]: Done starting upload Aug 19 05:10:32.899974994 (251h44m27.331055125s) [upload=261809]: Uploading segments... Aug 19 05:10:32.900021041 (251h44m27.331101192s) [upload=261809]: Got next segment. Inline: true Aug 19 05:10:32.900027745 (251h44m27.331107866s) [upload=261809]: Waiting for error group managing segments... Aug 19 05:10:32.900070356 (251h44m27.331150487s) [upload=261809]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:10:32.900075816 (251h44m27.331155947s) [upload=261809]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 05:10:32.900078782 (251h44m27.331158913s) [upload=261809]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:10:33.182135206 (251h44m27.613215337s) [upload=261809]: Done uploading segments... Aug 19 05:10:33.182159463 (251h44m27.613239624s) [upload=261809]: Upload finished. err: <nil> Duration:* 1.951969126s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [......................................X.....X............X..] duration: 5.860663916s FAIL (2025-08-19 05:10:43 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 19 05:09:11.386254861 (251h43m5.817334982s) [upload=261787]: Starting upload Aug 19 05:09:11.386321348 (251h43m5.817401469s) [upload=261787]: Done starting upload Aug 19 05:09:11.386407303 (251h43m5.817487434s) [upload=261787]: Uploading segments... Aug 19 05:09:11.386516612 (251h43m5.817596743s) [upload=261787]: Got next segment. Inline: false Aug 19 05:09:11.386552742 (251h43m5.817632863s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:09:11.386559414 (251h43m5.817639545s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 05:09:11.834890261 (251h43m6.265970392s) [seg_pos={0 0}, upload=261787]: Begin upload segment... Aug 19 05:09:11.834930347 (251h43m6.266010478s) [seg_pos={0 0}, upload=261787]: Done begin upload segment. Aug 19 05:09:11.834974011 (251h43m6.266054142s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835375028 (251h43m6.266455159s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835538070 (251h43m6.266618201s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835705821 (251h43m6.266785952s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835973453 (251h43m6.267053584s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836265933 (251h43m6.267346064s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836276182 (251h43m6.267356313s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836598940 (251h43m6.267679071s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836634258 (251h43m6.267714389s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836912620 (251h43m6.267992751s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837172388 (251h43m6.268252509s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837390996 (251h43m6.268471127s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837598462 (251h43m6.268678593s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837826179 (251h43m6.26890631s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838040359 (251h43m6.26912049s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838241463 (251h43m6.269321594s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838462406 (251h43m6.269542537s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838913720 (251h43m6.269993851s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:13.313230483 (251h43m7.744310624s) [upload=261787]: Next returned nil segment Aug 19 05:09:13.313249379 (251h43m7.74432952s) [upload=261787]: Waiting for error group managing segments... Aug 19 05:09:13.687728957 (251h43m8.118809089s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.709661914 (251h43m8.140742035s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.721922564 (251h43m8.153002695s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.756509633 (251h43m8.187589754s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.789161020 (251h43m8.220241151s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.803244097 (251h43m8.234324218s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.834984259 (251h43m8.26606438s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.842943449 (251h43m8.27402358s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.874788291 (251h43m8.305868422s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.875188526 (251h43m8.306268657s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.883263788 (251h43m8.314343919s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.898508016 (251h43m8.329588148s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.899690921 (251h43m8.330771052s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961706813 (251h43m8.392786934s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961733925 (251h43m8.392814056s) [seg_pos={0 0}, upload=261787]: Segment reached optimal threshold of 14 pieces. Aug 19 05:09:13.961909691 (251h43m8.392989832s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bCw4Dx7aFbxT7TeUKezRzHD4yQWYXXNJVgFfF3FGhnkVVk9Jb): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962008531 (251h43m8.393088662s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hRpjHEvHzBoYqq6DXKC5Z3SPsP4HEZz2tAiuheHkgzzcnsVU2): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962017918 (251h43m8.393098049s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2cXhqd5EWbNPTXem83jQUjYq5ZaGKBidbVCQzxYfR3rWddGR): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962068645 (251h43m8.393148776s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962084104 (251h43m8.393164235s) [seg_pos={0 0}, upload=261787]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 05:09:13.962142396 (251h43m8.393222527s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 05:09:13.962145853 (251h43m8.393225984s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:09:14.249509942 (251h43m8.680590073s) [upload=261787]: Done uploading segments... Aug 19 05:09:14.249531253 (251h43m8.680611384s) [upload=261787]: Upload finished. err: <nil> Duration: 5.860686561s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..........X.................................................] duration: 2.25454468s FAIL (2025-08-19 05:10:40 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.25455992s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [................................XX.........................X] duration: 1.38170099s FAIL (2025-08-19 05:10:33 UTC) orbiter warning: operation: ListObjects ======ERROR====== unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/1K ======LOGS====== Aug 19 05:10:32.899846928 (251h44m27.330927059s) [upload=261809]: Starting upload Aug 19 05:10:32.899910309 (251h44m27.33099044s) [upload=261809]: Done starting upload Aug 19 05:10:32.899974994 (251h44m27.331055125s) [upload=261809]: Uploading segments... Aug 19 05:10:32.900021041 (251h44m27.331101192s) [upload=261809]: Got next segment. Inline: true Aug 19 05:10:32.900027745 (251h44m27.331107866s) [upload=261809]: Waiting for error group managing segments... Aug 19 05:10:32.900070356 (251h44m27.331150487s) [upload=261809]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:10:32.900075816 (251h44m27.331155947s) [upload=261809]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 05:10:32.900078782 (251h44m27.331158913s) [upload=261809]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:10:33.182135206 (251h44m27.613215337s) [upload=261809]: Done uploading segments... Aug 19 05:10:33.182159463 (251h44m27.613239624s) [upload=261809]: Upload finished. err: <nil> Duration:* 1.381732802s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [.......................................X.....X............X.] duration: 5.779307455s FAIL (2025-08-19 05:10:06 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 19 05:09:11.386254861 (251h43m5.817334982s) [upload=261787]: Starting upload Aug 19 05:09:11.386321348 (251h43m5.817401469s) [upload=261787]: Done starting upload Aug 19 05:09:11.386407303 (251h43m5.817487434s) [upload=261787]: Uploading segments... Aug 19 05:09:11.386516612 (251h43m5.817596743s) [upload=261787]: Got next segment. Inline: false Aug 19 05:09:11.386552742 (251h43m5.817632863s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:09:11.386559414 (251h43m5.817639545s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 05:09:11.834890261 (251h43m6.265970392s) [seg_pos={0 0}, upload=261787]: Begin upload segment... Aug 19 05:09:11.834930347 (251h43m6.266010478s) [seg_pos={0 0}, upload=261787]: Done begin upload segment. Aug 19 05:09:11.834974011 (251h43m6.266054142s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835375028 (251h43m6.266455159s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835538070 (251h43m6.266618201s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835705821 (251h43m6.266785952s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835973453 (251h43m6.267053584s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836265933 (251h43m6.267346064s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836276182 (251h43m6.267356313s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836598940 (251h43m6.267679071s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836634258 (251h43m6.267714389s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836912620 (251h43m6.267992751s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837172388 (251h43m6.268252509s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837390996 (251h43m6.268471127s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837598462 (251h43m6.268678593s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837826179 (251h43m6.26890631s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838040359 (251h43m6.26912049s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838241463 (251h43m6.269321594s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838462406 (251h43m6.269542537s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838913720 (251h43m6.269993851s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:13.313230483 (251h43m7.744310624s) [upload=261787]: Next returned nil segment Aug 19 05:09:13.313249379 (251h43m7.74432952s) [upload=261787]: Waiting for error group managing segments... Aug 19 05:09:13.687728957 (251h43m8.118809089s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.709661914 (251h43m8.140742035s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.721922564 (251h43m8.153002695s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.756509633 (251h43m8.187589754s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.789161020 (251h43m8.220241151s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.803244097 (251h43m8.234324218s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.834984259 (251h43m8.26606438s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.842943449 (251h43m8.27402358s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.874788291 (251h43m8.305868422s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.875188526 (251h43m8.306268657s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.883263788 (251h43m8.314343919s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.898508016 (251h43m8.329588148s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.899690921 (251h43m8.330771052s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961706813 (251h43m8.392786934s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961733925 (251h43m8.392814056s) [seg_pos={0 0}, upload=261787]: Segment reached optimal threshold of 14 pieces. Aug 19 05:09:13.961909691 (251h43m8.392989832s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bCw4Dx7aFbxT7TeUKezRzHD4yQWYXXNJVgFfF3FGhnkVVk9Jb): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962008531 (251h43m8.393088662s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hRpjHEvHzBoYqq6DXKC5Z3SPsP4HEZz2tAiuheHkgzzcnsVU2): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962017918 (251h43m8.393098049s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2cXhqd5EWbNPTXem83jQUjYq5ZaGKBidbVCQzxYfR3rWddGR): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962068645 (251h43m8.393148776s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962084104 (251h43m8.393164235s) [seg_pos={0 0}, upload=261787]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 05:09:13.962142396 (251h43m8.393222527s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 05:09:13.962145853 (251h43m8.393225984s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:09:14.249509942 (251h43m8.680590073s) [upload=261787]: Done uploading segments... Aug 19 05:09:14.249531253 (251h43m8.680611384s) [upload=261787]: Upload finished. err: <nil> Duration: 5.779329428s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...........X................................................] duration: 2.219238224s FAIL (2025-08-19 05:09:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.219256789s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [.................................XX.........................] duration: 1.822621245s FAIL (2025-08-19 05:09:34 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:51:40.140222723 (251h25m34.571302855s) [upload=261488]: Starting upload Aug 19 04:51:40.140280544 (251h25m34.571360675s) [upload=261488]: Done starting upload Aug 19 04:51:40.140366689 (251h25m34.57144682s) [upload=261488]: Uploading segments... Aug 19 04:51:40.140413058 (251h25m34.571493189s) [upload=261488]: Got next segment. Inline: true Aug 19 04:51:40.140417165 (251h25m34.571497296s) [upload=261488]: Waiting for error group managing segments... Aug 19 04:51:40.140452172 (251h25m34.571532303s) [upload=261488]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:51:40.140458295 (251h25m34.571538426s) [upload=261488]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 04:51:40.140460799 (251h25m34.57154093s) [upload=261488]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 04:51:40.428150560 (251h25m34.859230691s) [upload=261488]: Done uploading segments... Aug 19 04:51:40.428167813 (251h25m34.859247934s) [upload=261488]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.822650161s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 3 out of 60 is failed (threshold=3) [........................................X.....X............X] duration: 4.192543293s FAIL (2025-08-19 05:09:14 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: object not found ("orbiter_us_0/4M") ======LOGS====== Aug 19 05:09:11.386254861 (251h43m5.817334982s) [upload=261787]: Starting upload Aug 19 05:09:11.386321348 (251h43m5.817401469s) [upload=261787]: Done starting upload Aug 19 05:09:11.386407303 (251h43m5.817487434s) [upload=261787]: Uploading segments... Aug 19 05:09:11.386516612 (251h43m5.817596743s) [upload=261787]: Got next segment. Inline: false Aug 19 05:09:11.386552742 (251h43m5.817632863s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 05:09:11.386559414 (251h43m5.817639545s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 05:09:11.834890261 (251h43m6.265970392s) [seg_pos={0 0}, upload=261787]: Begin upload segment... Aug 19 05:09:11.834930347 (251h43m6.266010478s) [seg_pos={0 0}, upload=261787]: Done begin upload segment. Aug 19 05:09:11.834974011 (251h43m6.266054142s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835375028 (251h43m6.266455159s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835538070 (251h43m6.266618201s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835705821 (251h43m6.266785952s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.835973453 (251h43m6.267053584s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836265933 (251h43m6.267346064s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836276182 (251h43m6.267356313s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836598940 (251h43m6.267679071s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836634258 (251h43m6.267714389s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.836912620 (251h43m6.267992751s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837172388 (251h43m6.268252509s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837390996 (251h43m6.268471127s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837598462 (251h43m6.268678593s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.837826179 (251h43m6.26890631s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838040359 (251h43m6.26912049s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838241463 (251h43m6.269321594s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838462406 (251h43m6.269542537s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:11.838913720 (251h43m6.269993851s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Uploading piece... Aug 19 05:09:13.313230483 (251h43m7.744310624s) [upload=261787]: Next returned nil segment Aug 19 05:09:13.313249379 (251h43m7.74432952s) [upload=261787]: Waiting for error group managing segments... Aug 19 05:09:13.687728957 (251h43m8.118809089s) [noise=true , address=79.127.220.98:4430 , piece_id=7Q6RMFR5OUM5YYBNIFKG23IYTK7LLVNYXSJ4474H3TGZQDLEHGYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.709661914 (251h43m8.140742035s) [noise=true , address=79.127.219.48:4077 , piece_id=23MWCEPFNT35R6WCECDJV7ZAHXAZIOHHVYIGNXN5JKEAABZTKU4Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.721922564 (251h43m8.153002695s) [noise=true , address=79.127.219.51:4199 , piece_id=OWKCS6UQKLI2JJDYXAZOP54TBT7MPWD3FJJLUE33W5GP343VFROQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.756509633 (251h43m8.187589754s) [noise=true , address=45.91.116.10:4095 , piece_id=GPSR3IILB26NTWJLNF4MH4OJJNUXVCRH554R3BWKP6TC6JILWOUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.789161020 (251h43m8.220241151s) [noise=true , address=45.91.116.6:4996 , piece_id=LDEG2KJ3MFQKHPK6E6OVWEROJKJOJ2YWSTKPLGFAZLUJTU2JUWGA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.803244097 (251h43m8.234324218s) [noise=true , address=45.91.116.14:4208 , piece_id=NY63G7GQZ7J6K7V7JZI3FNPKKRMFM77KVK7L4SXNHIAZLDJZME6Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.834984259 (251h43m8.26606438s) [noise=true , address=77.90.31.15:4701 , piece_id=4MFN7742M4BZMQR6S3NA3F3NPOXSF6ONO6O5Y2NUUFGJ6PUSMH2A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.842943449 (251h43m8.27402358s) [noise=true , address=104.36.82.18:4383 , piece_id=6WCWFKVJ6NJBZI7Z26SUYN6EJ5ACQKPQDH7SCLSQ2TWHW5ZTV2RA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.874788291 (251h43m8.305868422s) [noise=true , address=77.90.31.17:4788 , piece_id=TMAP2L6IVFGPVS6P2KM4WSIDRDFQ6ZRHRPYMYQS6L2JMKCXFIFBA, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.875188526 (251h43m8.306268657s) [noise=true , address=104.36.82.60:4357 , piece_id=MLUUTDTIVQWC6LBTFGB526A67JTJETATWQKTW7NROGG3EPS75KYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.883263788 (251h43m8.314343919s) [noise=true , address=45.91.116.4:4957 , piece_id=GN4IXLE4AVZVL7HIU5IHPJC3VTDTDO426ZYOAIF42XZQM6LGFI3A, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.898508016 (251h43m8.329588148s) [noise=true , address=104.36.82.23:4472 , piece_id=PH2Y4CFOKXM3HIH3XRDZGAH7YZH5PCJ2J5572BD3B4RZBIMSURVQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.899690921 (251h43m8.330771052s) [noise=true , address=79.127.201.215:4360 , piece_id=E7GWOTGTVCG7Y4SOU6TMU5ACGVJTUXTA2ARJNCH2LGZTPI4TKD7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961706813 (251h43m8.392786934s) [noise=true , address=77.90.31.19:4866 , piece_id=I7LBEK542HP7CJ5W5DV47L2OWDRB537VSX5JTSED3YPCKPZZQDYQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: <nil> Aug 19 05:09:13.961733925 (251h43m8.392814056s) [seg_pos={0 0}, upload=261787]: Segment reached optimal threshold of 14 pieces. Aug 19 05:09:13.961909691 (251h43m8.392989832s) [noise=true , address=77.90.31.11:4563 , piece_id=LEPGUKJVNLPWQFIVZB3QRWFNCF2I3MD6UOQULPEIP5325GZFW5TQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12bCw4Dx7aFbxT7TeUKezRzHD4yQWYXXNJVgFfF3FGhnkVVk9Jb): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962008531 (251h43m8.393088662s) [noise=true , address=45.91.116.13:4163 , piece_id=FSBFYTED4T3D52WDHB6FE3Z2WIAHLN4HHUEE7R2FNKU7FAGAZLUQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1hRpjHEvHzBoYqq6DXKC5Z3SPsP4HEZz2tAiuheHkgzzcnsVU2): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962017918 (251h43m8.393098049s) [noise=true , address=104.36.82.44:4886 , piece_id=YRYRBG5F2G3BHQVFI2MKJTX6SCV3ELIDBXLBWSS24AQJPGNA2A7Q, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1n2cXhqd5EWbNPTXem83jQUjYq5ZaGKBidbVCQzxYfR3rWddGR): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962068645 (251h43m8.393148776s) [noise=true , address=77.90.31.13:4656 , piece_id=QFO5PGVENCSWIGDW32Q7MLPCO34OWLK75RW2SA7M7VRNLMZGDVRQ, seg_pos={0 0}, upload=261787]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12CEXqfegKNoaZ516cRAYvaMBygJVdMtvyrArc85zK3eDQC6tXN): protocol: expected piece hash; context canceled; EOF Aug 19 05:09:13.962084104 (251h43m8.393164235s) [seg_pos={0 0}, upload=261787]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Aug 19 05:09:13.962142396 (251h43m8.393222527s) [upload=261787]: Flush batch item: pb.BatchRequestItem_SegmentCommit Aug 19 05:09:13.962145853 (251h43m8.393225984s) [upload=261787]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 05:09:14.249509942 (251h43m8.680590073s) [upload=261787]: Done uploading segments... Aug 19 05:09:14.249531253 (251h43m8.680611384s) [upload=261787]: Upload finished. err: <nil> Duration: 4.192567429s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [..................................XX........................] duration: 1.835168105s FAIL (2025-08-19 05:09:09 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:51:40.140222723 (251h25m34.571302855s) [upload=261488]: Starting upload Aug 19 04:51:40.140280544 (251h25m34.571360675s) [upload=261488]: Done starting upload Aug 19 04:51:40.140366689 (251h25m34.57144682s) [upload=261488]: Uploading segments... Aug 19 04:51:40.140413058 (251h25m34.571493189s) [upload=261488]: Got next segment. Inline: true Aug 19 04:51:40.140417165 (251h25m34.571497296s) [upload=261488]: Waiting for error group managing segments... Aug 19 04:51:40.140452172 (251h25m34.571532303s) [upload=261488]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:51:40.140458295 (251h25m34.571538426s) [upload=261488]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 04:51:40.140460799 (251h25m34.57154093s) [upload=261488]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 04:51:40.428150560 (251h25m34.859230691s) [upload=261488]: Done uploading segments... Aug 19 04:51:40.428167813 (251h25m34.859247934s) [upload=261488]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.835192613s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............X...............................................] duration: 2.183872995s FAIL (2025-08-19 05:09:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.183893224s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [.........................................X.....X............] duration: 6.00844316s FAIL (2025-08-19 05:08:44 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:58:44.132662644 (251h32m38.563742775s) [upload=261616]: Starting upload Aug 19 04:58:44.132726006 (251h32m38.563806137s) [upload=261616]: Done starting upload Aug 19 04:58:44.132826327 (251h32m38.563906458s) [upload=261616]: Uploading segments... Aug 19 04:58:44.133001823 (251h32m38.564081964s) [upload=261616]: Got next segment. Inline: false Aug 19 04:58:44.133053302 (251h32m38.564133433s) [upload=261616]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:58:44.133059093 (251h32m38.564139224s) [upload=261616]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:58:44.348901058 (251h32m38.779981189s) [upload=261616]: Next segment err: metaclient: Too Many Requests Aug 19 04:58:44.348928621 (251h32m38.780008752s) [upload=261616]: Done uploading segments... Aug 19 04:58:44.348940144 (251h32m38.780020275s) [upload=261616]: Upload finished. err: metaclient: Too Many Requests Duration: 6.008471444s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 2 out of 60 is failed (threshold=3) [...................................XX.......................] duration: 1.961755824s FAIL (2025-08-19 05:08:22 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:51:40.140222723 (251h25m34.571302855s) [upload=261488]: Starting upload Aug 19 04:51:40.140280544 (251h25m34.571360675s) [upload=261488]: Done starting upload Aug 19 04:51:40.140366689 (251h25m34.57144682s) [upload=261488]: Uploading segments... Aug 19 04:51:40.140413058 (251h25m34.571493189s) [upload=261488]: Got next segment. Inline: true Aug 19 04:51:40.140417165 (251h25m34.571497296s) [upload=261488]: Waiting for error group managing segments... Aug 19 04:51:40.140452172 (251h25m34.571532303s) [upload=261488]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:51:40.140458295 (251h25m34.571538426s) [upload=261488]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 04:51:40.140460799 (251h25m34.57154093s) [upload=261488]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 04:51:40.428150560 (251h25m34.859230691s) [upload=261488]: Done uploading segments... Aug 19 04:51:40.428167813 (251h25m34.859247934s) [upload=261488]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.961784467s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............X..............................................] duration: 2.290074893s FAIL (2025-08-19 05:08:08 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.290095273s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote) antiblip: 2 out of 60 is failed (threshold=3) [..........................................X.....X...........] duration: 5.627688356s FAIL (2025-08-19 05:07:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:58:44.132662644 (251h32m38.563742775s) [upload=261616]: Starting upload Aug 19 04:58:44.132726006 (251h32m38.563806137s) [upload=261616]: Done starting upload Aug 19 04:58:44.132826327 (251h32m38.563906458s) [upload=261616]: Uploading segments... Aug 19 04:58:44.133001823 (251h32m38.564081964s) [upload=261616]: Got next segment. Inline: false Aug 19 04:58:44.133053302 (251h32m38.564133433s) [upload=261616]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:58:44.133059093 (251h32m38.564139224s) [upload=261616]: Flush batch item: pb.BatchRequestItem_SegmentBegin Aug 19 04:58:44.348901058 (251h32m38.779981189s) [upload=261616]: Next segment err: metaclient: Too Many Requests Aug 19 04:58:44.348928621 (251h32m38.780008752s) [upload=261616]: Done uploading segments... Aug 19 04:58:44.348940144 (251h32m38.780020275s) [upload=261616]: Upload finished. err: metaclient: Too Many Requests Duration: 5.627713293s core uplink us-select-1 us1-placement-20 metainfo-projects
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline) antiblip: 3 out of 60 is failed (threshold=3) [X...................................XX......................] duration: 1.818606695s FAIL (2025-08-19 05:07:38 UTC) orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 19 04:51:40.140222723 (251h25m34.571302855s) [upload=261488]: Starting upload Aug 19 04:51:40.140280544 (251h25m34.571360675s) [upload=261488]: Done starting upload Aug 19 04:51:40.140366689 (251h25m34.57144682s) [upload=261488]: Uploading segments... Aug 19 04:51:40.140413058 (251h25m34.571493189s) [upload=261488]: Got next segment. Inline: true Aug 19 04:51:40.140417165 (251h25m34.571497296s) [upload=261488]: Waiting for error group managing segments... Aug 19 04:51:40.140452172 (251h25m34.571532303s) [upload=261488]: Flush batch item: pb.BatchRequestItem_ObjectBegin Aug 19 04:51:40.140458295 (251h25m34.571538426s) [upload=261488]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Aug 19 04:51:40.140460799 (251h25m34.57154093s) [upload=261488]: Flush batch item: pb.BatchRequestItem_ObjectCommit Aug 19 04:51:40.428150560 (251h25m34.859230691s) [upload=261488]: Done uploading segments... Aug 19 04:51:40.428167813 (251h25m34.859247934s) [upload=261488]: Upload finished. err: metaclient: Too Many Requests Duration:* 1.818633567s core uplink us-select-1 us1-placement-20 metainfo-projects

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)