Orbiter: EU/US/AP/EDGE | Code | Config | Playbook | Escalation Procedure
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [............X.X.....X..................X....X......X..X.....] duration:
5.634537391s
FAIL (2025-08-20 20:00:40 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 20 19:56:45.926480516 (290h30m40.357560647s) [upload=302117]: Starting upload
Aug 20 19:56:45.926528679 (290h30m40.35760881s) [upload=302117]: Done starting upload
Aug 20 19:56:45.926642687 (290h30m40.357722808s) [upload=302117]: Uploading segments...
Aug 20 19:56:45.926700177 (290h30m40.357780308s) [upload=302117]: Got next segment. Inline: false
Aug 20 19:56:45.926726707 (290h30m40.357806838s) [upload=302117]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:56:45.926730936 (290h30m40.357811067s) [upload=302117]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:56:46.405932573 (290h30m40.837012704s) [seg_pos={0 0}, upload=302117]: Begin upload segment...
Aug 20 19:56:46.405996124 (290h30m40.837076255s) [seg_pos={0 0}, upload=302117]: Done begin upload segment.
Aug 20 19:56:46.406016974 (290h30m40.837097105s) [noise=true , address=104.36.82.45:4912 , piece_id=O7SV66TED6H4BYWKBFCS5FWJEXDNGGZIF4WDU6R2URDBAEJBZ4MQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406028476 (290h30m40.837108607s) [noise=true , address=79.127.219.47:4052 , piece_id=CHRYZMD4TBSJIB7AAYWSXPQXRH7EXNDI62HTWWWSUXIGER5XE5VQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406540887 (290h30m40.837621008s) [noise=true , address=77.90.31.18:4829 , piece_id=PUL7FTNP43XSFVZKXGVXNEIKLEEBWC3TOKXV3FWCTXD33FXLW5JQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406552959 (290h30m40.83763308s) [noise=true , address=77.90.31.19:4874 , piece_id=NTTQX3MOV63GFRLHIBGNWK47DGC5DGMFQXVEJOGRRASANMXS6P6Q, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406910894 (290h30m40.837991025s) [noise=true , address=77.90.31.15:4725 , piece_id=VFAKRC6KM44B5Y3WJN5ZL4LCCTOPXL3PQU7ECGVC5XPIID2EHXXQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406960369 (290h30m40.8380405s) [noise=true , address=45.91.116.14:4203 , piece_id=FIUBFSOVURCKR24NGIVV3Q36DJOWXGLL5BEF3DWTNPE3DFF3ANMA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407268388 (290h30m40.838348519s) [noise=true , address=104.36.82.37:4661 , piece_id=BAEJ5XHLFL6XCTL34L2Y7IS6H7UGCTHNKMPQLS47E2QGJS4F6X2A, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407348020 (290h30m40.838428152s) [noise=true , address=77.90.31.18:4831 , piece_id=SEFZMAOPZRJNJGNE7K7FAB66FAFOLM2MZJAFSOMFUB2TTEX7VJLA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407610553 (290h30m40.838690684s) [noise=true , address=104.36.82.60:4350 , piece_id=WCI6ZHFQUORHOBWHVR2VYMLRFQKXSRSHYLBX5N7LWAEXKDMBMW2Q, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407697980 (290h30m40.838778101s) [noise=true , address=77.90.31.10:4548 , piece_id=FWXVHFIUZDBSECT3XYL4NJOWK7JSTSWWY7FC5AMVFJ6RYPJL67GA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407895899 (290h30m40.83897603s) [noise=true , address=104.36.82.61:4407 , piece_id=PNO3E5IENODHJJ3VBPQZIVBSJUMHIRUL2NWVKSC5CUC3SZU5EJHA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407976333 (290h30m40.839056464s) [noise=true , address=79.127.205.235:4682 , piece_id=BO2N56W4TTGIGJZNCPFPJARTEIRHDX243K6DSD6MPHRZJIOTQOLA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408211293 (290h30m40.839291414s) [noise=true , address=77.90.31.11:4570 , piece_id=T6BL5ELP44MCL5HDRJABGB4QEYOK72R4INCH5SJKJASC5NDCXDMQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408352232 (290h30m40.839432353s) [noise=true , address=77.90.31.12:4606 , piece_id=N6TNFQBP3KLPO4IUZLYS6GRUXJ2ARCRJTM7AY2MUICN7QIJ3GXVA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408503050 (290h30m40.839583181s) [noise=true , address=45.91.116.12:4255 , piece_id=GMJZWXNBEYK5JVDOL7MTWYM5A6N4EOQHS3D4JLIWSYPXRDWBS73A, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408706150 (290h30m40.839786281s) [noise=true , address=104.36.82.11:4128 , piece_id=RH3EQMLH6B7UEZ4KKXUXIS3KLGFA3TTEAAT4CNM7UF6WGS73LZ6Q, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408793937 (290h30m40.839874068s) [noise=true , address=77.90.31.19:4865 , piece_id=BCI3LHXCGAXXI7XYMG7ZKPG4Z5XEISPFNVJODPOF5AMV73YHQKAQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408984783 (290h30m40.840064914s) [noise=true , address=104.36.82.23:4474 , piece_id=DHNXO53Z45ZP7OYG3UDCBQHD3HZ6576WEFBL6TJGINC7HD7XCHAA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:47.546960553 (290h30m41.978040684s) [upload=302117]: Next returned nil segment
Aug 20 19:56:47.546977915 (290h30m41.978058036s) [upload=302117]: Waiting for error group managing segments...
Aug 20 19:56:47.859670921 (290h30m42.290751052s) [noise=true , address=79.127.205.235:4682 , piece_id=BO2N56W4TTGIGJZNCPFPJARTEIRHDX243K6DSD6MPHRZJIOTQOLA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.332936680 (290h30m42.764016811s) [noise=true , address=77.90.31.15:4725 , piece_id=VFAKRC6KM44B5Y3WJN5ZL4LCCTOPXL3PQU7ECGVC5XPIID2EHXXQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.343858005 (290h30m42.774938127s) [noise=true , address=77.90.31.18:4829 , piece_id=PUL7FTNP43XSFVZKXGVXNEIKLEEBWC3TOKXV3FWCTXD33FXLW5JQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.355374261 (290h30m42.786454382s) [noise=true , address=77.90.31.19:4865 , piece_id=BCI3LHXCGAXXI7XYMG7ZKPG4Z5XEISPFNVJODPOF5AMV73YHQKAQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.357989975 (290h30m42.789070126s) [noise=true , address=79.127.219.47:4052 , piece_id=CHRYZMD4TBSJIB7AAYWSXPQXRH7EXNDI62HTWWWSUXIGER5XE5VQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.378251352 (290h30m42.809331483s) [noise=true , address=104.36.82.37:4661 , piece_id=BAEJ5XHLFL6XCTL34L2Y7IS6H7UGCTHNKMPQLS47E2QGJS4F6X2A, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.388793625 (290h30m42.819873756s) [noise=true , address=45.91.116.12:4255 , piece_id=GMJZWXNBEYK5JVDOL7MTWYM5A6N4EOQHS3D4JLIWSYPXRDWBS73A, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.398301596 (290h30m42.829381727s) [noise=true , address=104.36.82.60:4350 , piece_id=WCI6ZHFQUORHOBWHVR2VYMLRFQKXSRSHYLBX5N7LWAEXKDMBMW2Q, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.430115318 (290h30m42.861195449s) [noise=true , address=45.91.116.14:4203 , piece_id=FIUBFSOVURCKR24NGIVV3Q36DJOWXGLL5BEF3DWTNPE3DFF3ANMA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.470970648 (290h30m42.902050779s) [noise=true , address=104.36.82.23:4474 , piece_id=DHNXO53Z45ZP7OYG3UDCBQHD3HZ6576WEFBL6TJGINC7HD7XCHAA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.473835110 (290h30m42.904915231s) [noise=true , address=77.90.31.19:4874 , piece_id=NTTQX3MOV63GFRLHIBGNWK47DGC5DGMFQXVEJOGRRASANMXS6P6Q, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.500135622 (290h30m42.931215753s) [noise=true , address=77.90.31.10:4548 , piece_id=FWXVHFIUZDBSECT3XYL4NJOWK7JSTSWWY7FC5AMVFJ6RYPJL67GA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.504234083 (290h30m42.935314204s) [noise=true , address=77.90.31.18:4831 , piece_id=SEFZMAOPZRJNJGNE7K7FAB66FAFOLM2MZJAFSOMFUB2TTEX7VJLA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.510783305 (290h30m42.941863426s) [noise=true , address=77.90.31.11:4570 , piece_id=T6BL5ELP44MCL5HDRJABGB4QEYOK72R4INCH5SJKJASC5NDCXDMQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.510800156 (290h30m42.941880287s) [seg_pos={0 0}, upload=302117]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:56:48.510883416 (290h30m42.941963547s) [noise=true , address=104.36.82.45:4912 , piece_id=O7SV66TED6H4BYWKBFCS5FWJEXDNGGZIF4WDU6R2URDBAEJBZ4MQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HnqBnErwajHUpuLrYCmCg7cbJYMQohVM2pQbHZ9LFCvjye39x): protocol: expected piece hash; context canceled; EOF
Aug 20 19:56:48.510950495 (290h30m42.942030626s) [noise=true , address=104.36.82.61:4407 , piece_id=PNO3E5IENODHJJ3VBPQZIVBSJUMHIRUL2NWVKSC5CUC3SZU5EJHA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122k7b6wa2JhSXMVAhF4qPKA48cWkh3DZRyWuwPEt7Vp3ciofPF): protocol: expected piece hash; context canceled; EOF
Aug 20 19:56:48.511146239 (290h30m42.94222636s) [noise=true , address=104.36.82.11:4128 , piece_id=RH3EQMLH6B7UEZ4KKXUXIS3KLGFA3TTEAAT4CNM7UF6WGS73LZ6Q, seg_pos={0 0}, upload=302117]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wABkAtAjoYkKyNoAiaVCxSvY6WgvHvAYFPCjpNojtpiYiGtDS): protocol: expected piece hash; context canceled; EOF
Aug 20 19:56:48.511267170 (290h30m42.942347301s) [noise=true , address=77.90.31.12:4606 , piece_id=N6TNFQBP3KLPO4IUZLYS6GRUXJ2ARCRJTM7AY2MUICN7QIJ3GXVA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pLKmTja7ttT6vqjq8vHMYR9RLfnpqxY9xm9GDBG8ez9aHujs): protocol: write tcp 188.166.225.170:50622->77.90.31.12:4606: use of closed network connection; write tcp 188.166.225.170:50622->77.90.31.12:4606: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50622->77.90.31.12:4606: use of closed network connection
Aug 20 19:56:48.511278352 (290h30m42.942358473s) [seg_pos={0 0}, upload=302117]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:56:48.511365969 (290h30m42.9424461s) [upload=302117]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:56:48.511370247 (290h30m42.942450378s) [upload=302117]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:56:48.827512752 (290h30m43.258592883s) [upload=302117]: Done uploading segments...
Aug 20 19:56:48.827549673 (290h30m43.258629805s) [upload=302117]: Upload finished. err: <nil>
Duration: 5.634567598s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.X.....................X....................................] duration:
1.89204687s
FAIL (2025-08-20 20:00:29 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.892076087s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [.............X.X.....X..................X....X......X..X....] duration:
5.773096895s
FAIL (2025-08-20 19:59:36 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 20 19:56:45.926480516 (290h30m40.357560647s) [upload=302117]: Starting upload
Aug 20 19:56:45.926528679 (290h30m40.35760881s) [upload=302117]: Done starting upload
Aug 20 19:56:45.926642687 (290h30m40.357722808s) [upload=302117]: Uploading segments...
Aug 20 19:56:45.926700177 (290h30m40.357780308s) [upload=302117]: Got next segment. Inline: false
Aug 20 19:56:45.926726707 (290h30m40.357806838s) [upload=302117]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:56:45.926730936 (290h30m40.357811067s) [upload=302117]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:56:46.405932573 (290h30m40.837012704s) [seg_pos={0 0}, upload=302117]: Begin upload segment...
Aug 20 19:56:46.405996124 (290h30m40.837076255s) [seg_pos={0 0}, upload=302117]: Done begin upload segment.
Aug 20 19:56:46.406016974 (290h30m40.837097105s) [noise=true , address=104.36.82.45:4912 , piece_id=O7SV66TED6H4BYWKBFCS5FWJEXDNGGZIF4WDU6R2URDBAEJBZ4MQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406028476 (290h30m40.837108607s) [noise=true , address=79.127.219.47:4052 , piece_id=CHRYZMD4TBSJIB7AAYWSXPQXRH7EXNDI62HTWWWSUXIGER5XE5VQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406540887 (290h30m40.837621008s) [noise=true , address=77.90.31.18:4829 , piece_id=PUL7FTNP43XSFVZKXGVXNEIKLEEBWC3TOKXV3FWCTXD33FXLW5JQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406552959 (290h30m40.83763308s) [noise=true , address=77.90.31.19:4874 , piece_id=NTTQX3MOV63GFRLHIBGNWK47DGC5DGMFQXVEJOGRRASANMXS6P6Q, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406910894 (290h30m40.837991025s) [noise=true , address=77.90.31.15:4725 , piece_id=VFAKRC6KM44B5Y3WJN5ZL4LCCTOPXL3PQU7ECGVC5XPIID2EHXXQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406960369 (290h30m40.8380405s) [noise=true , address=45.91.116.14:4203 , piece_id=FIUBFSOVURCKR24NGIVV3Q36DJOWXGLL5BEF3DWTNPE3DFF3ANMA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407268388 (290h30m40.838348519s) [noise=true , address=104.36.82.37:4661 , piece_id=BAEJ5XHLFL6XCTL34L2Y7IS6H7UGCTHNKMPQLS47E2QGJS4F6X2A, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407348020 (290h30m40.838428152s) [noise=true , address=77.90.31.18:4831 , piece_id=SEFZMAOPZRJNJGNE7K7FAB66FAFOLM2MZJAFSOMFUB2TTEX7VJLA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407610553 (290h30m40.838690684s) [noise=true , address=104.36.82.60:4350 , piece_id=WCI6ZHFQUORHOBWHVR2VYMLRFQKXSRSHYLBX5N7LWAEXKDMBMW2Q, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407697980 (290h30m40.838778101s) [noise=true , address=77.90.31.10:4548 , piece_id=FWXVHFIUZDBSECT3XYL4NJOWK7JSTSWWY7FC5AMVFJ6RYPJL67GA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407895899 (290h30m40.83897603s) [noise=true , address=104.36.82.61:4407 , piece_id=PNO3E5IENODHJJ3VBPQZIVBSJUMHIRUL2NWVKSC5CUC3SZU5EJHA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407976333 (290h30m40.839056464s) [noise=true , address=79.127.205.235:4682 , piece_id=BO2N56W4TTGIGJZNCPFPJARTEIRHDX243K6DSD6MPHRZJIOTQOLA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408211293 (290h30m40.839291414s) [noise=true , address=77.90.31.11:4570 , piece_id=T6BL5ELP44MCL5HDRJABGB4QEYOK72R4INCH5SJKJASC5NDCXDMQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408352232 (290h30m40.839432353s) [noise=true , address=77.90.31.12:4606 , piece_id=N6TNFQBP3KLPO4IUZLYS6GRUXJ2ARCRJTM7AY2MUICN7QIJ3GXVA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408503050 (290h30m40.839583181s) [noise=true , address=45.91.116.12:4255 , piece_id=GMJZWXNBEYK5JVDOL7MTWYM5A6N4EOQHS3D4JLIWSYPXRDWBS73A, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408706150 (290h30m40.839786281s) [noise=true , address=104.36.82.11:4128 , piece_id=RH3EQMLH6B7UEZ4KKXUXIS3KLGFA3TTEAAT4CNM7UF6WGS73LZ6Q, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408793937 (290h30m40.839874068s) [noise=true , address=77.90.31.19:4865 , piece_id=BCI3LHXCGAXXI7XYMG7ZKPG4Z5XEISPFNVJODPOF5AMV73YHQKAQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408984783 (290h30m40.840064914s) [noise=true , address=104.36.82.23:4474 , piece_id=DHNXO53Z45ZP7OYG3UDCBQHD3HZ6576WEFBL6TJGINC7HD7XCHAA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:47.546960553 (290h30m41.978040684s) [upload=302117]: Next returned nil segment
Aug 20 19:56:47.546977915 (290h30m41.978058036s) [upload=302117]: Waiting for error group managing segments...
Aug 20 19:56:47.859670921 (290h30m42.290751052s) [noise=true , address=79.127.205.235:4682 , piece_id=BO2N56W4TTGIGJZNCPFPJARTEIRHDX243K6DSD6MPHRZJIOTQOLA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.332936680 (290h30m42.764016811s) [noise=true , address=77.90.31.15:4725 , piece_id=VFAKRC6KM44B5Y3WJN5ZL4LCCTOPXL3PQU7ECGVC5XPIID2EHXXQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.343858005 (290h30m42.774938127s) [noise=true , address=77.90.31.18:4829 , piece_id=PUL7FTNP43XSFVZKXGVXNEIKLEEBWC3TOKXV3FWCTXD33FXLW5JQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.355374261 (290h30m42.786454382s) [noise=true , address=77.90.31.19:4865 , piece_id=BCI3LHXCGAXXI7XYMG7ZKPG4Z5XEISPFNVJODPOF5AMV73YHQKAQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.357989975 (290h30m42.789070126s) [noise=true , address=79.127.219.47:4052 , piece_id=CHRYZMD4TBSJIB7AAYWSXPQXRH7EXNDI62HTWWWSUXIGER5XE5VQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.378251352 (290h30m42.809331483s) [noise=true , address=104.36.82.37:4661 , piece_id=BAEJ5XHLFL6XCTL34L2Y7IS6H7UGCTHNKMPQLS47E2QGJS4F6X2A, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.388793625 (290h30m42.819873756s) [noise=true , address=45.91.116.12:4255 , piece_id=GMJZWXNBEYK5JVDOL7MTWYM5A6N4EOQHS3D4JLIWSYPXRDWBS73A, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.398301596 (290h30m42.829381727s) [noise=true , address=104.36.82.60:4350 , piece_id=WCI6ZHFQUORHOBWHVR2VYMLRFQKXSRSHYLBX5N7LWAEXKDMBMW2Q, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.430115318 (290h30m42.861195449s) [noise=true , address=45.91.116.14:4203 , piece_id=FIUBFSOVURCKR24NGIVV3Q36DJOWXGLL5BEF3DWTNPE3DFF3ANMA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.470970648 (290h30m42.902050779s) [noise=true , address=104.36.82.23:4474 , piece_id=DHNXO53Z45ZP7OYG3UDCBQHD3HZ6576WEFBL6TJGINC7HD7XCHAA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.473835110 (290h30m42.904915231s) [noise=true , address=77.90.31.19:4874 , piece_id=NTTQX3MOV63GFRLHIBGNWK47DGC5DGMFQXVEJOGRRASANMXS6P6Q, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.500135622 (290h30m42.931215753s) [noise=true , address=77.90.31.10:4548 , piece_id=FWXVHFIUZDBSECT3XYL4NJOWK7JSTSWWY7FC5AMVFJ6RYPJL67GA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.504234083 (290h30m42.935314204s) [noise=true , address=77.90.31.18:4831 , piece_id=SEFZMAOPZRJNJGNE7K7FAB66FAFOLM2MZJAFSOMFUB2TTEX7VJLA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.510783305 (290h30m42.941863426s) [noise=true , address=77.90.31.11:4570 , piece_id=T6BL5ELP44MCL5HDRJABGB4QEYOK72R4INCH5SJKJASC5NDCXDMQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.510800156 (290h30m42.941880287s) [seg_pos={0 0}, upload=302117]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:56:48.510883416 (290h30m42.941963547s) [noise=true , address=104.36.82.45:4912 , piece_id=O7SV66TED6H4BYWKBFCS5FWJEXDNGGZIF4WDU6R2URDBAEJBZ4MQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HnqBnErwajHUpuLrYCmCg7cbJYMQohVM2pQbHZ9LFCvjye39x): protocol: expected piece hash; context canceled; EOF
Aug 20 19:56:48.510950495 (290h30m42.942030626s) [noise=true , address=104.36.82.61:4407 , piece_id=PNO3E5IENODHJJ3VBPQZIVBSJUMHIRUL2NWVKSC5CUC3SZU5EJHA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122k7b6wa2JhSXMVAhF4qPKA48cWkh3DZRyWuwPEt7Vp3ciofPF): protocol: expected piece hash; context canceled; EOF
Aug 20 19:56:48.511146239 (290h30m42.94222636s) [noise=true , address=104.36.82.11:4128 , piece_id=RH3EQMLH6B7UEZ4KKXUXIS3KLGFA3TTEAAT4CNM7UF6WGS73LZ6Q, seg_pos={0 0}, upload=302117]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wABkAtAjoYkKyNoAiaVCxSvY6WgvHvAYFPCjpNojtpiYiGtDS): protocol: expected piece hash; context canceled; EOF
Aug 20 19:56:48.511267170 (290h30m42.942347301s) [noise=true , address=77.90.31.12:4606 , piece_id=N6TNFQBP3KLPO4IUZLYS6GRUXJ2ARCRJTM7AY2MUICN7QIJ3GXVA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pLKmTja7ttT6vqjq8vHMYR9RLfnpqxY9xm9GDBG8ez9aHujs): protocol: write tcp 188.166.225.170:50622->77.90.31.12:4606: use of closed network connection; write tcp 188.166.225.170:50622->77.90.31.12:4606: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50622->77.90.31.12:4606: use of closed network connection
Aug 20 19:56:48.511278352 (290h30m42.942358473s) [seg_pos={0 0}, upload=302117]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:56:48.511365969 (290h30m42.9424461s) [upload=302117]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:56:48.511370247 (290h30m42.942450378s) [upload=302117]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:56:48.827512752 (290h30m43.258592883s) [upload=302117]: Done uploading segments...
Aug 20 19:56:48.827549673 (290h30m43.258629805s) [upload=302117]: Upload finished. err: <nil>
Duration: 5.773126962s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [..X.....................X...................................] duration:
1.948334248s
FAIL (2025-08-20 19:59:35 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.948351342s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [..............X.X.....X..................X....X......X..X...] duration:
6.011506489s
FAIL (2025-08-20 19:59:02 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 20 19:56:45.926480516 (290h30m40.357560647s) [upload=302117]: Starting upload
Aug 20 19:56:45.926528679 (290h30m40.35760881s) [upload=302117]: Done starting upload
Aug 20 19:56:45.926642687 (290h30m40.357722808s) [upload=302117]: Uploading segments...
Aug 20 19:56:45.926700177 (290h30m40.357780308s) [upload=302117]: Got next segment. Inline: false
Aug 20 19:56:45.926726707 (290h30m40.357806838s) [upload=302117]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:56:45.926730936 (290h30m40.357811067s) [upload=302117]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:56:46.405932573 (290h30m40.837012704s) [seg_pos={0 0}, upload=302117]: Begin upload segment...
Aug 20 19:56:46.405996124 (290h30m40.837076255s) [seg_pos={0 0}, upload=302117]: Done begin upload segment.
Aug 20 19:56:46.406016974 (290h30m40.837097105s) [noise=true , address=104.36.82.45:4912 , piece_id=O7SV66TED6H4BYWKBFCS5FWJEXDNGGZIF4WDU6R2URDBAEJBZ4MQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406028476 (290h30m40.837108607s) [noise=true , address=79.127.219.47:4052 , piece_id=CHRYZMD4TBSJIB7AAYWSXPQXRH7EXNDI62HTWWWSUXIGER5XE5VQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406540887 (290h30m40.837621008s) [noise=true , address=77.90.31.18:4829 , piece_id=PUL7FTNP43XSFVZKXGVXNEIKLEEBWC3TOKXV3FWCTXD33FXLW5JQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406552959 (290h30m40.83763308s) [noise=true , address=77.90.31.19:4874 , piece_id=NTTQX3MOV63GFRLHIBGNWK47DGC5DGMFQXVEJOGRRASANMXS6P6Q, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406910894 (290h30m40.837991025s) [noise=true , address=77.90.31.15:4725 , piece_id=VFAKRC6KM44B5Y3WJN5ZL4LCCTOPXL3PQU7ECGVC5XPIID2EHXXQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406960369 (290h30m40.8380405s) [noise=true , address=45.91.116.14:4203 , piece_id=FIUBFSOVURCKR24NGIVV3Q36DJOWXGLL5BEF3DWTNPE3DFF3ANMA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407268388 (290h30m40.838348519s) [noise=true , address=104.36.82.37:4661 , piece_id=BAEJ5XHLFL6XCTL34L2Y7IS6H7UGCTHNKMPQLS47E2QGJS4F6X2A, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407348020 (290h30m40.838428152s) [noise=true , address=77.90.31.18:4831 , piece_id=SEFZMAOPZRJNJGNE7K7FAB66FAFOLM2MZJAFSOMFUB2TTEX7VJLA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407610553 (290h30m40.838690684s) [noise=true , address=104.36.82.60:4350 , piece_id=WCI6ZHFQUORHOBWHVR2VYMLRFQKXSRSHYLBX5N7LWAEXKDMBMW2Q, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407697980 (290h30m40.838778101s) [noise=true , address=77.90.31.10:4548 , piece_id=FWXVHFIUZDBSECT3XYL4NJOWK7JSTSWWY7FC5AMVFJ6RYPJL67GA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407895899 (290h30m40.83897603s) [noise=true , address=104.36.82.61:4407 , piece_id=PNO3E5IENODHJJ3VBPQZIVBSJUMHIRUL2NWVKSC5CUC3SZU5EJHA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407976333 (290h30m40.839056464s) [noise=true , address=79.127.205.235:4682 , piece_id=BO2N56W4TTGIGJZNCPFPJARTEIRHDX243K6DSD6MPHRZJIOTQOLA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408211293 (290h30m40.839291414s) [noise=true , address=77.90.31.11:4570 , piece_id=T6BL5ELP44MCL5HDRJABGB4QEYOK72R4INCH5SJKJASC5NDCXDMQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408352232 (290h30m40.839432353s) [noise=true , address=77.90.31.12:4606 , piece_id=N6TNFQBP3KLPO4IUZLYS6GRUXJ2ARCRJTM7AY2MUICN7QIJ3GXVA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408503050 (290h30m40.839583181s) [noise=true , address=45.91.116.12:4255 , piece_id=GMJZWXNBEYK5JVDOL7MTWYM5A6N4EOQHS3D4JLIWSYPXRDWBS73A, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408706150 (290h30m40.839786281s) [noise=true , address=104.36.82.11:4128 , piece_id=RH3EQMLH6B7UEZ4KKXUXIS3KLGFA3TTEAAT4CNM7UF6WGS73LZ6Q, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408793937 (290h30m40.839874068s) [noise=true , address=77.90.31.19:4865 , piece_id=BCI3LHXCGAXXI7XYMG7ZKPG4Z5XEISPFNVJODPOF5AMV73YHQKAQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408984783 (290h30m40.840064914s) [noise=true , address=104.36.82.23:4474 , piece_id=DHNXO53Z45ZP7OYG3UDCBQHD3HZ6576WEFBL6TJGINC7HD7XCHAA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:47.546960553 (290h30m41.978040684s) [upload=302117]: Next returned nil segment
Aug 20 19:56:47.546977915 (290h30m41.978058036s) [upload=302117]: Waiting for error group managing segments...
Aug 20 19:56:47.859670921 (290h30m42.290751052s) [noise=true , address=79.127.205.235:4682 , piece_id=BO2N56W4TTGIGJZNCPFPJARTEIRHDX243K6DSD6MPHRZJIOTQOLA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.332936680 (290h30m42.764016811s) [noise=true , address=77.90.31.15:4725 , piece_id=VFAKRC6KM44B5Y3WJN5ZL4LCCTOPXL3PQU7ECGVC5XPIID2EHXXQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.343858005 (290h30m42.774938127s) [noise=true , address=77.90.31.18:4829 , piece_id=PUL7FTNP43XSFVZKXGVXNEIKLEEBWC3TOKXV3FWCTXD33FXLW5JQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.355374261 (290h30m42.786454382s) [noise=true , address=77.90.31.19:4865 , piece_id=BCI3LHXCGAXXI7XYMG7ZKPG4Z5XEISPFNVJODPOF5AMV73YHQKAQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.357989975 (290h30m42.789070126s) [noise=true , address=79.127.219.47:4052 , piece_id=CHRYZMD4TBSJIB7AAYWSXPQXRH7EXNDI62HTWWWSUXIGER5XE5VQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.378251352 (290h30m42.809331483s) [noise=true , address=104.36.82.37:4661 , piece_id=BAEJ5XHLFL6XCTL34L2Y7IS6H7UGCTHNKMPQLS47E2QGJS4F6X2A, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.388793625 (290h30m42.819873756s) [noise=true , address=45.91.116.12:4255 , piece_id=GMJZWXNBEYK5JVDOL7MTWYM5A6N4EOQHS3D4JLIWSYPXRDWBS73A, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.398301596 (290h30m42.829381727s) [noise=true , address=104.36.82.60:4350 , piece_id=WCI6ZHFQUORHOBWHVR2VYMLRFQKXSRSHYLBX5N7LWAEXKDMBMW2Q, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.430115318 (290h30m42.861195449s) [noise=true , address=45.91.116.14:4203 , piece_id=FIUBFSOVURCKR24NGIVV3Q36DJOWXGLL5BEF3DWTNPE3DFF3ANMA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.470970648 (290h30m42.902050779s) [noise=true , address=104.36.82.23:4474 , piece_id=DHNXO53Z45ZP7OYG3UDCBQHD3HZ6576WEFBL6TJGINC7HD7XCHAA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.473835110 (290h30m42.904915231s) [noise=true , address=77.90.31.19:4874 , piece_id=NTTQX3MOV63GFRLHIBGNWK47DGC5DGMFQXVEJOGRRASANMXS6P6Q, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.500135622 (290h30m42.931215753s) [noise=true , address=77.90.31.10:4548 , piece_id=FWXVHFIUZDBSECT3XYL4NJOWK7JSTSWWY7FC5AMVFJ6RYPJL67GA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.504234083 (290h30m42.935314204s) [noise=true , address=77.90.31.18:4831 , piece_id=SEFZMAOPZRJNJGNE7K7FAB66FAFOLM2MZJAFSOMFUB2TTEX7VJLA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.510783305 (290h30m42.941863426s) [noise=true , address=77.90.31.11:4570 , piece_id=T6BL5ELP44MCL5HDRJABGB4QEYOK72R4INCH5SJKJASC5NDCXDMQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.510800156 (290h30m42.941880287s) [seg_pos={0 0}, upload=302117]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:56:48.510883416 (290h30m42.941963547s) [noise=true , address=104.36.82.45:4912 , piece_id=O7SV66TED6H4BYWKBFCS5FWJEXDNGGZIF4WDU6R2URDBAEJBZ4MQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HnqBnErwajHUpuLrYCmCg7cbJYMQohVM2pQbHZ9LFCvjye39x): protocol: expected piece hash; context canceled; EOF
Aug 20 19:56:48.510950495 (290h30m42.942030626s) [noise=true , address=104.36.82.61:4407 , piece_id=PNO3E5IENODHJJ3VBPQZIVBSJUMHIRUL2NWVKSC5CUC3SZU5EJHA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122k7b6wa2JhSXMVAhF4qPKA48cWkh3DZRyWuwPEt7Vp3ciofPF): protocol: expected piece hash; context canceled; EOF
Aug 20 19:56:48.511146239 (290h30m42.94222636s) [noise=true , address=104.36.82.11:4128 , piece_id=RH3EQMLH6B7UEZ4KKXUXIS3KLGFA3TTEAAT4CNM7UF6WGS73LZ6Q, seg_pos={0 0}, upload=302117]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wABkAtAjoYkKyNoAiaVCxSvY6WgvHvAYFPCjpNojtpiYiGtDS): protocol: expected piece hash; context canceled; EOF
Aug 20 19:56:48.511267170 (290h30m42.942347301s) [noise=true , address=77.90.31.12:4606 , piece_id=N6TNFQBP3KLPO4IUZLYS6GRUXJ2ARCRJTM7AY2MUICN7QIJ3GXVA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pLKmTja7ttT6vqjq8vHMYR9RLfnpqxY9xm9GDBG8ez9aHujs): protocol: write tcp 188.166.225.170:50622->77.90.31.12:4606: use of closed network connection; write tcp 188.166.225.170:50622->77.90.31.12:4606: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50622->77.90.31.12:4606: use of closed network connection
Aug 20 19:56:48.511278352 (290h30m42.942358473s) [seg_pos={0 0}, upload=302117]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:56:48.511365969 (290h30m42.9424461s) [upload=302117]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:56:48.511370247 (290h30m42.942450378s) [upload=302117]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:56:48.827512752 (290h30m43.258592883s) [upload=302117]: Done uploading segments...
Aug 20 19:56:48.827549673 (290h30m43.258629805s) [upload=302117]: Upload finished. err: <nil>
Duration: 6.011536376s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [...X.....................X..................................] duration:
1.959366099s
FAIL (2025-08-20 19:58:26 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.959389504s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [...............X.X.....X..................X....X......X..X..] duration:
5.71846143s
FAIL (2025-08-20 19:57:51 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 20 19:56:45.926480516 (290h30m40.357560647s) [upload=302117]: Starting upload
Aug 20 19:56:45.926528679 (290h30m40.35760881s) [upload=302117]: Done starting upload
Aug 20 19:56:45.926642687 (290h30m40.357722808s) [upload=302117]: Uploading segments...
Aug 20 19:56:45.926700177 (290h30m40.357780308s) [upload=302117]: Got next segment. Inline: false
Aug 20 19:56:45.926726707 (290h30m40.357806838s) [upload=302117]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:56:45.926730936 (290h30m40.357811067s) [upload=302117]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:56:46.405932573 (290h30m40.837012704s) [seg_pos={0 0}, upload=302117]: Begin upload segment...
Aug 20 19:56:46.405996124 (290h30m40.837076255s) [seg_pos={0 0}, upload=302117]: Done begin upload segment.
Aug 20 19:56:46.406016974 (290h30m40.837097105s) [noise=true , address=104.36.82.45:4912 , piece_id=O7SV66TED6H4BYWKBFCS5FWJEXDNGGZIF4WDU6R2URDBAEJBZ4MQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406028476 (290h30m40.837108607s) [noise=true , address=79.127.219.47:4052 , piece_id=CHRYZMD4TBSJIB7AAYWSXPQXRH7EXNDI62HTWWWSUXIGER5XE5VQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406540887 (290h30m40.837621008s) [noise=true , address=77.90.31.18:4829 , piece_id=PUL7FTNP43XSFVZKXGVXNEIKLEEBWC3TOKXV3FWCTXD33FXLW5JQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406552959 (290h30m40.83763308s) [noise=true , address=77.90.31.19:4874 , piece_id=NTTQX3MOV63GFRLHIBGNWK47DGC5DGMFQXVEJOGRRASANMXS6P6Q, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406910894 (290h30m40.837991025s) [noise=true , address=77.90.31.15:4725 , piece_id=VFAKRC6KM44B5Y3WJN5ZL4LCCTOPXL3PQU7ECGVC5XPIID2EHXXQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406960369 (290h30m40.8380405s) [noise=true , address=45.91.116.14:4203 , piece_id=FIUBFSOVURCKR24NGIVV3Q36DJOWXGLL5BEF3DWTNPE3DFF3ANMA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407268388 (290h30m40.838348519s) [noise=true , address=104.36.82.37:4661 , piece_id=BAEJ5XHLFL6XCTL34L2Y7IS6H7UGCTHNKMPQLS47E2QGJS4F6X2A, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407348020 (290h30m40.838428152s) [noise=true , address=77.90.31.18:4831 , piece_id=SEFZMAOPZRJNJGNE7K7FAB66FAFOLM2MZJAFSOMFUB2TTEX7VJLA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407610553 (290h30m40.838690684s) [noise=true , address=104.36.82.60:4350 , piece_id=WCI6ZHFQUORHOBWHVR2VYMLRFQKXSRSHYLBX5N7LWAEXKDMBMW2Q, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407697980 (290h30m40.838778101s) [noise=true , address=77.90.31.10:4548 , piece_id=FWXVHFIUZDBSECT3XYL4NJOWK7JSTSWWY7FC5AMVFJ6RYPJL67GA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407895899 (290h30m40.83897603s) [noise=true , address=104.36.82.61:4407 , piece_id=PNO3E5IENODHJJ3VBPQZIVBSJUMHIRUL2NWVKSC5CUC3SZU5EJHA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407976333 (290h30m40.839056464s) [noise=true , address=79.127.205.235:4682 , piece_id=BO2N56W4TTGIGJZNCPFPJARTEIRHDX243K6DSD6MPHRZJIOTQOLA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408211293 (290h30m40.839291414s) [noise=true , address=77.90.31.11:4570 , piece_id=T6BL5ELP44MCL5HDRJABGB4QEYOK72R4INCH5SJKJASC5NDCXDMQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408352232 (290h30m40.839432353s) [noise=true , address=77.90.31.12:4606 , piece_id=N6TNFQBP3KLPO4IUZLYS6GRUXJ2ARCRJTM7AY2MUICN7QIJ3GXVA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408503050 (290h30m40.839583181s) [noise=true , address=45.91.116.12:4255 , piece_id=GMJZWXNBEYK5JVDOL7MTWYM5A6N4EOQHS3D4JLIWSYPXRDWBS73A, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408706150 (290h30m40.839786281s) [noise=true , address=104.36.82.11:4128 , piece_id=RH3EQMLH6B7UEZ4KKXUXIS3KLGFA3TTEAAT4CNM7UF6WGS73LZ6Q, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408793937 (290h30m40.839874068s) [noise=true , address=77.90.31.19:4865 , piece_id=BCI3LHXCGAXXI7XYMG7ZKPG4Z5XEISPFNVJODPOF5AMV73YHQKAQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408984783 (290h30m40.840064914s) [noise=true , address=104.36.82.23:4474 , piece_id=DHNXO53Z45ZP7OYG3UDCBQHD3HZ6576WEFBL6TJGINC7HD7XCHAA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:47.546960553 (290h30m41.978040684s) [upload=302117]: Next returned nil segment
Aug 20 19:56:47.546977915 (290h30m41.978058036s) [upload=302117]: Waiting for error group managing segments...
Aug 20 19:56:47.859670921 (290h30m42.290751052s) [noise=true , address=79.127.205.235:4682 , piece_id=BO2N56W4TTGIGJZNCPFPJARTEIRHDX243K6DSD6MPHRZJIOTQOLA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.332936680 (290h30m42.764016811s) [noise=true , address=77.90.31.15:4725 , piece_id=VFAKRC6KM44B5Y3WJN5ZL4LCCTOPXL3PQU7ECGVC5XPIID2EHXXQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.343858005 (290h30m42.774938127s) [noise=true , address=77.90.31.18:4829 , piece_id=PUL7FTNP43XSFVZKXGVXNEIKLEEBWC3TOKXV3FWCTXD33FXLW5JQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.355374261 (290h30m42.786454382s) [noise=true , address=77.90.31.19:4865 , piece_id=BCI3LHXCGAXXI7XYMG7ZKPG4Z5XEISPFNVJODPOF5AMV73YHQKAQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.357989975 (290h30m42.789070126s) [noise=true , address=79.127.219.47:4052 , piece_id=CHRYZMD4TBSJIB7AAYWSXPQXRH7EXNDI62HTWWWSUXIGER5XE5VQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.378251352 (290h30m42.809331483s) [noise=true , address=104.36.82.37:4661 , piece_id=BAEJ5XHLFL6XCTL34L2Y7IS6H7UGCTHNKMPQLS47E2QGJS4F6X2A, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.388793625 (290h30m42.819873756s) [noise=true , address=45.91.116.12:4255 , piece_id=GMJZWXNBEYK5JVDOL7MTWYM5A6N4EOQHS3D4JLIWSYPXRDWBS73A, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.398301596 (290h30m42.829381727s) [noise=true , address=104.36.82.60:4350 , piece_id=WCI6ZHFQUORHOBWHVR2VYMLRFQKXSRSHYLBX5N7LWAEXKDMBMW2Q, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.430115318 (290h30m42.861195449s) [noise=true , address=45.91.116.14:4203 , piece_id=FIUBFSOVURCKR24NGIVV3Q36DJOWXGLL5BEF3DWTNPE3DFF3ANMA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.470970648 (290h30m42.902050779s) [noise=true , address=104.36.82.23:4474 , piece_id=DHNXO53Z45ZP7OYG3UDCBQHD3HZ6576WEFBL6TJGINC7HD7XCHAA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.473835110 (290h30m42.904915231s) [noise=true , address=77.90.31.19:4874 , piece_id=NTTQX3MOV63GFRLHIBGNWK47DGC5DGMFQXVEJOGRRASANMXS6P6Q, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.500135622 (290h30m42.931215753s) [noise=true , address=77.90.31.10:4548 , piece_id=FWXVHFIUZDBSECT3XYL4NJOWK7JSTSWWY7FC5AMVFJ6RYPJL67GA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.504234083 (290h30m42.935314204s) [noise=true , address=77.90.31.18:4831 , piece_id=SEFZMAOPZRJNJGNE7K7FAB66FAFOLM2MZJAFSOMFUB2TTEX7VJLA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.510783305 (290h30m42.941863426s) [noise=true , address=77.90.31.11:4570 , piece_id=T6BL5ELP44MCL5HDRJABGB4QEYOK72R4INCH5SJKJASC5NDCXDMQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.510800156 (290h30m42.941880287s) [seg_pos={0 0}, upload=302117]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:56:48.510883416 (290h30m42.941963547s) [noise=true , address=104.36.82.45:4912 , piece_id=O7SV66TED6H4BYWKBFCS5FWJEXDNGGZIF4WDU6R2URDBAEJBZ4MQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HnqBnErwajHUpuLrYCmCg7cbJYMQohVM2pQbHZ9LFCvjye39x): protocol: expected piece hash; context canceled; EOF
Aug 20 19:56:48.510950495 (290h30m42.942030626s) [noise=true , address=104.36.82.61:4407 , piece_id=PNO3E5IENODHJJ3VBPQZIVBSJUMHIRUL2NWVKSC5CUC3SZU5EJHA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122k7b6wa2JhSXMVAhF4qPKA48cWkh3DZRyWuwPEt7Vp3ciofPF): protocol: expected piece hash; context canceled; EOF
Aug 20 19:56:48.511146239 (290h30m42.94222636s) [noise=true , address=104.36.82.11:4128 , piece_id=RH3EQMLH6B7UEZ4KKXUXIS3KLGFA3TTEAAT4CNM7UF6WGS73LZ6Q, seg_pos={0 0}, upload=302117]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wABkAtAjoYkKyNoAiaVCxSvY6WgvHvAYFPCjpNojtpiYiGtDS): protocol: expected piece hash; context canceled; EOF
Aug 20 19:56:48.511267170 (290h30m42.942347301s) [noise=true , address=77.90.31.12:4606 , piece_id=N6TNFQBP3KLPO4IUZLYS6GRUXJ2ARCRJTM7AY2MUICN7QIJ3GXVA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pLKmTja7ttT6vqjq8vHMYR9RLfnpqxY9xm9GDBG8ez9aHujs): protocol: write tcp 188.166.225.170:50622->77.90.31.12:4606: use of closed network connection; write tcp 188.166.225.170:50622->77.90.31.12:4606: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50622->77.90.31.12:4606: use of closed network connection
Aug 20 19:56:48.511278352 (290h30m42.942358473s) [seg_pos={0 0}, upload=302117]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:56:48.511365969 (290h30m42.9424461s) [upload=302117]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:56:48.511370247 (290h30m42.942450378s) [upload=302117]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:56:48.827512752 (290h30m43.258592883s) [upload=302117]: Done uploading segments...
Aug 20 19:56:48.827549673 (290h30m43.258629805s) [upload=302117]: Upload finished. err: <nil>
Duration: 5.718489604s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [....X.....................X.................................] duration:
1.988562693s
FAIL (2025-08-20 19:57:50 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.988621725s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [X...............X.X.....X..................X....X......X..X.] duration:
5.62509506s
FAIL (2025-08-20 19:57:16 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 20 19:56:45.926480516 (290h30m40.357560647s) [upload=302117]: Starting upload
Aug 20 19:56:45.926528679 (290h30m40.35760881s) [upload=302117]: Done starting upload
Aug 20 19:56:45.926642687 (290h30m40.357722808s) [upload=302117]: Uploading segments...
Aug 20 19:56:45.926700177 (290h30m40.357780308s) [upload=302117]: Got next segment. Inline: false
Aug 20 19:56:45.926726707 (290h30m40.357806838s) [upload=302117]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:56:45.926730936 (290h30m40.357811067s) [upload=302117]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:56:46.405932573 (290h30m40.837012704s) [seg_pos={0 0}, upload=302117]: Begin upload segment...
Aug 20 19:56:46.405996124 (290h30m40.837076255s) [seg_pos={0 0}, upload=302117]: Done begin upload segment.
Aug 20 19:56:46.406016974 (290h30m40.837097105s) [noise=true , address=104.36.82.45:4912 , piece_id=O7SV66TED6H4BYWKBFCS5FWJEXDNGGZIF4WDU6R2URDBAEJBZ4MQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406028476 (290h30m40.837108607s) [noise=true , address=79.127.219.47:4052 , piece_id=CHRYZMD4TBSJIB7AAYWSXPQXRH7EXNDI62HTWWWSUXIGER5XE5VQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406540887 (290h30m40.837621008s) [noise=true , address=77.90.31.18:4829 , piece_id=PUL7FTNP43XSFVZKXGVXNEIKLEEBWC3TOKXV3FWCTXD33FXLW5JQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406552959 (290h30m40.83763308s) [noise=true , address=77.90.31.19:4874 , piece_id=NTTQX3MOV63GFRLHIBGNWK47DGC5DGMFQXVEJOGRRASANMXS6P6Q, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406910894 (290h30m40.837991025s) [noise=true , address=77.90.31.15:4725 , piece_id=VFAKRC6KM44B5Y3WJN5ZL4LCCTOPXL3PQU7ECGVC5XPIID2EHXXQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406960369 (290h30m40.8380405s) [noise=true , address=45.91.116.14:4203 , piece_id=FIUBFSOVURCKR24NGIVV3Q36DJOWXGLL5BEF3DWTNPE3DFF3ANMA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407268388 (290h30m40.838348519s) [noise=true , address=104.36.82.37:4661 , piece_id=BAEJ5XHLFL6XCTL34L2Y7IS6H7UGCTHNKMPQLS47E2QGJS4F6X2A, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407348020 (290h30m40.838428152s) [noise=true , address=77.90.31.18:4831 , piece_id=SEFZMAOPZRJNJGNE7K7FAB66FAFOLM2MZJAFSOMFUB2TTEX7VJLA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407610553 (290h30m40.838690684s) [noise=true , address=104.36.82.60:4350 , piece_id=WCI6ZHFQUORHOBWHVR2VYMLRFQKXSRSHYLBX5N7LWAEXKDMBMW2Q, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407697980 (290h30m40.838778101s) [noise=true , address=77.90.31.10:4548 , piece_id=FWXVHFIUZDBSECT3XYL4NJOWK7JSTSWWY7FC5AMVFJ6RYPJL67GA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407895899 (290h30m40.83897603s) [noise=true , address=104.36.82.61:4407 , piece_id=PNO3E5IENODHJJ3VBPQZIVBSJUMHIRUL2NWVKSC5CUC3SZU5EJHA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407976333 (290h30m40.839056464s) [noise=true , address=79.127.205.235:4682 , piece_id=BO2N56W4TTGIGJZNCPFPJARTEIRHDX243K6DSD6MPHRZJIOTQOLA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408211293 (290h30m40.839291414s) [noise=true , address=77.90.31.11:4570 , piece_id=T6BL5ELP44MCL5HDRJABGB4QEYOK72R4INCH5SJKJASC5NDCXDMQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408352232 (290h30m40.839432353s) [noise=true , address=77.90.31.12:4606 , piece_id=N6TNFQBP3KLPO4IUZLYS6GRUXJ2ARCRJTM7AY2MUICN7QIJ3GXVA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408503050 (290h30m40.839583181s) [noise=true , address=45.91.116.12:4255 , piece_id=GMJZWXNBEYK5JVDOL7MTWYM5A6N4EOQHS3D4JLIWSYPXRDWBS73A, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408706150 (290h30m40.839786281s) [noise=true , address=104.36.82.11:4128 , piece_id=RH3EQMLH6B7UEZ4KKXUXIS3KLGFA3TTEAAT4CNM7UF6WGS73LZ6Q, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408793937 (290h30m40.839874068s) [noise=true , address=77.90.31.19:4865 , piece_id=BCI3LHXCGAXXI7XYMG7ZKPG4Z5XEISPFNVJODPOF5AMV73YHQKAQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408984783 (290h30m40.840064914s) [noise=true , address=104.36.82.23:4474 , piece_id=DHNXO53Z45ZP7OYG3UDCBQHD3HZ6576WEFBL6TJGINC7HD7XCHAA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:47.546960553 (290h30m41.978040684s) [upload=302117]: Next returned nil segment
Aug 20 19:56:47.546977915 (290h30m41.978058036s) [upload=302117]: Waiting for error group managing segments...
Aug 20 19:56:47.859670921 (290h30m42.290751052s) [noise=true , address=79.127.205.235:4682 , piece_id=BO2N56W4TTGIGJZNCPFPJARTEIRHDX243K6DSD6MPHRZJIOTQOLA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.332936680 (290h30m42.764016811s) [noise=true , address=77.90.31.15:4725 , piece_id=VFAKRC6KM44B5Y3WJN5ZL4LCCTOPXL3PQU7ECGVC5XPIID2EHXXQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.343858005 (290h30m42.774938127s) [noise=true , address=77.90.31.18:4829 , piece_id=PUL7FTNP43XSFVZKXGVXNEIKLEEBWC3TOKXV3FWCTXD33FXLW5JQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.355374261 (290h30m42.786454382s) [noise=true , address=77.90.31.19:4865 , piece_id=BCI3LHXCGAXXI7XYMG7ZKPG4Z5XEISPFNVJODPOF5AMV73YHQKAQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.357989975 (290h30m42.789070126s) [noise=true , address=79.127.219.47:4052 , piece_id=CHRYZMD4TBSJIB7AAYWSXPQXRH7EXNDI62HTWWWSUXIGER5XE5VQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.378251352 (290h30m42.809331483s) [noise=true , address=104.36.82.37:4661 , piece_id=BAEJ5XHLFL6XCTL34L2Y7IS6H7UGCTHNKMPQLS47E2QGJS4F6X2A, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.388793625 (290h30m42.819873756s) [noise=true , address=45.91.116.12:4255 , piece_id=GMJZWXNBEYK5JVDOL7MTWYM5A6N4EOQHS3D4JLIWSYPXRDWBS73A, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.398301596 (290h30m42.829381727s) [noise=true , address=104.36.82.60:4350 , piece_id=WCI6ZHFQUORHOBWHVR2VYMLRFQKXSRSHYLBX5N7LWAEXKDMBMW2Q, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.430115318 (290h30m42.861195449s) [noise=true , address=45.91.116.14:4203 , piece_id=FIUBFSOVURCKR24NGIVV3Q36DJOWXGLL5BEF3DWTNPE3DFF3ANMA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.470970648 (290h30m42.902050779s) [noise=true , address=104.36.82.23:4474 , piece_id=DHNXO53Z45ZP7OYG3UDCBQHD3HZ6576WEFBL6TJGINC7HD7XCHAA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.473835110 (290h30m42.904915231s) [noise=true , address=77.90.31.19:4874 , piece_id=NTTQX3MOV63GFRLHIBGNWK47DGC5DGMFQXVEJOGRRASANMXS6P6Q, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.500135622 (290h30m42.931215753s) [noise=true , address=77.90.31.10:4548 , piece_id=FWXVHFIUZDBSECT3XYL4NJOWK7JSTSWWY7FC5AMVFJ6RYPJL67GA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.504234083 (290h30m42.935314204s) [noise=true , address=77.90.31.18:4831 , piece_id=SEFZMAOPZRJNJGNE7K7FAB66FAFOLM2MZJAFSOMFUB2TTEX7VJLA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.510783305 (290h30m42.941863426s) [noise=true , address=77.90.31.11:4570 , piece_id=T6BL5ELP44MCL5HDRJABGB4QEYOK72R4INCH5SJKJASC5NDCXDMQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.510800156 (290h30m42.941880287s) [seg_pos={0 0}, upload=302117]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:56:48.510883416 (290h30m42.941963547s) [noise=true , address=104.36.82.45:4912 , piece_id=O7SV66TED6H4BYWKBFCS5FWJEXDNGGZIF4WDU6R2URDBAEJBZ4MQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HnqBnErwajHUpuLrYCmCg7cbJYMQohVM2pQbHZ9LFCvjye39x): protocol: expected piece hash; context canceled; EOF
Aug 20 19:56:48.510950495 (290h30m42.942030626s) [noise=true , address=104.36.82.61:4407 , piece_id=PNO3E5IENODHJJ3VBPQZIVBSJUMHIRUL2NWVKSC5CUC3SZU5EJHA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122k7b6wa2JhSXMVAhF4qPKA48cWkh3DZRyWuwPEt7Vp3ciofPF): protocol: expected piece hash; context canceled; EOF
Aug 20 19:56:48.511146239 (290h30m42.94222636s) [noise=true , address=104.36.82.11:4128 , piece_id=RH3EQMLH6B7UEZ4KKXUXIS3KLGFA3TTEAAT4CNM7UF6WGS73LZ6Q, seg_pos={0 0}, upload=302117]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wABkAtAjoYkKyNoAiaVCxSvY6WgvHvAYFPCjpNojtpiYiGtDS): protocol: expected piece hash; context canceled; EOF
Aug 20 19:56:48.511267170 (290h30m42.942347301s) [noise=true , address=77.90.31.12:4606 , piece_id=N6TNFQBP3KLPO4IUZLYS6GRUXJ2ARCRJTM7AY2MUICN7QIJ3GXVA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pLKmTja7ttT6vqjq8vHMYR9RLfnpqxY9xm9GDBG8ez9aHujs): protocol: write tcp 188.166.225.170:50622->77.90.31.12:4606: use of closed network connection; write tcp 188.166.225.170:50622->77.90.31.12:4606: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50622->77.90.31.12:4606: use of closed network connection
Aug 20 19:56:48.511278352 (290h30m42.942358473s) [seg_pos={0 0}, upload=302117]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:56:48.511365969 (290h30m42.9424461s) [upload=302117]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:56:48.511370247 (290h30m42.942450378s) [upload=302117]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:56:48.827512752 (290h30m43.258592883s) [upload=302117]: Done uploading segments...
Aug 20 19:56:48.827549673 (290h30m43.258629805s) [upload=302117]: Upload finished. err: <nil>
Duration: 5.62511567s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.....X.....................X................................] duration:
1.964198021s
FAIL (2025-08-20 19:57:01 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.964224382s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
8 out of 60 is failed (threshold=3) [.X...............X.X.....X..................X....X......X..X] duration:
4.006469197s
FAIL (2025-08-20 19:56:49 UTC)
orbiter warning:
operation: ListObjects
======ERROR======
unable to find key in bucket: sj://uptime-checks-placement-20/orbiter_us_0/4M
======LOGS======
Aug 20 19:56:45.926480516 (290h30m40.357560647s) [upload=302117]: Starting upload
Aug 20 19:56:45.926528679 (290h30m40.35760881s) [upload=302117]: Done starting upload
Aug 20 19:56:45.926642687 (290h30m40.357722808s) [upload=302117]: Uploading segments...
Aug 20 19:56:45.926700177 (290h30m40.357780308s) [upload=302117]: Got next segment. Inline: false
Aug 20 19:56:45.926726707 (290h30m40.357806838s) [upload=302117]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:56:45.926730936 (290h30m40.357811067s) [upload=302117]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:56:46.405932573 (290h30m40.837012704s) [seg_pos={0 0}, upload=302117]: Begin upload segment...
Aug 20 19:56:46.405996124 (290h30m40.837076255s) [seg_pos={0 0}, upload=302117]: Done begin upload segment.
Aug 20 19:56:46.406016974 (290h30m40.837097105s) [noise=true , address=104.36.82.45:4912 , piece_id=O7SV66TED6H4BYWKBFCS5FWJEXDNGGZIF4WDU6R2URDBAEJBZ4MQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406028476 (290h30m40.837108607s) [noise=true , address=79.127.219.47:4052 , piece_id=CHRYZMD4TBSJIB7AAYWSXPQXRH7EXNDI62HTWWWSUXIGER5XE5VQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406540887 (290h30m40.837621008s) [noise=true , address=77.90.31.18:4829 , piece_id=PUL7FTNP43XSFVZKXGVXNEIKLEEBWC3TOKXV3FWCTXD33FXLW5JQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406552959 (290h30m40.83763308s) [noise=true , address=77.90.31.19:4874 , piece_id=NTTQX3MOV63GFRLHIBGNWK47DGC5DGMFQXVEJOGRRASANMXS6P6Q, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406910894 (290h30m40.837991025s) [noise=true , address=77.90.31.15:4725 , piece_id=VFAKRC6KM44B5Y3WJN5ZL4LCCTOPXL3PQU7ECGVC5XPIID2EHXXQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.406960369 (290h30m40.8380405s) [noise=true , address=45.91.116.14:4203 , piece_id=FIUBFSOVURCKR24NGIVV3Q36DJOWXGLL5BEF3DWTNPE3DFF3ANMA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407268388 (290h30m40.838348519s) [noise=true , address=104.36.82.37:4661 , piece_id=BAEJ5XHLFL6XCTL34L2Y7IS6H7UGCTHNKMPQLS47E2QGJS4F6X2A, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407348020 (290h30m40.838428152s) [noise=true , address=77.90.31.18:4831 , piece_id=SEFZMAOPZRJNJGNE7K7FAB66FAFOLM2MZJAFSOMFUB2TTEX7VJLA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407610553 (290h30m40.838690684s) [noise=true , address=104.36.82.60:4350 , piece_id=WCI6ZHFQUORHOBWHVR2VYMLRFQKXSRSHYLBX5N7LWAEXKDMBMW2Q, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407697980 (290h30m40.838778101s) [noise=true , address=77.90.31.10:4548 , piece_id=FWXVHFIUZDBSECT3XYL4NJOWK7JSTSWWY7FC5AMVFJ6RYPJL67GA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407895899 (290h30m40.83897603s) [noise=true , address=104.36.82.61:4407 , piece_id=PNO3E5IENODHJJ3VBPQZIVBSJUMHIRUL2NWVKSC5CUC3SZU5EJHA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.407976333 (290h30m40.839056464s) [noise=true , address=79.127.205.235:4682 , piece_id=BO2N56W4TTGIGJZNCPFPJARTEIRHDX243K6DSD6MPHRZJIOTQOLA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408211293 (290h30m40.839291414s) [noise=true , address=77.90.31.11:4570 , piece_id=T6BL5ELP44MCL5HDRJABGB4QEYOK72R4INCH5SJKJASC5NDCXDMQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408352232 (290h30m40.839432353s) [noise=true , address=77.90.31.12:4606 , piece_id=N6TNFQBP3KLPO4IUZLYS6GRUXJ2ARCRJTM7AY2MUICN7QIJ3GXVA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408503050 (290h30m40.839583181s) [noise=true , address=45.91.116.12:4255 , piece_id=GMJZWXNBEYK5JVDOL7MTWYM5A6N4EOQHS3D4JLIWSYPXRDWBS73A, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408706150 (290h30m40.839786281s) [noise=true , address=104.36.82.11:4128 , piece_id=RH3EQMLH6B7UEZ4KKXUXIS3KLGFA3TTEAAT4CNM7UF6WGS73LZ6Q, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408793937 (290h30m40.839874068s) [noise=true , address=77.90.31.19:4865 , piece_id=BCI3LHXCGAXXI7XYMG7ZKPG4Z5XEISPFNVJODPOF5AMV73YHQKAQ, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:46.408984783 (290h30m40.840064914s) [noise=true , address=104.36.82.23:4474 , piece_id=DHNXO53Z45ZP7OYG3UDCBQHD3HZ6576WEFBL6TJGINC7HD7XCHAA, seg_pos={0 0}, upload=302117]: Uploading piece...
Aug 20 19:56:47.546960553 (290h30m41.978040684s) [upload=302117]: Next returned nil segment
Aug 20 19:56:47.546977915 (290h30m41.978058036s) [upload=302117]: Waiting for error group managing segments...
Aug 20 19:56:47.859670921 (290h30m42.290751052s) [noise=true , address=79.127.205.235:4682 , piece_id=BO2N56W4TTGIGJZNCPFPJARTEIRHDX243K6DSD6MPHRZJIOTQOLA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.332936680 (290h30m42.764016811s) [noise=true , address=77.90.31.15:4725 , piece_id=VFAKRC6KM44B5Y3WJN5ZL4LCCTOPXL3PQU7ECGVC5XPIID2EHXXQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.343858005 (290h30m42.774938127s) [noise=true , address=77.90.31.18:4829 , piece_id=PUL7FTNP43XSFVZKXGVXNEIKLEEBWC3TOKXV3FWCTXD33FXLW5JQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.355374261 (290h30m42.786454382s) [noise=true , address=77.90.31.19:4865 , piece_id=BCI3LHXCGAXXI7XYMG7ZKPG4Z5XEISPFNVJODPOF5AMV73YHQKAQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.357989975 (290h30m42.789070126s) [noise=true , address=79.127.219.47:4052 , piece_id=CHRYZMD4TBSJIB7AAYWSXPQXRH7EXNDI62HTWWWSUXIGER5XE5VQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.378251352 (290h30m42.809331483s) [noise=true , address=104.36.82.37:4661 , piece_id=BAEJ5XHLFL6XCTL34L2Y7IS6H7UGCTHNKMPQLS47E2QGJS4F6X2A, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.388793625 (290h30m42.819873756s) [noise=true , address=45.91.116.12:4255 , piece_id=GMJZWXNBEYK5JVDOL7MTWYM5A6N4EOQHS3D4JLIWSYPXRDWBS73A, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.398301596 (290h30m42.829381727s) [noise=true , address=104.36.82.60:4350 , piece_id=WCI6ZHFQUORHOBWHVR2VYMLRFQKXSRSHYLBX5N7LWAEXKDMBMW2Q, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.430115318 (290h30m42.861195449s) [noise=true , address=45.91.116.14:4203 , piece_id=FIUBFSOVURCKR24NGIVV3Q36DJOWXGLL5BEF3DWTNPE3DFF3ANMA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.470970648 (290h30m42.902050779s) [noise=true , address=104.36.82.23:4474 , piece_id=DHNXO53Z45ZP7OYG3UDCBQHD3HZ6576WEFBL6TJGINC7HD7XCHAA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.473835110 (290h30m42.904915231s) [noise=true , address=77.90.31.19:4874 , piece_id=NTTQX3MOV63GFRLHIBGNWK47DGC5DGMFQXVEJOGRRASANMXS6P6Q, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.500135622 (290h30m42.931215753s) [noise=true , address=77.90.31.10:4548 , piece_id=FWXVHFIUZDBSECT3XYL4NJOWK7JSTSWWY7FC5AMVFJ6RYPJL67GA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.504234083 (290h30m42.935314204s) [noise=true , address=77.90.31.18:4831 , piece_id=SEFZMAOPZRJNJGNE7K7FAB66FAFOLM2MZJAFSOMFUB2TTEX7VJLA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.510783305 (290h30m42.941863426s) [noise=true , address=77.90.31.11:4570 , piece_id=T6BL5ELP44MCL5HDRJABGB4QEYOK72R4INCH5SJKJASC5NDCXDMQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: <nil>
Aug 20 19:56:48.510800156 (290h30m42.941880287s) [seg_pos={0 0}, upload=302117]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:56:48.510883416 (290h30m42.941963547s) [noise=true , address=104.36.82.45:4912 , piece_id=O7SV66TED6H4BYWKBFCS5FWJEXDNGGZIF4WDU6R2URDBAEJBZ4MQ, seg_pos={0 0}, upload=302117]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12HnqBnErwajHUpuLrYCmCg7cbJYMQohVM2pQbHZ9LFCvjye39x): protocol: expected piece hash; context canceled; EOF
Aug 20 19:56:48.510950495 (290h30m42.942030626s) [noise=true , address=104.36.82.61:4407 , piece_id=PNO3E5IENODHJJ3VBPQZIVBSJUMHIRUL2NWVKSC5CUC3SZU5EJHA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:122k7b6wa2JhSXMVAhF4qPKA48cWkh3DZRyWuwPEt7Vp3ciofPF): protocol: expected piece hash; context canceled; EOF
Aug 20 19:56:48.511146239 (290h30m42.94222636s) [noise=true , address=104.36.82.11:4128 , piece_id=RH3EQMLH6B7UEZ4KKXUXIS3KLGFA3TTEAAT4CNM7UF6WGS73LZ6Q, seg_pos={0 0}, upload=302117]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1wABkAtAjoYkKyNoAiaVCxSvY6WgvHvAYFPCjpNojtpiYiGtDS): protocol: expected piece hash; context canceled; EOF
Aug 20 19:56:48.511267170 (290h30m42.942347301s) [noise=true , address=77.90.31.12:4606 , piece_id=N6TNFQBP3KLPO4IUZLYS6GRUXJ2ARCRJTM7AY2MUICN7QIJ3GXVA, seg_pos={0 0}, upload=302117]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1pLKmTja7ttT6vqjq8vHMYR9RLfnpqxY9xm9GDBG8ez9aHujs): protocol: write tcp 188.166.225.170:50622->77.90.31.12:4606: use of closed network connection; write tcp 188.166.225.170:50622->77.90.31.12:4606: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:50622->77.90.31.12:4606: use of closed network connection
Aug 20 19:56:48.511278352 (290h30m42.942358473s) [seg_pos={0 0}, upload=302117]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:56:48.511365969 (290h30m42.9424461s) [upload=302117]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:56:48.511370247 (290h30m42.942450378s) [upload=302117]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:56:48.827512752 (290h30m43.258592883s) [upload=302117]: Done uploading segments...
Aug 20 19:56:48.827549673 (290h30m43.258629805s) [upload=302117]: Upload finished. err: <nil>
Duration: 4.006494906s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [......X.....................X...............................] duration:
2.017890405s
FAIL (2025-08-20 19:56:42 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.017914761s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [..X...............X.X.....X..................X....X......X..] duration:
5.655439992s
FAIL (2025-08-20 19:56:11 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:54:44.844883873 (290h28m39.275964004s) [upload=302079]: Starting upload Aug 20 19:54:44.844925754 (290h28m39.276005885s) [upload=302079]: Done starting upload Aug 20 19:54:44.845012360 (290h28m39.276092491s) [upload=302079]: Uploading segments... Aug 20 19:54:44.845073005 (290h28m39.276153136s) [upload=302079]: Got next segment. Inline: false Aug 20 19:54:44.845100979 (290h28m39.27618111s) [upload=302079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:54:44.845104856 (290h28m39.276184987s) [upload=302079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 19:54:45.060207426 (290h28m39.491287557s) [upload=302079]: Next segment err: metaclient: Too Many Requests Aug 20 19:54:45.060227474 (290h28m39.491307605s) [upload=302079]: Done uploading segments... Aug 20 19:54:45.060245228 (290h28m39.491325359s) [upload=302079]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.655462536s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.......X.....................X..............................] duration:
1.865358286s
FAIL (2025-08-20 19:56:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.865380379s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [...X...............X.X.....X..................X....X......X.] duration:
5.848051329s
FAIL (2025-08-20 19:55:18 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:54:44.844883873 (290h28m39.275964004s) [upload=302079]: Starting upload Aug 20 19:54:44.844925754 (290h28m39.276005885s) [upload=302079]: Done starting upload Aug 20 19:54:44.845012360 (290h28m39.276092491s) [upload=302079]: Uploading segments... Aug 20 19:54:44.845073005 (290h28m39.276153136s) [upload=302079]: Got next segment. Inline: false Aug 20 19:54:44.845100979 (290h28m39.27618111s) [upload=302079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:54:44.845104856 (290h28m39.276184987s) [upload=302079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 19:54:45.060207426 (290h28m39.491287557s) [upload=302079]: Next segment err: metaclient: Too Many Requests Aug 20 19:54:45.060227474 (290h28m39.491307605s) [upload=302079]: Done uploading segments... Aug 20 19:54:45.060245228 (290h28m39.491325359s) [upload=302079]: Upload finished. err: metaclient: Too Many Requests
Duration: 5.848076748s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [........X.....................X.............................] duration:
2.084444427s
FAIL (2025-08-20 19:55:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.084470999s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
7 out of 60 is failed (threshold=3) [....X...............X.X.....X..................X....X......X] duration:
863.010101ms
FAIL (2025-08-20 19:54:45 UTC)
orbiter warning: operation: sync2.Copy ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:54:44.844883873 (290h28m39.275964004s) [upload=302079]: Starting upload Aug 20 19:54:44.844925754 (290h28m39.276005885s) [upload=302079]: Done starting upload Aug 20 19:54:44.845012360 (290h28m39.276092491s) [upload=302079]: Uploading segments... Aug 20 19:54:44.845073005 (290h28m39.276153136s) [upload=302079]: Got next segment. Inline: false Aug 20 19:54:44.845100979 (290h28m39.27618111s) [upload=302079]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:54:44.845104856 (290h28m39.276184987s) [upload=302079]: Flush batch item: *pb.BatchRequestItem_SegmentBegin Aug 20 19:54:45.060207426 (290h28m39.491287557s) [upload=302079]: Next segment err: metaclient: Too Many Requests Aug 20 19:54:45.060227474 (290h28m39.491307605s) [upload=302079]: Done uploading segments... Aug 20 19:54:45.060245228 (290h28m39.491325359s) [upload=302079]: Upload finished. err: metaclient: Too Many Requests
Duration: 863.03057ms
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
2 out of 60 is failed (threshold=3) [.........X.....................X............................] duration:
1.832775682s
FAIL (2025-08-20 19:54:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.832806842s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.....X...............X.X.....X..................X....X......] duration:
5.922259679s
FAIL (2025-08-20 19:54:04 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 19:49:26.389896574 (290h23m20.820976705s) [upload=301982]: Starting upload
Aug 20 19:49:26.389949686 (290h23m20.821029817s) [upload=301982]: Done starting upload
Aug 20 19:49:26.390036321 (290h23m20.821116452s) [upload=301982]: Uploading segments...
Aug 20 19:49:26.390137696 (290h23m20.821217827s) [upload=301982]: Got next segment. Inline: false
Aug 20 19:49:26.390175097 (290h23m20.821255228s) [upload=301982]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:49:26.390179705 (290h23m20.821259836s) [upload=301982]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:49:26.840456571 (290h23m21.271536692s) [seg_pos={0 0}, upload=301982]: Begin upload segment...
Aug 20 19:49:26.840499312 (290h23m21.271579443s) [seg_pos={0 0}, upload=301982]: Done begin upload segment.
Aug 20 19:49:26.840528188 (290h23m21.271608319s) [noise=true , address=77.90.31.13:4634 , piece_id=C5X7JX6UNW6KSEWUKHK23FWCJACQBWO5BMGPHX5YZHPGSFXB6NVA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.840531864 (290h23m21.271611995s) [noise=true , address=45.91.116.7:4029 , piece_id=BJZFWAHOIVZYRINKG37TVINBKZ3BGHG5OORZOQ2UFG2X5AV5SAAA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.840868670 (290h23m21.271948801s) [noise=true , address=77.90.31.19:4857 , piece_id=UX6ISUG4W2JB63SYBXDBEFAKDGL7P2GZ2NBERVKPFMZJH72T3RWA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.841147212 (290h23m21.272227343s) [noise=true , address=77.90.31.12:4624 , piece_id=OUXP4Z73VCF6CE3EY5BOWCG5COJX2LHBXNTD6RW2ZK7NBXUVS4DA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.841413511 (290h23m21.272493642s) [noise=true , address=45.91.116.12:4248 , piece_id=LVJCE6WTWNR55EW2NIZ6VSVATA4UORKVBYQDKERKD4JOILVGVOPQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.841677877 (290h23m21.272757998s) [noise=true , address=45.91.116.5:4305 , piece_id=3XZGROXHFYG6T6EYDC6HHB3GFB4VVAW7WFTT77RP3ZPZCOE2XO4Q, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.841970017 (290h23m21.273050148s) [noise=true , address=104.36.82.14:4248 , piece_id=MEH35NPNMFMMFZXKG77FMUHY64HY7WIP5AAGHTVPSVE6RZXBVLLQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.842200487 (290h23m21.273280618s) [noise=true , address=104.36.82.37:4661 , piece_id=AJ7OZUW2SPWIYMMEOTF3W2OSCZOZPYFDFORDFPLCNR5XK7DXRMCA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.842401151 (290h23m21.273481272s) [noise=true , address=77.90.31.15:4705 , piece_id=R23HJMEHYUHNRZST4YTYCKAMN5LRY42FUVUBHO3FGBPZD6QJ7KDA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.842611313 (290h23m21.273691444s) [noise=true , address=104.36.82.60:4353 , piece_id=3FBQSKFEZV4DVDXINLBFNGFTGGGD5XPRVBV7DYWVEDX6WOFGDUFA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.842813540 (290h23m21.273893671s) [noise=true , address=45.91.116.11:4142 , piece_id=BK23NFTPE5NH3FOSYHTJ2UQBRBO3C7SGS7MCSGPP6BCTNN3N77BA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.843022580 (290h23m21.274102701s) [noise=true , address=104.36.82.51:4071 , piece_id=MZ6SHSFI7DTZ43JRTYKD5IFLPKMZIOOTTEZ5GPVTMAQA3OJ6STUA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.843238804 (290h23m21.274318935s) [noise=true , address=104.36.82.23:4447 , piece_id=CREQI75WCAXZH2HSIHKUCHEP7LXGGVE64VT5DCXTG2XV3QRGYZ5Q, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.843446461 (290h23m21.274526592s) [noise=true , address=45.91.116.4:4949 , piece_id=JNRDLVWW277LYQZ2ES4QOHVIFO6XJYJC22K34KWU6OPQIEG3DSJQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.843799737 (290h23m21.274879868s) [noise=true , address=79.127.205.233:4647 , piece_id=6JOSOX5OQ7QETYLZDYHA5ERWCGQUK5EJQUXUJMTOLYQTVDBDCRCQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.844928608 (290h23m21.276008739s) [noise=true , address=45.91.116.13:4159 , piece_id=WVUH6DDG2YVD4UGLZMAHHFSG2JASQ2SPAFQDXU3EA6RYRVBE3AVQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.848536471 (290h23m21.279616602s) [noise=true , address=104.36.82.44:4883 , piece_id=ANZA6KLXAVNLVMNRLVTLPT3EXWUGPZ7ZP6DWCTGATIRWFDFW4B7A, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.850291689 (290h23m21.28137182s) [noise=true , address=104.36.82.5:4872 , piece_id=O3UF3WSPGUFZJC7OYVOVSHQ4GGQ3TYHWEKZECP25N3EV4AHQWMSQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:27.995314800 (290h23m22.426394921s) [upload=301982]: Next returned nil segment
Aug 20 19:49:27.995333715 (290h23m22.426413846s) [upload=301982]: Waiting for error group managing segments...
Aug 20 19:49:28.308895956 (290h23m22.739976087s) [noise=true , address=79.127.205.233:4647 , piece_id=6JOSOX5OQ7QETYLZDYHA5ERWCGQUK5EJQUXUJMTOLYQTVDBDCRCQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.728558835 (290h23m23.159638966s) [noise=true , address=45.91.116.11:4142 , piece_id=BK23NFTPE5NH3FOSYHTJ2UQBRBO3C7SGS7MCSGPP6BCTNN3N77BA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.734009465 (290h23m23.165089596s) [noise=true , address=45.91.116.13:4159 , piece_id=WVUH6DDG2YVD4UGLZMAHHFSG2JASQ2SPAFQDXU3EA6RYRVBE3AVQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.739435837 (290h23m23.170515968s) [noise=true , address=45.91.116.5:4305 , piece_id=3XZGROXHFYG6T6EYDC6HHB3GFB4VVAW7WFTT77RP3ZPZCOE2XO4Q, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.740202443 (290h23m23.171282574s) [noise=true , address=45.91.116.7:4029 , piece_id=BJZFWAHOIVZYRINKG37TVINBKZ3BGHG5OORZOQ2UFG2X5AV5SAAA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.752858218 (290h23m23.183938349s) [noise=true , address=45.91.116.12:4248 , piece_id=LVJCE6WTWNR55EW2NIZ6VSVATA4UORKVBYQDKERKD4JOILVGVOPQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.785780060 (290h23m23.216860202s) [noise=true , address=104.36.82.5:4872 , piece_id=O3UF3WSPGUFZJC7OYVOVSHQ4GGQ3TYHWEKZECP25N3EV4AHQWMSQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.826014212 (290h23m23.257094333s) [noise=true , address=77.90.31.19:4857 , piece_id=UX6ISUG4W2JB63SYBXDBEFAKDGL7P2GZ2NBERVKPFMZJH72T3RWA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.831751040 (290h23m23.262831161s) [noise=true , address=77.90.31.13:4634 , piece_id=C5X7JX6UNW6KSEWUKHK23FWCJACQBWO5BMGPHX5YZHPGSFXB6NVA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.838490104 (290h23m23.269570235s) [noise=true , address=104.36.82.51:4071 , piece_id=MZ6SHSFI7DTZ43JRTYKD5IFLPKMZIOOTTEZ5GPVTMAQA3OJ6STUA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.841271807 (290h23m23.272351938s) [noise=true , address=104.36.82.37:4661 , piece_id=AJ7OZUW2SPWIYMMEOTF3W2OSCZOZPYFDFORDFPLCNR5XK7DXRMCA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.849557210 (290h23m23.280637341s) [noise=true , address=104.36.82.23:4447 , piece_id=CREQI75WCAXZH2HSIHKUCHEP7LXGGVE64VT5DCXTG2XV3QRGYZ5Q, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.854054595 (290h23m23.285134726s) [noise=true , address=77.90.31.15:4705 , piece_id=R23HJMEHYUHNRZST4YTYCKAMN5LRY42FUVUBHO3FGBPZD6QJ7KDA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.878131603 (290h23m23.309211734s) [noise=true , address=104.36.82.44:4883 , piece_id=ANZA6KLXAVNLVMNRLVTLPT3EXWUGPZ7ZP6DWCTGATIRWFDFW4B7A, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.878180417 (290h23m23.309260538s) [seg_pos={0 0}, upload=301982]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:49:28.878299795 (290h23m23.309379926s) [noise=true , address=45.91.116.4:4949 , piece_id=JNRDLVWW277LYQZ2ES4QOHVIFO6XJYJC22K34KWU6OPQIEG3DSJQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MxLbxMQxhM4LASkuABsSUS13bXn3KyrdpijiKNYU9mmyczHrF): protocol: expected piece hash; context canceled; EOF
Aug 20 19:49:28.878363987 (290h23m23.309444118s) [noise=true , address=77.90.31.12:4624 , piece_id=OUXP4Z73VCF6CE3EY5BOWCG5COJX2LHBXNTD6RW2ZK7NBXUVS4DA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KxpgfHEQjqnumtfhQ2TEYCgZPFbUQVShfJA7dgNbnZXpncMnV): protocol: expected piece hash; context canceled; EOF
Aug 20 19:49:28.878379287 (290h23m23.309459408s) [noise=true , address=104.36.82.60:4353 , piece_id=3FBQSKFEZV4DVDXINLBFNGFTGGGD5XPRVBV7DYWVEDX6WOFGDUFA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 20 19:49:28.878418041 (290h23m23.309498172s) [noise=true , address=104.36.82.14:4248 , piece_id=MEH35NPNMFMMFZXKG77FMUHY64HY7WIP5AAGHTVPSVE6RZXBVLLQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u6ir2PLqDa9xGm64cuqq1RqY4qeBa1fqCo9VghspBf54XEXqn): protocol: expected piece hash; context canceled; EOF
Aug 20 19:49:28.878432589 (290h23m23.30951272s) [seg_pos={0 0}, upload=301982]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:49:28.878497964 (290h23m23.309578095s) [upload=301982]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:49:28.878501751 (290h23m23.309581882s) [upload=301982]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:49:29.479829471 (290h23m23.910909602s) [upload=301982]: Done uploading segments...
Aug 20 19:49:29.479848368 (290h23m23.910928499s) [upload=301982]: Upload finished. err: <nil>
Duration: 5.922282483s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [X.........X.....................X...........................] duration:
1.842168367s
FAIL (2025-08-20 19:53:39 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.842185239s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.X.........X.....................X..........................] duration:
1.862838567s
FAIL (2025-08-20 19:53:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.862864725s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [......X...............X.X.....X..................X....X.....] duration:
5.914875331s
FAIL (2025-08-20 19:52:58 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 19:49:26.389896574 (290h23m20.820976705s) [upload=301982]: Starting upload
Aug 20 19:49:26.389949686 (290h23m20.821029817s) [upload=301982]: Done starting upload
Aug 20 19:49:26.390036321 (290h23m20.821116452s) [upload=301982]: Uploading segments...
Aug 20 19:49:26.390137696 (290h23m20.821217827s) [upload=301982]: Got next segment. Inline: false
Aug 20 19:49:26.390175097 (290h23m20.821255228s) [upload=301982]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:49:26.390179705 (290h23m20.821259836s) [upload=301982]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:49:26.840456571 (290h23m21.271536692s) [seg_pos={0 0}, upload=301982]: Begin upload segment...
Aug 20 19:49:26.840499312 (290h23m21.271579443s) [seg_pos={0 0}, upload=301982]: Done begin upload segment.
Aug 20 19:49:26.840528188 (290h23m21.271608319s) [noise=true , address=77.90.31.13:4634 , piece_id=C5X7JX6UNW6KSEWUKHK23FWCJACQBWO5BMGPHX5YZHPGSFXB6NVA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.840531864 (290h23m21.271611995s) [noise=true , address=45.91.116.7:4029 , piece_id=BJZFWAHOIVZYRINKG37TVINBKZ3BGHG5OORZOQ2UFG2X5AV5SAAA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.840868670 (290h23m21.271948801s) [noise=true , address=77.90.31.19:4857 , piece_id=UX6ISUG4W2JB63SYBXDBEFAKDGL7P2GZ2NBERVKPFMZJH72T3RWA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.841147212 (290h23m21.272227343s) [noise=true , address=77.90.31.12:4624 , piece_id=OUXP4Z73VCF6CE3EY5BOWCG5COJX2LHBXNTD6RW2ZK7NBXUVS4DA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.841413511 (290h23m21.272493642s) [noise=true , address=45.91.116.12:4248 , piece_id=LVJCE6WTWNR55EW2NIZ6VSVATA4UORKVBYQDKERKD4JOILVGVOPQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.841677877 (290h23m21.272757998s) [noise=true , address=45.91.116.5:4305 , piece_id=3XZGROXHFYG6T6EYDC6HHB3GFB4VVAW7WFTT77RP3ZPZCOE2XO4Q, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.841970017 (290h23m21.273050148s) [noise=true , address=104.36.82.14:4248 , piece_id=MEH35NPNMFMMFZXKG77FMUHY64HY7WIP5AAGHTVPSVE6RZXBVLLQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.842200487 (290h23m21.273280618s) [noise=true , address=104.36.82.37:4661 , piece_id=AJ7OZUW2SPWIYMMEOTF3W2OSCZOZPYFDFORDFPLCNR5XK7DXRMCA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.842401151 (290h23m21.273481272s) [noise=true , address=77.90.31.15:4705 , piece_id=R23HJMEHYUHNRZST4YTYCKAMN5LRY42FUVUBHO3FGBPZD6QJ7KDA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.842611313 (290h23m21.273691444s) [noise=true , address=104.36.82.60:4353 , piece_id=3FBQSKFEZV4DVDXINLBFNGFTGGGD5XPRVBV7DYWVEDX6WOFGDUFA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.842813540 (290h23m21.273893671s) [noise=true , address=45.91.116.11:4142 , piece_id=BK23NFTPE5NH3FOSYHTJ2UQBRBO3C7SGS7MCSGPP6BCTNN3N77BA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.843022580 (290h23m21.274102701s) [noise=true , address=104.36.82.51:4071 , piece_id=MZ6SHSFI7DTZ43JRTYKD5IFLPKMZIOOTTEZ5GPVTMAQA3OJ6STUA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.843238804 (290h23m21.274318935s) [noise=true , address=104.36.82.23:4447 , piece_id=CREQI75WCAXZH2HSIHKUCHEP7LXGGVE64VT5DCXTG2XV3QRGYZ5Q, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.843446461 (290h23m21.274526592s) [noise=true , address=45.91.116.4:4949 , piece_id=JNRDLVWW277LYQZ2ES4QOHVIFO6XJYJC22K34KWU6OPQIEG3DSJQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.843799737 (290h23m21.274879868s) [noise=true , address=79.127.205.233:4647 , piece_id=6JOSOX5OQ7QETYLZDYHA5ERWCGQUK5EJQUXUJMTOLYQTVDBDCRCQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.844928608 (290h23m21.276008739s) [noise=true , address=45.91.116.13:4159 , piece_id=WVUH6DDG2YVD4UGLZMAHHFSG2JASQ2SPAFQDXU3EA6RYRVBE3AVQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.848536471 (290h23m21.279616602s) [noise=true , address=104.36.82.44:4883 , piece_id=ANZA6KLXAVNLVMNRLVTLPT3EXWUGPZ7ZP6DWCTGATIRWFDFW4B7A, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.850291689 (290h23m21.28137182s) [noise=true , address=104.36.82.5:4872 , piece_id=O3UF3WSPGUFZJC7OYVOVSHQ4GGQ3TYHWEKZECP25N3EV4AHQWMSQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:27.995314800 (290h23m22.426394921s) [upload=301982]: Next returned nil segment
Aug 20 19:49:27.995333715 (290h23m22.426413846s) [upload=301982]: Waiting for error group managing segments...
Aug 20 19:49:28.308895956 (290h23m22.739976087s) [noise=true , address=79.127.205.233:4647 , piece_id=6JOSOX5OQ7QETYLZDYHA5ERWCGQUK5EJQUXUJMTOLYQTVDBDCRCQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.728558835 (290h23m23.159638966s) [noise=true , address=45.91.116.11:4142 , piece_id=BK23NFTPE5NH3FOSYHTJ2UQBRBO3C7SGS7MCSGPP6BCTNN3N77BA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.734009465 (290h23m23.165089596s) [noise=true , address=45.91.116.13:4159 , piece_id=WVUH6DDG2YVD4UGLZMAHHFSG2JASQ2SPAFQDXU3EA6RYRVBE3AVQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.739435837 (290h23m23.170515968s) [noise=true , address=45.91.116.5:4305 , piece_id=3XZGROXHFYG6T6EYDC6HHB3GFB4VVAW7WFTT77RP3ZPZCOE2XO4Q, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.740202443 (290h23m23.171282574s) [noise=true , address=45.91.116.7:4029 , piece_id=BJZFWAHOIVZYRINKG37TVINBKZ3BGHG5OORZOQ2UFG2X5AV5SAAA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.752858218 (290h23m23.183938349s) [noise=true , address=45.91.116.12:4248 , piece_id=LVJCE6WTWNR55EW2NIZ6VSVATA4UORKVBYQDKERKD4JOILVGVOPQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.785780060 (290h23m23.216860202s) [noise=true , address=104.36.82.5:4872 , piece_id=O3UF3WSPGUFZJC7OYVOVSHQ4GGQ3TYHWEKZECP25N3EV4AHQWMSQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.826014212 (290h23m23.257094333s) [noise=true , address=77.90.31.19:4857 , piece_id=UX6ISUG4W2JB63SYBXDBEFAKDGL7P2GZ2NBERVKPFMZJH72T3RWA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.831751040 (290h23m23.262831161s) [noise=true , address=77.90.31.13:4634 , piece_id=C5X7JX6UNW6KSEWUKHK23FWCJACQBWO5BMGPHX5YZHPGSFXB6NVA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.838490104 (290h23m23.269570235s) [noise=true , address=104.36.82.51:4071 , piece_id=MZ6SHSFI7DTZ43JRTYKD5IFLPKMZIOOTTEZ5GPVTMAQA3OJ6STUA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.841271807 (290h23m23.272351938s) [noise=true , address=104.36.82.37:4661 , piece_id=AJ7OZUW2SPWIYMMEOTF3W2OSCZOZPYFDFORDFPLCNR5XK7DXRMCA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.849557210 (290h23m23.280637341s) [noise=true , address=104.36.82.23:4447 , piece_id=CREQI75WCAXZH2HSIHKUCHEP7LXGGVE64VT5DCXTG2XV3QRGYZ5Q, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.854054595 (290h23m23.285134726s) [noise=true , address=77.90.31.15:4705 , piece_id=R23HJMEHYUHNRZST4YTYCKAMN5LRY42FUVUBHO3FGBPZD6QJ7KDA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.878131603 (290h23m23.309211734s) [noise=true , address=104.36.82.44:4883 , piece_id=ANZA6KLXAVNLVMNRLVTLPT3EXWUGPZ7ZP6DWCTGATIRWFDFW4B7A, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.878180417 (290h23m23.309260538s) [seg_pos={0 0}, upload=301982]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:49:28.878299795 (290h23m23.309379926s) [noise=true , address=45.91.116.4:4949 , piece_id=JNRDLVWW277LYQZ2ES4QOHVIFO6XJYJC22K34KWU6OPQIEG3DSJQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MxLbxMQxhM4LASkuABsSUS13bXn3KyrdpijiKNYU9mmyczHrF): protocol: expected piece hash; context canceled; EOF
Aug 20 19:49:28.878363987 (290h23m23.309444118s) [noise=true , address=77.90.31.12:4624 , piece_id=OUXP4Z73VCF6CE3EY5BOWCG5COJX2LHBXNTD6RW2ZK7NBXUVS4DA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KxpgfHEQjqnumtfhQ2TEYCgZPFbUQVShfJA7dgNbnZXpncMnV): protocol: expected piece hash; context canceled; EOF
Aug 20 19:49:28.878379287 (290h23m23.309459408s) [noise=true , address=104.36.82.60:4353 , piece_id=3FBQSKFEZV4DVDXINLBFNGFTGGGD5XPRVBV7DYWVEDX6WOFGDUFA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 20 19:49:28.878418041 (290h23m23.309498172s) [noise=true , address=104.36.82.14:4248 , piece_id=MEH35NPNMFMMFZXKG77FMUHY64HY7WIP5AAGHTVPSVE6RZXBVLLQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u6ir2PLqDa9xGm64cuqq1RqY4qeBa1fqCo9VghspBf54XEXqn): protocol: expected piece hash; context canceled; EOF
Aug 20 19:49:28.878432589 (290h23m23.30951272s) [seg_pos={0 0}, upload=301982]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:49:28.878497964 (290h23m23.309578095s) [upload=301982]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:49:28.878501751 (290h23m23.309581882s) [upload=301982]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:49:29.479829471 (290h23m23.910909602s) [upload=301982]: Done uploading segments...
Aug 20 19:49:29.479848368 (290h23m23.910928499s) [upload=301982]: Upload finished. err: <nil>
Duration: 5.914904677s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..X.........X.....................X.........................] duration:
1.89418862s
FAIL (2025-08-20 19:52:34 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.89421472s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.......X...............X.X.....X..................X....X....] duration:
5.787168948s
FAIL (2025-08-20 19:52:22 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 19:49:26.389896574 (290h23m20.820976705s) [upload=301982]: Starting upload
Aug 20 19:49:26.389949686 (290h23m20.821029817s) [upload=301982]: Done starting upload
Aug 20 19:49:26.390036321 (290h23m20.821116452s) [upload=301982]: Uploading segments...
Aug 20 19:49:26.390137696 (290h23m20.821217827s) [upload=301982]: Got next segment. Inline: false
Aug 20 19:49:26.390175097 (290h23m20.821255228s) [upload=301982]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:49:26.390179705 (290h23m20.821259836s) [upload=301982]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:49:26.840456571 (290h23m21.271536692s) [seg_pos={0 0}, upload=301982]: Begin upload segment...
Aug 20 19:49:26.840499312 (290h23m21.271579443s) [seg_pos={0 0}, upload=301982]: Done begin upload segment.
Aug 20 19:49:26.840528188 (290h23m21.271608319s) [noise=true , address=77.90.31.13:4634 , piece_id=C5X7JX6UNW6KSEWUKHK23FWCJACQBWO5BMGPHX5YZHPGSFXB6NVA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.840531864 (290h23m21.271611995s) [noise=true , address=45.91.116.7:4029 , piece_id=BJZFWAHOIVZYRINKG37TVINBKZ3BGHG5OORZOQ2UFG2X5AV5SAAA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.840868670 (290h23m21.271948801s) [noise=true , address=77.90.31.19:4857 , piece_id=UX6ISUG4W2JB63SYBXDBEFAKDGL7P2GZ2NBERVKPFMZJH72T3RWA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.841147212 (290h23m21.272227343s) [noise=true , address=77.90.31.12:4624 , piece_id=OUXP4Z73VCF6CE3EY5BOWCG5COJX2LHBXNTD6RW2ZK7NBXUVS4DA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.841413511 (290h23m21.272493642s) [noise=true , address=45.91.116.12:4248 , piece_id=LVJCE6WTWNR55EW2NIZ6VSVATA4UORKVBYQDKERKD4JOILVGVOPQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.841677877 (290h23m21.272757998s) [noise=true , address=45.91.116.5:4305 , piece_id=3XZGROXHFYG6T6EYDC6HHB3GFB4VVAW7WFTT77RP3ZPZCOE2XO4Q, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.841970017 (290h23m21.273050148s) [noise=true , address=104.36.82.14:4248 , piece_id=MEH35NPNMFMMFZXKG77FMUHY64HY7WIP5AAGHTVPSVE6RZXBVLLQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.842200487 (290h23m21.273280618s) [noise=true , address=104.36.82.37:4661 , piece_id=AJ7OZUW2SPWIYMMEOTF3W2OSCZOZPYFDFORDFPLCNR5XK7DXRMCA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.842401151 (290h23m21.273481272s) [noise=true , address=77.90.31.15:4705 , piece_id=R23HJMEHYUHNRZST4YTYCKAMN5LRY42FUVUBHO3FGBPZD6QJ7KDA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.842611313 (290h23m21.273691444s) [noise=true , address=104.36.82.60:4353 , piece_id=3FBQSKFEZV4DVDXINLBFNGFTGGGD5XPRVBV7DYWVEDX6WOFGDUFA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.842813540 (290h23m21.273893671s) [noise=true , address=45.91.116.11:4142 , piece_id=BK23NFTPE5NH3FOSYHTJ2UQBRBO3C7SGS7MCSGPP6BCTNN3N77BA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.843022580 (290h23m21.274102701s) [noise=true , address=104.36.82.51:4071 , piece_id=MZ6SHSFI7DTZ43JRTYKD5IFLPKMZIOOTTEZ5GPVTMAQA3OJ6STUA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.843238804 (290h23m21.274318935s) [noise=true , address=104.36.82.23:4447 , piece_id=CREQI75WCAXZH2HSIHKUCHEP7LXGGVE64VT5DCXTG2XV3QRGYZ5Q, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.843446461 (290h23m21.274526592s) [noise=true , address=45.91.116.4:4949 , piece_id=JNRDLVWW277LYQZ2ES4QOHVIFO6XJYJC22K34KWU6OPQIEG3DSJQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.843799737 (290h23m21.274879868s) [noise=true , address=79.127.205.233:4647 , piece_id=6JOSOX5OQ7QETYLZDYHA5ERWCGQUK5EJQUXUJMTOLYQTVDBDCRCQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.844928608 (290h23m21.276008739s) [noise=true , address=45.91.116.13:4159 , piece_id=WVUH6DDG2YVD4UGLZMAHHFSG2JASQ2SPAFQDXU3EA6RYRVBE3AVQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.848536471 (290h23m21.279616602s) [noise=true , address=104.36.82.44:4883 , piece_id=ANZA6KLXAVNLVMNRLVTLPT3EXWUGPZ7ZP6DWCTGATIRWFDFW4B7A, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.850291689 (290h23m21.28137182s) [noise=true , address=104.36.82.5:4872 , piece_id=O3UF3WSPGUFZJC7OYVOVSHQ4GGQ3TYHWEKZECP25N3EV4AHQWMSQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:27.995314800 (290h23m22.426394921s) [upload=301982]: Next returned nil segment
Aug 20 19:49:27.995333715 (290h23m22.426413846s) [upload=301982]: Waiting for error group managing segments...
Aug 20 19:49:28.308895956 (290h23m22.739976087s) [noise=true , address=79.127.205.233:4647 , piece_id=6JOSOX5OQ7QETYLZDYHA5ERWCGQUK5EJQUXUJMTOLYQTVDBDCRCQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.728558835 (290h23m23.159638966s) [noise=true , address=45.91.116.11:4142 , piece_id=BK23NFTPE5NH3FOSYHTJ2UQBRBO3C7SGS7MCSGPP6BCTNN3N77BA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.734009465 (290h23m23.165089596s) [noise=true , address=45.91.116.13:4159 , piece_id=WVUH6DDG2YVD4UGLZMAHHFSG2JASQ2SPAFQDXU3EA6RYRVBE3AVQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.739435837 (290h23m23.170515968s) [noise=true , address=45.91.116.5:4305 , piece_id=3XZGROXHFYG6T6EYDC6HHB3GFB4VVAW7WFTT77RP3ZPZCOE2XO4Q, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.740202443 (290h23m23.171282574s) [noise=true , address=45.91.116.7:4029 , piece_id=BJZFWAHOIVZYRINKG37TVINBKZ3BGHG5OORZOQ2UFG2X5AV5SAAA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.752858218 (290h23m23.183938349s) [noise=true , address=45.91.116.12:4248 , piece_id=LVJCE6WTWNR55EW2NIZ6VSVATA4UORKVBYQDKERKD4JOILVGVOPQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.785780060 (290h23m23.216860202s) [noise=true , address=104.36.82.5:4872 , piece_id=O3UF3WSPGUFZJC7OYVOVSHQ4GGQ3TYHWEKZECP25N3EV4AHQWMSQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.826014212 (290h23m23.257094333s) [noise=true , address=77.90.31.19:4857 , piece_id=UX6ISUG4W2JB63SYBXDBEFAKDGL7P2GZ2NBERVKPFMZJH72T3RWA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.831751040 (290h23m23.262831161s) [noise=true , address=77.90.31.13:4634 , piece_id=C5X7JX6UNW6KSEWUKHK23FWCJACQBWO5BMGPHX5YZHPGSFXB6NVA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.838490104 (290h23m23.269570235s) [noise=true , address=104.36.82.51:4071 , piece_id=MZ6SHSFI7DTZ43JRTYKD5IFLPKMZIOOTTEZ5GPVTMAQA3OJ6STUA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.841271807 (290h23m23.272351938s) [noise=true , address=104.36.82.37:4661 , piece_id=AJ7OZUW2SPWIYMMEOTF3W2OSCZOZPYFDFORDFPLCNR5XK7DXRMCA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.849557210 (290h23m23.280637341s) [noise=true , address=104.36.82.23:4447 , piece_id=CREQI75WCAXZH2HSIHKUCHEP7LXGGVE64VT5DCXTG2XV3QRGYZ5Q, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.854054595 (290h23m23.285134726s) [noise=true , address=77.90.31.15:4705 , piece_id=R23HJMEHYUHNRZST4YTYCKAMN5LRY42FUVUBHO3FGBPZD6QJ7KDA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.878131603 (290h23m23.309211734s) [noise=true , address=104.36.82.44:4883 , piece_id=ANZA6KLXAVNLVMNRLVTLPT3EXWUGPZ7ZP6DWCTGATIRWFDFW4B7A, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.878180417 (290h23m23.309260538s) [seg_pos={0 0}, upload=301982]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:49:28.878299795 (290h23m23.309379926s) [noise=true , address=45.91.116.4:4949 , piece_id=JNRDLVWW277LYQZ2ES4QOHVIFO6XJYJC22K34KWU6OPQIEG3DSJQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MxLbxMQxhM4LASkuABsSUS13bXn3KyrdpijiKNYU9mmyczHrF): protocol: expected piece hash; context canceled; EOF
Aug 20 19:49:28.878363987 (290h23m23.309444118s) [noise=true , address=77.90.31.12:4624 , piece_id=OUXP4Z73VCF6CE3EY5BOWCG5COJX2LHBXNTD6RW2ZK7NBXUVS4DA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KxpgfHEQjqnumtfhQ2TEYCgZPFbUQVShfJA7dgNbnZXpncMnV): protocol: expected piece hash; context canceled; EOF
Aug 20 19:49:28.878379287 (290h23m23.309459408s) [noise=true , address=104.36.82.60:4353 , piece_id=3FBQSKFEZV4DVDXINLBFNGFTGGGD5XPRVBV7DYWVEDX6WOFGDUFA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 20 19:49:28.878418041 (290h23m23.309498172s) [noise=true , address=104.36.82.14:4248 , piece_id=MEH35NPNMFMMFZXKG77FMUHY64HY7WIP5AAGHTVPSVE6RZXBVLLQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u6ir2PLqDa9xGm64cuqq1RqY4qeBa1fqCo9VghspBf54XEXqn): protocol: expected piece hash; context canceled; EOF
Aug 20 19:49:28.878432589 (290h23m23.30951272s) [seg_pos={0 0}, upload=301982]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:49:28.878497964 (290h23m23.309578095s) [upload=301982]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:49:28.878501751 (290h23m23.309581882s) [upload=301982]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:49:29.479829471 (290h23m23.910909602s) [upload=301982]: Done uploading segments...
Aug 20 19:49:29.479848368 (290h23m23.910928499s) [upload=301982]: Upload finished. err: <nil>
Duration: 5.787219635s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...X.........X.....................X........................] duration:
1.849057188s
FAIL (2025-08-20 19:52:04 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.849105771s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [........X...............X.X.....X..................X....X...] duration:
5.819328009s
FAIL (2025-08-20 19:51:58 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 19:49:26.389896574 (290h23m20.820976705s) [upload=301982]: Starting upload
Aug 20 19:49:26.389949686 (290h23m20.821029817s) [upload=301982]: Done starting upload
Aug 20 19:49:26.390036321 (290h23m20.821116452s) [upload=301982]: Uploading segments...
Aug 20 19:49:26.390137696 (290h23m20.821217827s) [upload=301982]: Got next segment. Inline: false
Aug 20 19:49:26.390175097 (290h23m20.821255228s) [upload=301982]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:49:26.390179705 (290h23m20.821259836s) [upload=301982]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:49:26.840456571 (290h23m21.271536692s) [seg_pos={0 0}, upload=301982]: Begin upload segment...
Aug 20 19:49:26.840499312 (290h23m21.271579443s) [seg_pos={0 0}, upload=301982]: Done begin upload segment.
Aug 20 19:49:26.840528188 (290h23m21.271608319s) [noise=true , address=77.90.31.13:4634 , piece_id=C5X7JX6UNW6KSEWUKHK23FWCJACQBWO5BMGPHX5YZHPGSFXB6NVA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.840531864 (290h23m21.271611995s) [noise=true , address=45.91.116.7:4029 , piece_id=BJZFWAHOIVZYRINKG37TVINBKZ3BGHG5OORZOQ2UFG2X5AV5SAAA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.840868670 (290h23m21.271948801s) [noise=true , address=77.90.31.19:4857 , piece_id=UX6ISUG4W2JB63SYBXDBEFAKDGL7P2GZ2NBERVKPFMZJH72T3RWA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.841147212 (290h23m21.272227343s) [noise=true , address=77.90.31.12:4624 , piece_id=OUXP4Z73VCF6CE3EY5BOWCG5COJX2LHBXNTD6RW2ZK7NBXUVS4DA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.841413511 (290h23m21.272493642s) [noise=true , address=45.91.116.12:4248 , piece_id=LVJCE6WTWNR55EW2NIZ6VSVATA4UORKVBYQDKERKD4JOILVGVOPQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.841677877 (290h23m21.272757998s) [noise=true , address=45.91.116.5:4305 , piece_id=3XZGROXHFYG6T6EYDC6HHB3GFB4VVAW7WFTT77RP3ZPZCOE2XO4Q, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.841970017 (290h23m21.273050148s) [noise=true , address=104.36.82.14:4248 , piece_id=MEH35NPNMFMMFZXKG77FMUHY64HY7WIP5AAGHTVPSVE6RZXBVLLQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.842200487 (290h23m21.273280618s) [noise=true , address=104.36.82.37:4661 , piece_id=AJ7OZUW2SPWIYMMEOTF3W2OSCZOZPYFDFORDFPLCNR5XK7DXRMCA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.842401151 (290h23m21.273481272s) [noise=true , address=77.90.31.15:4705 , piece_id=R23HJMEHYUHNRZST4YTYCKAMN5LRY42FUVUBHO3FGBPZD6QJ7KDA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.842611313 (290h23m21.273691444s) [noise=true , address=104.36.82.60:4353 , piece_id=3FBQSKFEZV4DVDXINLBFNGFTGGGD5XPRVBV7DYWVEDX6WOFGDUFA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.842813540 (290h23m21.273893671s) [noise=true , address=45.91.116.11:4142 , piece_id=BK23NFTPE5NH3FOSYHTJ2UQBRBO3C7SGS7MCSGPP6BCTNN3N77BA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.843022580 (290h23m21.274102701s) [noise=true , address=104.36.82.51:4071 , piece_id=MZ6SHSFI7DTZ43JRTYKD5IFLPKMZIOOTTEZ5GPVTMAQA3OJ6STUA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.843238804 (290h23m21.274318935s) [noise=true , address=104.36.82.23:4447 , piece_id=CREQI75WCAXZH2HSIHKUCHEP7LXGGVE64VT5DCXTG2XV3QRGYZ5Q, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.843446461 (290h23m21.274526592s) [noise=true , address=45.91.116.4:4949 , piece_id=JNRDLVWW277LYQZ2ES4QOHVIFO6XJYJC22K34KWU6OPQIEG3DSJQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.843799737 (290h23m21.274879868s) [noise=true , address=79.127.205.233:4647 , piece_id=6JOSOX5OQ7QETYLZDYHA5ERWCGQUK5EJQUXUJMTOLYQTVDBDCRCQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.844928608 (290h23m21.276008739s) [noise=true , address=45.91.116.13:4159 , piece_id=WVUH6DDG2YVD4UGLZMAHHFSG2JASQ2SPAFQDXU3EA6RYRVBE3AVQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.848536471 (290h23m21.279616602s) [noise=true , address=104.36.82.44:4883 , piece_id=ANZA6KLXAVNLVMNRLVTLPT3EXWUGPZ7ZP6DWCTGATIRWFDFW4B7A, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.850291689 (290h23m21.28137182s) [noise=true , address=104.36.82.5:4872 , piece_id=O3UF3WSPGUFZJC7OYVOVSHQ4GGQ3TYHWEKZECP25N3EV4AHQWMSQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:27.995314800 (290h23m22.426394921s) [upload=301982]: Next returned nil segment
Aug 20 19:49:27.995333715 (290h23m22.426413846s) [upload=301982]: Waiting for error group managing segments...
Aug 20 19:49:28.308895956 (290h23m22.739976087s) [noise=true , address=79.127.205.233:4647 , piece_id=6JOSOX5OQ7QETYLZDYHA5ERWCGQUK5EJQUXUJMTOLYQTVDBDCRCQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.728558835 (290h23m23.159638966s) [noise=true , address=45.91.116.11:4142 , piece_id=BK23NFTPE5NH3FOSYHTJ2UQBRBO3C7SGS7MCSGPP6BCTNN3N77BA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.734009465 (290h23m23.165089596s) [noise=true , address=45.91.116.13:4159 , piece_id=WVUH6DDG2YVD4UGLZMAHHFSG2JASQ2SPAFQDXU3EA6RYRVBE3AVQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.739435837 (290h23m23.170515968s) [noise=true , address=45.91.116.5:4305 , piece_id=3XZGROXHFYG6T6EYDC6HHB3GFB4VVAW7WFTT77RP3ZPZCOE2XO4Q, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.740202443 (290h23m23.171282574s) [noise=true , address=45.91.116.7:4029 , piece_id=BJZFWAHOIVZYRINKG37TVINBKZ3BGHG5OORZOQ2UFG2X5AV5SAAA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.752858218 (290h23m23.183938349s) [noise=true , address=45.91.116.12:4248 , piece_id=LVJCE6WTWNR55EW2NIZ6VSVATA4UORKVBYQDKERKD4JOILVGVOPQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.785780060 (290h23m23.216860202s) [noise=true , address=104.36.82.5:4872 , piece_id=O3UF3WSPGUFZJC7OYVOVSHQ4GGQ3TYHWEKZECP25N3EV4AHQWMSQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.826014212 (290h23m23.257094333s) [noise=true , address=77.90.31.19:4857 , piece_id=UX6ISUG4W2JB63SYBXDBEFAKDGL7P2GZ2NBERVKPFMZJH72T3RWA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.831751040 (290h23m23.262831161s) [noise=true , address=77.90.31.13:4634 , piece_id=C5X7JX6UNW6KSEWUKHK23FWCJACQBWO5BMGPHX5YZHPGSFXB6NVA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.838490104 (290h23m23.269570235s) [noise=true , address=104.36.82.51:4071 , piece_id=MZ6SHSFI7DTZ43JRTYKD5IFLPKMZIOOTTEZ5GPVTMAQA3OJ6STUA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.841271807 (290h23m23.272351938s) [noise=true , address=104.36.82.37:4661 , piece_id=AJ7OZUW2SPWIYMMEOTF3W2OSCZOZPYFDFORDFPLCNR5XK7DXRMCA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.849557210 (290h23m23.280637341s) [noise=true , address=104.36.82.23:4447 , piece_id=CREQI75WCAXZH2HSIHKUCHEP7LXGGVE64VT5DCXTG2XV3QRGYZ5Q, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.854054595 (290h23m23.285134726s) [noise=true , address=77.90.31.15:4705 , piece_id=R23HJMEHYUHNRZST4YTYCKAMN5LRY42FUVUBHO3FGBPZD6QJ7KDA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.878131603 (290h23m23.309211734s) [noise=true , address=104.36.82.44:4883 , piece_id=ANZA6KLXAVNLVMNRLVTLPT3EXWUGPZ7ZP6DWCTGATIRWFDFW4B7A, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.878180417 (290h23m23.309260538s) [seg_pos={0 0}, upload=301982]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:49:28.878299795 (290h23m23.309379926s) [noise=true , address=45.91.116.4:4949 , piece_id=JNRDLVWW277LYQZ2ES4QOHVIFO6XJYJC22K34KWU6OPQIEG3DSJQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MxLbxMQxhM4LASkuABsSUS13bXn3KyrdpijiKNYU9mmyczHrF): protocol: expected piece hash; context canceled; EOF
Aug 20 19:49:28.878363987 (290h23m23.309444118s) [noise=true , address=77.90.31.12:4624 , piece_id=OUXP4Z73VCF6CE3EY5BOWCG5COJX2LHBXNTD6RW2ZK7NBXUVS4DA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KxpgfHEQjqnumtfhQ2TEYCgZPFbUQVShfJA7dgNbnZXpncMnV): protocol: expected piece hash; context canceled; EOF
Aug 20 19:49:28.878379287 (290h23m23.309459408s) [noise=true , address=104.36.82.60:4353 , piece_id=3FBQSKFEZV4DVDXINLBFNGFTGGGD5XPRVBV7DYWVEDX6WOFGDUFA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 20 19:49:28.878418041 (290h23m23.309498172s) [noise=true , address=104.36.82.14:4248 , piece_id=MEH35NPNMFMMFZXKG77FMUHY64HY7WIP5AAGHTVPSVE6RZXBVLLQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u6ir2PLqDa9xGm64cuqq1RqY4qeBa1fqCo9VghspBf54XEXqn): protocol: expected piece hash; context canceled; EOF
Aug 20 19:49:28.878432589 (290h23m23.30951272s) [seg_pos={0 0}, upload=301982]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:49:28.878497964 (290h23m23.309578095s) [upload=301982]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:49:28.878501751 (290h23m23.309581882s) [upload=301982]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:49:29.479829471 (290h23m23.910909602s) [upload=301982]: Done uploading segments...
Aug 20 19:49:29.479848368 (290h23m23.910928499s) [upload=301982]: Upload finished. err: <nil>
Duration: 5.819357615s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [....X.........X.....................X.......................] duration:
1.842338293s
FAIL (2025-08-20 19:51:30 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.842368198s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [.........X...............X.X.....X..................X....X..] duration:
6.047819422s
FAIL (2025-08-20 19:51:02 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 19:49:26.389896574 (290h23m20.820976705s) [upload=301982]: Starting upload
Aug 20 19:49:26.389949686 (290h23m20.821029817s) [upload=301982]: Done starting upload
Aug 20 19:49:26.390036321 (290h23m20.821116452s) [upload=301982]: Uploading segments...
Aug 20 19:49:26.390137696 (290h23m20.821217827s) [upload=301982]: Got next segment. Inline: false
Aug 20 19:49:26.390175097 (290h23m20.821255228s) [upload=301982]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:49:26.390179705 (290h23m20.821259836s) [upload=301982]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:49:26.840456571 (290h23m21.271536692s) [seg_pos={0 0}, upload=301982]: Begin upload segment...
Aug 20 19:49:26.840499312 (290h23m21.271579443s) [seg_pos={0 0}, upload=301982]: Done begin upload segment.
Aug 20 19:49:26.840528188 (290h23m21.271608319s) [noise=true , address=77.90.31.13:4634 , piece_id=C5X7JX6UNW6KSEWUKHK23FWCJACQBWO5BMGPHX5YZHPGSFXB6NVA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.840531864 (290h23m21.271611995s) [noise=true , address=45.91.116.7:4029 , piece_id=BJZFWAHOIVZYRINKG37TVINBKZ3BGHG5OORZOQ2UFG2X5AV5SAAA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.840868670 (290h23m21.271948801s) [noise=true , address=77.90.31.19:4857 , piece_id=UX6ISUG4W2JB63SYBXDBEFAKDGL7P2GZ2NBERVKPFMZJH72T3RWA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.841147212 (290h23m21.272227343s) [noise=true , address=77.90.31.12:4624 , piece_id=OUXP4Z73VCF6CE3EY5BOWCG5COJX2LHBXNTD6RW2ZK7NBXUVS4DA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.841413511 (290h23m21.272493642s) [noise=true , address=45.91.116.12:4248 , piece_id=LVJCE6WTWNR55EW2NIZ6VSVATA4UORKVBYQDKERKD4JOILVGVOPQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.841677877 (290h23m21.272757998s) [noise=true , address=45.91.116.5:4305 , piece_id=3XZGROXHFYG6T6EYDC6HHB3GFB4VVAW7WFTT77RP3ZPZCOE2XO4Q, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.841970017 (290h23m21.273050148s) [noise=true , address=104.36.82.14:4248 , piece_id=MEH35NPNMFMMFZXKG77FMUHY64HY7WIP5AAGHTVPSVE6RZXBVLLQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.842200487 (290h23m21.273280618s) [noise=true , address=104.36.82.37:4661 , piece_id=AJ7OZUW2SPWIYMMEOTF3W2OSCZOZPYFDFORDFPLCNR5XK7DXRMCA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.842401151 (290h23m21.273481272s) [noise=true , address=77.90.31.15:4705 , piece_id=R23HJMEHYUHNRZST4YTYCKAMN5LRY42FUVUBHO3FGBPZD6QJ7KDA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.842611313 (290h23m21.273691444s) [noise=true , address=104.36.82.60:4353 , piece_id=3FBQSKFEZV4DVDXINLBFNGFTGGGD5XPRVBV7DYWVEDX6WOFGDUFA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.842813540 (290h23m21.273893671s) [noise=true , address=45.91.116.11:4142 , piece_id=BK23NFTPE5NH3FOSYHTJ2UQBRBO3C7SGS7MCSGPP6BCTNN3N77BA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.843022580 (290h23m21.274102701s) [noise=true , address=104.36.82.51:4071 , piece_id=MZ6SHSFI7DTZ43JRTYKD5IFLPKMZIOOTTEZ5GPVTMAQA3OJ6STUA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.843238804 (290h23m21.274318935s) [noise=true , address=104.36.82.23:4447 , piece_id=CREQI75WCAXZH2HSIHKUCHEP7LXGGVE64VT5DCXTG2XV3QRGYZ5Q, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.843446461 (290h23m21.274526592s) [noise=true , address=45.91.116.4:4949 , piece_id=JNRDLVWW277LYQZ2ES4QOHVIFO6XJYJC22K34KWU6OPQIEG3DSJQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.843799737 (290h23m21.274879868s) [noise=true , address=79.127.205.233:4647 , piece_id=6JOSOX5OQ7QETYLZDYHA5ERWCGQUK5EJQUXUJMTOLYQTVDBDCRCQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.844928608 (290h23m21.276008739s) [noise=true , address=45.91.116.13:4159 , piece_id=WVUH6DDG2YVD4UGLZMAHHFSG2JASQ2SPAFQDXU3EA6RYRVBE3AVQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.848536471 (290h23m21.279616602s) [noise=true , address=104.36.82.44:4883 , piece_id=ANZA6KLXAVNLVMNRLVTLPT3EXWUGPZ7ZP6DWCTGATIRWFDFW4B7A, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.850291689 (290h23m21.28137182s) [noise=true , address=104.36.82.5:4872 , piece_id=O3UF3WSPGUFZJC7OYVOVSHQ4GGQ3TYHWEKZECP25N3EV4AHQWMSQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:27.995314800 (290h23m22.426394921s) [upload=301982]: Next returned nil segment
Aug 20 19:49:27.995333715 (290h23m22.426413846s) [upload=301982]: Waiting for error group managing segments...
Aug 20 19:49:28.308895956 (290h23m22.739976087s) [noise=true , address=79.127.205.233:4647 , piece_id=6JOSOX5OQ7QETYLZDYHA5ERWCGQUK5EJQUXUJMTOLYQTVDBDCRCQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.728558835 (290h23m23.159638966s) [noise=true , address=45.91.116.11:4142 , piece_id=BK23NFTPE5NH3FOSYHTJ2UQBRBO3C7SGS7MCSGPP6BCTNN3N77BA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.734009465 (290h23m23.165089596s) [noise=true , address=45.91.116.13:4159 , piece_id=WVUH6DDG2YVD4UGLZMAHHFSG2JASQ2SPAFQDXU3EA6RYRVBE3AVQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.739435837 (290h23m23.170515968s) [noise=true , address=45.91.116.5:4305 , piece_id=3XZGROXHFYG6T6EYDC6HHB3GFB4VVAW7WFTT77RP3ZPZCOE2XO4Q, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.740202443 (290h23m23.171282574s) [noise=true , address=45.91.116.7:4029 , piece_id=BJZFWAHOIVZYRINKG37TVINBKZ3BGHG5OORZOQ2UFG2X5AV5SAAA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.752858218 (290h23m23.183938349s) [noise=true , address=45.91.116.12:4248 , piece_id=LVJCE6WTWNR55EW2NIZ6VSVATA4UORKVBYQDKERKD4JOILVGVOPQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.785780060 (290h23m23.216860202s) [noise=true , address=104.36.82.5:4872 , piece_id=O3UF3WSPGUFZJC7OYVOVSHQ4GGQ3TYHWEKZECP25N3EV4AHQWMSQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.826014212 (290h23m23.257094333s) [noise=true , address=77.90.31.19:4857 , piece_id=UX6ISUG4W2JB63SYBXDBEFAKDGL7P2GZ2NBERVKPFMZJH72T3RWA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.831751040 (290h23m23.262831161s) [noise=true , address=77.90.31.13:4634 , piece_id=C5X7JX6UNW6KSEWUKHK23FWCJACQBWO5BMGPHX5YZHPGSFXB6NVA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.838490104 (290h23m23.269570235s) [noise=true , address=104.36.82.51:4071 , piece_id=MZ6SHSFI7DTZ43JRTYKD5IFLPKMZIOOTTEZ5GPVTMAQA3OJ6STUA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.841271807 (290h23m23.272351938s) [noise=true , address=104.36.82.37:4661 , piece_id=AJ7OZUW2SPWIYMMEOTF3W2OSCZOZPYFDFORDFPLCNR5XK7DXRMCA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.849557210 (290h23m23.280637341s) [noise=true , address=104.36.82.23:4447 , piece_id=CREQI75WCAXZH2HSIHKUCHEP7LXGGVE64VT5DCXTG2XV3QRGYZ5Q, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.854054595 (290h23m23.285134726s) [noise=true , address=77.90.31.15:4705 , piece_id=R23HJMEHYUHNRZST4YTYCKAMN5LRY42FUVUBHO3FGBPZD6QJ7KDA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.878131603 (290h23m23.309211734s) [noise=true , address=104.36.82.44:4883 , piece_id=ANZA6KLXAVNLVMNRLVTLPT3EXWUGPZ7ZP6DWCTGATIRWFDFW4B7A, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.878180417 (290h23m23.309260538s) [seg_pos={0 0}, upload=301982]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:49:28.878299795 (290h23m23.309379926s) [noise=true , address=45.91.116.4:4949 , piece_id=JNRDLVWW277LYQZ2ES4QOHVIFO6XJYJC22K34KWU6OPQIEG3DSJQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MxLbxMQxhM4LASkuABsSUS13bXn3KyrdpijiKNYU9mmyczHrF): protocol: expected piece hash; context canceled; EOF
Aug 20 19:49:28.878363987 (290h23m23.309444118s) [noise=true , address=77.90.31.12:4624 , piece_id=OUXP4Z73VCF6CE3EY5BOWCG5COJX2LHBXNTD6RW2ZK7NBXUVS4DA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KxpgfHEQjqnumtfhQ2TEYCgZPFbUQVShfJA7dgNbnZXpncMnV): protocol: expected piece hash; context canceled; EOF
Aug 20 19:49:28.878379287 (290h23m23.309459408s) [noise=true , address=104.36.82.60:4353 , piece_id=3FBQSKFEZV4DVDXINLBFNGFTGGGD5XPRVBV7DYWVEDX6WOFGDUFA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 20 19:49:28.878418041 (290h23m23.309498172s) [noise=true , address=104.36.82.14:4248 , piece_id=MEH35NPNMFMMFZXKG77FMUHY64HY7WIP5AAGHTVPSVE6RZXBVLLQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u6ir2PLqDa9xGm64cuqq1RqY4qeBa1fqCo9VghspBf54XEXqn): protocol: expected piece hash; context canceled; EOF
Aug 20 19:49:28.878432589 (290h23m23.30951272s) [seg_pos={0 0}, upload=301982]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:49:28.878497964 (290h23m23.309578095s) [upload=301982]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:49:28.878501751 (290h23m23.309581882s) [upload=301982]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:49:29.479829471 (290h23m23.910909602s) [upload=301982]: Done uploading segments...
Aug 20 19:49:29.479848368 (290h23m23.910928499s) [upload=301982]: Upload finished. err: <nil>
Duration: 6.047844369s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.....X.........X.....................X......................] duration:
1.83624472s
FAIL (2025-08-20 19:51:00 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.836279648s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [..........X...............X.X.....X..................X....X.] duration:
6.023276056s
FAIL (2025-08-20 19:50:13 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 19:49:26.389896574 (290h23m20.820976705s) [upload=301982]: Starting upload
Aug 20 19:49:26.389949686 (290h23m20.821029817s) [upload=301982]: Done starting upload
Aug 20 19:49:26.390036321 (290h23m20.821116452s) [upload=301982]: Uploading segments...
Aug 20 19:49:26.390137696 (290h23m20.821217827s) [upload=301982]: Got next segment. Inline: false
Aug 20 19:49:26.390175097 (290h23m20.821255228s) [upload=301982]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:49:26.390179705 (290h23m20.821259836s) [upload=301982]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:49:26.840456571 (290h23m21.271536692s) [seg_pos={0 0}, upload=301982]: Begin upload segment...
Aug 20 19:49:26.840499312 (290h23m21.271579443s) [seg_pos={0 0}, upload=301982]: Done begin upload segment.
Aug 20 19:49:26.840528188 (290h23m21.271608319s) [noise=true , address=77.90.31.13:4634 , piece_id=C5X7JX6UNW6KSEWUKHK23FWCJACQBWO5BMGPHX5YZHPGSFXB6NVA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.840531864 (290h23m21.271611995s) [noise=true , address=45.91.116.7:4029 , piece_id=BJZFWAHOIVZYRINKG37TVINBKZ3BGHG5OORZOQ2UFG2X5AV5SAAA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.840868670 (290h23m21.271948801s) [noise=true , address=77.90.31.19:4857 , piece_id=UX6ISUG4W2JB63SYBXDBEFAKDGL7P2GZ2NBERVKPFMZJH72T3RWA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.841147212 (290h23m21.272227343s) [noise=true , address=77.90.31.12:4624 , piece_id=OUXP4Z73VCF6CE3EY5BOWCG5COJX2LHBXNTD6RW2ZK7NBXUVS4DA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.841413511 (290h23m21.272493642s) [noise=true , address=45.91.116.12:4248 , piece_id=LVJCE6WTWNR55EW2NIZ6VSVATA4UORKVBYQDKERKD4JOILVGVOPQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.841677877 (290h23m21.272757998s) [noise=true , address=45.91.116.5:4305 , piece_id=3XZGROXHFYG6T6EYDC6HHB3GFB4VVAW7WFTT77RP3ZPZCOE2XO4Q, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.841970017 (290h23m21.273050148s) [noise=true , address=104.36.82.14:4248 , piece_id=MEH35NPNMFMMFZXKG77FMUHY64HY7WIP5AAGHTVPSVE6RZXBVLLQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.842200487 (290h23m21.273280618s) [noise=true , address=104.36.82.37:4661 , piece_id=AJ7OZUW2SPWIYMMEOTF3W2OSCZOZPYFDFORDFPLCNR5XK7DXRMCA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.842401151 (290h23m21.273481272s) [noise=true , address=77.90.31.15:4705 , piece_id=R23HJMEHYUHNRZST4YTYCKAMN5LRY42FUVUBHO3FGBPZD6QJ7KDA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.842611313 (290h23m21.273691444s) [noise=true , address=104.36.82.60:4353 , piece_id=3FBQSKFEZV4DVDXINLBFNGFTGGGD5XPRVBV7DYWVEDX6WOFGDUFA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.842813540 (290h23m21.273893671s) [noise=true , address=45.91.116.11:4142 , piece_id=BK23NFTPE5NH3FOSYHTJ2UQBRBO3C7SGS7MCSGPP6BCTNN3N77BA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.843022580 (290h23m21.274102701s) [noise=true , address=104.36.82.51:4071 , piece_id=MZ6SHSFI7DTZ43JRTYKD5IFLPKMZIOOTTEZ5GPVTMAQA3OJ6STUA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.843238804 (290h23m21.274318935s) [noise=true , address=104.36.82.23:4447 , piece_id=CREQI75WCAXZH2HSIHKUCHEP7LXGGVE64VT5DCXTG2XV3QRGYZ5Q, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.843446461 (290h23m21.274526592s) [noise=true , address=45.91.116.4:4949 , piece_id=JNRDLVWW277LYQZ2ES4QOHVIFO6XJYJC22K34KWU6OPQIEG3DSJQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.843799737 (290h23m21.274879868s) [noise=true , address=79.127.205.233:4647 , piece_id=6JOSOX5OQ7QETYLZDYHA5ERWCGQUK5EJQUXUJMTOLYQTVDBDCRCQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.844928608 (290h23m21.276008739s) [noise=true , address=45.91.116.13:4159 , piece_id=WVUH6DDG2YVD4UGLZMAHHFSG2JASQ2SPAFQDXU3EA6RYRVBE3AVQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.848536471 (290h23m21.279616602s) [noise=true , address=104.36.82.44:4883 , piece_id=ANZA6KLXAVNLVMNRLVTLPT3EXWUGPZ7ZP6DWCTGATIRWFDFW4B7A, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.850291689 (290h23m21.28137182s) [noise=true , address=104.36.82.5:4872 , piece_id=O3UF3WSPGUFZJC7OYVOVSHQ4GGQ3TYHWEKZECP25N3EV4AHQWMSQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:27.995314800 (290h23m22.426394921s) [upload=301982]: Next returned nil segment
Aug 20 19:49:27.995333715 (290h23m22.426413846s) [upload=301982]: Waiting for error group managing segments...
Aug 20 19:49:28.308895956 (290h23m22.739976087s) [noise=true , address=79.127.205.233:4647 , piece_id=6JOSOX5OQ7QETYLZDYHA5ERWCGQUK5EJQUXUJMTOLYQTVDBDCRCQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.728558835 (290h23m23.159638966s) [noise=true , address=45.91.116.11:4142 , piece_id=BK23NFTPE5NH3FOSYHTJ2UQBRBO3C7SGS7MCSGPP6BCTNN3N77BA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.734009465 (290h23m23.165089596s) [noise=true , address=45.91.116.13:4159 , piece_id=WVUH6DDG2YVD4UGLZMAHHFSG2JASQ2SPAFQDXU3EA6RYRVBE3AVQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.739435837 (290h23m23.170515968s) [noise=true , address=45.91.116.5:4305 , piece_id=3XZGROXHFYG6T6EYDC6HHB3GFB4VVAW7WFTT77RP3ZPZCOE2XO4Q, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.740202443 (290h23m23.171282574s) [noise=true , address=45.91.116.7:4029 , piece_id=BJZFWAHOIVZYRINKG37TVINBKZ3BGHG5OORZOQ2UFG2X5AV5SAAA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.752858218 (290h23m23.183938349s) [noise=true , address=45.91.116.12:4248 , piece_id=LVJCE6WTWNR55EW2NIZ6VSVATA4UORKVBYQDKERKD4JOILVGVOPQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.785780060 (290h23m23.216860202s) [noise=true , address=104.36.82.5:4872 , piece_id=O3UF3WSPGUFZJC7OYVOVSHQ4GGQ3TYHWEKZECP25N3EV4AHQWMSQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.826014212 (290h23m23.257094333s) [noise=true , address=77.90.31.19:4857 , piece_id=UX6ISUG4W2JB63SYBXDBEFAKDGL7P2GZ2NBERVKPFMZJH72T3RWA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.831751040 (290h23m23.262831161s) [noise=true , address=77.90.31.13:4634 , piece_id=C5X7JX6UNW6KSEWUKHK23FWCJACQBWO5BMGPHX5YZHPGSFXB6NVA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.838490104 (290h23m23.269570235s) [noise=true , address=104.36.82.51:4071 , piece_id=MZ6SHSFI7DTZ43JRTYKD5IFLPKMZIOOTTEZ5GPVTMAQA3OJ6STUA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.841271807 (290h23m23.272351938s) [noise=true , address=104.36.82.37:4661 , piece_id=AJ7OZUW2SPWIYMMEOTF3W2OSCZOZPYFDFORDFPLCNR5XK7DXRMCA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.849557210 (290h23m23.280637341s) [noise=true , address=104.36.82.23:4447 , piece_id=CREQI75WCAXZH2HSIHKUCHEP7LXGGVE64VT5DCXTG2XV3QRGYZ5Q, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.854054595 (290h23m23.285134726s) [noise=true , address=77.90.31.15:4705 , piece_id=R23HJMEHYUHNRZST4YTYCKAMN5LRY42FUVUBHO3FGBPZD6QJ7KDA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.878131603 (290h23m23.309211734s) [noise=true , address=104.36.82.44:4883 , piece_id=ANZA6KLXAVNLVMNRLVTLPT3EXWUGPZ7ZP6DWCTGATIRWFDFW4B7A, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.878180417 (290h23m23.309260538s) [seg_pos={0 0}, upload=301982]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:49:28.878299795 (290h23m23.309379926s) [noise=true , address=45.91.116.4:4949 , piece_id=JNRDLVWW277LYQZ2ES4QOHVIFO6XJYJC22K34KWU6OPQIEG3DSJQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MxLbxMQxhM4LASkuABsSUS13bXn3KyrdpijiKNYU9mmyczHrF): protocol: expected piece hash; context canceled; EOF
Aug 20 19:49:28.878363987 (290h23m23.309444118s) [noise=true , address=77.90.31.12:4624 , piece_id=OUXP4Z73VCF6CE3EY5BOWCG5COJX2LHBXNTD6RW2ZK7NBXUVS4DA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KxpgfHEQjqnumtfhQ2TEYCgZPFbUQVShfJA7dgNbnZXpncMnV): protocol: expected piece hash; context canceled; EOF
Aug 20 19:49:28.878379287 (290h23m23.309459408s) [noise=true , address=104.36.82.60:4353 , piece_id=3FBQSKFEZV4DVDXINLBFNGFTGGGD5XPRVBV7DYWVEDX6WOFGDUFA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 20 19:49:28.878418041 (290h23m23.309498172s) [noise=true , address=104.36.82.14:4248 , piece_id=MEH35NPNMFMMFZXKG77FMUHY64HY7WIP5AAGHTVPSVE6RZXBVLLQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u6ir2PLqDa9xGm64cuqq1RqY4qeBa1fqCo9VghspBf54XEXqn): protocol: expected piece hash; context canceled; EOF
Aug 20 19:49:28.878432589 (290h23m23.30951272s) [seg_pos={0 0}, upload=301982]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:49:28.878497964 (290h23m23.309578095s) [upload=301982]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:49:28.878501751 (290h23m23.309581882s) [upload=301982]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:49:29.479829471 (290h23m23.910909602s) [upload=301982]: Done uploading segments...
Aug 20 19:49:29.479848368 (290h23m23.910928499s) [upload=301982]: Upload finished. err: <nil>
Duration: 6.023303059s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [......X.........X.....................X.....................] duration:
2.077324287s
FAIL (2025-08-20 19:50:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.077358451s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
6 out of 60 is failed (threshold=3) [...........X...............X.X.....X..................X....X] duration:
4.411314038s
FAIL (2025-08-20 19:49:30 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 19:49:26.389896574 (290h23m20.820976705s) [upload=301982]: Starting upload
Aug 20 19:49:26.389949686 (290h23m20.821029817s) [upload=301982]: Done starting upload
Aug 20 19:49:26.390036321 (290h23m20.821116452s) [upload=301982]: Uploading segments...
Aug 20 19:49:26.390137696 (290h23m20.821217827s) [upload=301982]: Got next segment. Inline: false
Aug 20 19:49:26.390175097 (290h23m20.821255228s) [upload=301982]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:49:26.390179705 (290h23m20.821259836s) [upload=301982]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:49:26.840456571 (290h23m21.271536692s) [seg_pos={0 0}, upload=301982]: Begin upload segment...
Aug 20 19:49:26.840499312 (290h23m21.271579443s) [seg_pos={0 0}, upload=301982]: Done begin upload segment.
Aug 20 19:49:26.840528188 (290h23m21.271608319s) [noise=true , address=77.90.31.13:4634 , piece_id=C5X7JX6UNW6KSEWUKHK23FWCJACQBWO5BMGPHX5YZHPGSFXB6NVA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.840531864 (290h23m21.271611995s) [noise=true , address=45.91.116.7:4029 , piece_id=BJZFWAHOIVZYRINKG37TVINBKZ3BGHG5OORZOQ2UFG2X5AV5SAAA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.840868670 (290h23m21.271948801s) [noise=true , address=77.90.31.19:4857 , piece_id=UX6ISUG4W2JB63SYBXDBEFAKDGL7P2GZ2NBERVKPFMZJH72T3RWA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.841147212 (290h23m21.272227343s) [noise=true , address=77.90.31.12:4624 , piece_id=OUXP4Z73VCF6CE3EY5BOWCG5COJX2LHBXNTD6RW2ZK7NBXUVS4DA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.841413511 (290h23m21.272493642s) [noise=true , address=45.91.116.12:4248 , piece_id=LVJCE6WTWNR55EW2NIZ6VSVATA4UORKVBYQDKERKD4JOILVGVOPQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.841677877 (290h23m21.272757998s) [noise=true , address=45.91.116.5:4305 , piece_id=3XZGROXHFYG6T6EYDC6HHB3GFB4VVAW7WFTT77RP3ZPZCOE2XO4Q, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.841970017 (290h23m21.273050148s) [noise=true , address=104.36.82.14:4248 , piece_id=MEH35NPNMFMMFZXKG77FMUHY64HY7WIP5AAGHTVPSVE6RZXBVLLQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.842200487 (290h23m21.273280618s) [noise=true , address=104.36.82.37:4661 , piece_id=AJ7OZUW2SPWIYMMEOTF3W2OSCZOZPYFDFORDFPLCNR5XK7DXRMCA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.842401151 (290h23m21.273481272s) [noise=true , address=77.90.31.15:4705 , piece_id=R23HJMEHYUHNRZST4YTYCKAMN5LRY42FUVUBHO3FGBPZD6QJ7KDA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.842611313 (290h23m21.273691444s) [noise=true , address=104.36.82.60:4353 , piece_id=3FBQSKFEZV4DVDXINLBFNGFTGGGD5XPRVBV7DYWVEDX6WOFGDUFA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.842813540 (290h23m21.273893671s) [noise=true , address=45.91.116.11:4142 , piece_id=BK23NFTPE5NH3FOSYHTJ2UQBRBO3C7SGS7MCSGPP6BCTNN3N77BA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.843022580 (290h23m21.274102701s) [noise=true , address=104.36.82.51:4071 , piece_id=MZ6SHSFI7DTZ43JRTYKD5IFLPKMZIOOTTEZ5GPVTMAQA3OJ6STUA, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.843238804 (290h23m21.274318935s) [noise=true , address=104.36.82.23:4447 , piece_id=CREQI75WCAXZH2HSIHKUCHEP7LXGGVE64VT5DCXTG2XV3QRGYZ5Q, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.843446461 (290h23m21.274526592s) [noise=true , address=45.91.116.4:4949 , piece_id=JNRDLVWW277LYQZ2ES4QOHVIFO6XJYJC22K34KWU6OPQIEG3DSJQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.843799737 (290h23m21.274879868s) [noise=true , address=79.127.205.233:4647 , piece_id=6JOSOX5OQ7QETYLZDYHA5ERWCGQUK5EJQUXUJMTOLYQTVDBDCRCQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.844928608 (290h23m21.276008739s) [noise=true , address=45.91.116.13:4159 , piece_id=WVUH6DDG2YVD4UGLZMAHHFSG2JASQ2SPAFQDXU3EA6RYRVBE3AVQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.848536471 (290h23m21.279616602s) [noise=true , address=104.36.82.44:4883 , piece_id=ANZA6KLXAVNLVMNRLVTLPT3EXWUGPZ7ZP6DWCTGATIRWFDFW4B7A, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:26.850291689 (290h23m21.28137182s) [noise=true , address=104.36.82.5:4872 , piece_id=O3UF3WSPGUFZJC7OYVOVSHQ4GGQ3TYHWEKZECP25N3EV4AHQWMSQ, seg_pos={0 0}, upload=301982]: Uploading piece...
Aug 20 19:49:27.995314800 (290h23m22.426394921s) [upload=301982]: Next returned nil segment
Aug 20 19:49:27.995333715 (290h23m22.426413846s) [upload=301982]: Waiting for error group managing segments...
Aug 20 19:49:28.308895956 (290h23m22.739976087s) [noise=true , address=79.127.205.233:4647 , piece_id=6JOSOX5OQ7QETYLZDYHA5ERWCGQUK5EJQUXUJMTOLYQTVDBDCRCQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.728558835 (290h23m23.159638966s) [noise=true , address=45.91.116.11:4142 , piece_id=BK23NFTPE5NH3FOSYHTJ2UQBRBO3C7SGS7MCSGPP6BCTNN3N77BA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.734009465 (290h23m23.165089596s) [noise=true , address=45.91.116.13:4159 , piece_id=WVUH6DDG2YVD4UGLZMAHHFSG2JASQ2SPAFQDXU3EA6RYRVBE3AVQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.739435837 (290h23m23.170515968s) [noise=true , address=45.91.116.5:4305 , piece_id=3XZGROXHFYG6T6EYDC6HHB3GFB4VVAW7WFTT77RP3ZPZCOE2XO4Q, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.740202443 (290h23m23.171282574s) [noise=true , address=45.91.116.7:4029 , piece_id=BJZFWAHOIVZYRINKG37TVINBKZ3BGHG5OORZOQ2UFG2X5AV5SAAA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.752858218 (290h23m23.183938349s) [noise=true , address=45.91.116.12:4248 , piece_id=LVJCE6WTWNR55EW2NIZ6VSVATA4UORKVBYQDKERKD4JOILVGVOPQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.785780060 (290h23m23.216860202s) [noise=true , address=104.36.82.5:4872 , piece_id=O3UF3WSPGUFZJC7OYVOVSHQ4GGQ3TYHWEKZECP25N3EV4AHQWMSQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.826014212 (290h23m23.257094333s) [noise=true , address=77.90.31.19:4857 , piece_id=UX6ISUG4W2JB63SYBXDBEFAKDGL7P2GZ2NBERVKPFMZJH72T3RWA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.831751040 (290h23m23.262831161s) [noise=true , address=77.90.31.13:4634 , piece_id=C5X7JX6UNW6KSEWUKHK23FWCJACQBWO5BMGPHX5YZHPGSFXB6NVA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.838490104 (290h23m23.269570235s) [noise=true , address=104.36.82.51:4071 , piece_id=MZ6SHSFI7DTZ43JRTYKD5IFLPKMZIOOTTEZ5GPVTMAQA3OJ6STUA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.841271807 (290h23m23.272351938s) [noise=true , address=104.36.82.37:4661 , piece_id=AJ7OZUW2SPWIYMMEOTF3W2OSCZOZPYFDFORDFPLCNR5XK7DXRMCA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.849557210 (290h23m23.280637341s) [noise=true , address=104.36.82.23:4447 , piece_id=CREQI75WCAXZH2HSIHKUCHEP7LXGGVE64VT5DCXTG2XV3QRGYZ5Q, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.854054595 (290h23m23.285134726s) [noise=true , address=77.90.31.15:4705 , piece_id=R23HJMEHYUHNRZST4YTYCKAMN5LRY42FUVUBHO3FGBPZD6QJ7KDA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.878131603 (290h23m23.309211734s) [noise=true , address=104.36.82.44:4883 , piece_id=ANZA6KLXAVNLVMNRLVTLPT3EXWUGPZ7ZP6DWCTGATIRWFDFW4B7A, seg_pos={0 0}, upload=301982]: Done uploading piece. err: <nil>
Aug 20 19:49:28.878180417 (290h23m23.309260538s) [seg_pos={0 0}, upload=301982]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:49:28.878299795 (290h23m23.309379926s) [noise=true , address=45.91.116.4:4949 , piece_id=JNRDLVWW277LYQZ2ES4QOHVIFO6XJYJC22K34KWU6OPQIEG3DSJQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1MxLbxMQxhM4LASkuABsSUS13bXn3KyrdpijiKNYU9mmyczHrF): protocol: expected piece hash; context canceled; EOF
Aug 20 19:49:28.878363987 (290h23m23.309444118s) [noise=true , address=77.90.31.12:4624 , piece_id=OUXP4Z73VCF6CE3EY5BOWCG5COJX2LHBXNTD6RW2ZK7NBXUVS4DA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1KxpgfHEQjqnumtfhQ2TEYCgZPFbUQVShfJA7dgNbnZXpncMnV): protocol: expected piece hash; context canceled; EOF
Aug 20 19:49:28.878379287 (290h23m23.309459408s) [noise=true , address=104.36.82.60:4353 , piece_id=3FBQSKFEZV4DVDXINLBFNGFTGGGD5XPRVBV7DYWVEDX6WOFGDUFA, seg_pos={0 0}, upload=301982]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12BmzVLKbkqPMB7bJHGzFbgRRLu3TLg6TdTBCvYybsvz2yLpBbQ): protocol: expected piece hash; context canceled; EOF
Aug 20 19:49:28.878418041 (290h23m23.309498172s) [noise=true , address=104.36.82.14:4248 , piece_id=MEH35NPNMFMMFZXKG77FMUHY64HY7WIP5AAGHTVPSVE6RZXBVLLQ, seg_pos={0 0}, upload=301982]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1u6ir2PLqDa9xGm64cuqq1RqY4qeBa1fqCo9VghspBf54XEXqn): protocol: expected piece hash; context canceled; EOF
Aug 20 19:49:28.878432589 (290h23m23.30951272s) [seg_pos={0 0}, upload=301982]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:49:28.878497964 (290h23m23.309578095s) [upload=301982]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:49:28.878501751 (290h23m23.309581882s) [upload=301982]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:49:29.479829471 (290h23m23.910909602s) [upload=301982]: Done uploading segments...
Aug 20 19:49:29.479848368 (290h23m23.910928499s) [upload=301982]: Upload finished. err: <nil>
Duration: 4.411340759s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.......X.........X.....................X....................] duration:
1.897676926s
FAIL (2025-08-20 19:49:25 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.897703076s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [............X...............X.X.....X..................X....] duration:
5.863873219s
FAIL (2025-08-20 19:49:11 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 19:46:35.328710793 (290h20m29.759790914s) [upload=301935]: Starting upload
Aug 20 19:46:35.328776057 (290h20m29.759856188s) [upload=301935]: Done starting upload
Aug 20 19:46:35.328901979 (290h20m29.75998211s) [upload=301935]: Uploading segments...
Aug 20 19:46:35.328981070 (290h20m29.760061211s) [upload=301935]: Got next segment. Inline: false
Aug 20 19:46:35.329016868 (290h20m29.760096989s) [upload=301935]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:46:35.329022900 (290h20m29.760103031s) [upload=301935]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:46:35.782862692 (290h20m30.213942833s) [seg_pos={0 0}, upload=301935]: Begin upload segment...
Aug 20 19:46:35.782927867 (290h20m30.214007998s) [seg_pos={0 0}, upload=301935]: Done begin upload segment.
Aug 20 19:46:35.782959487 (290h20m30.214039618s) [noise=true , address=45.91.116.11:4139 , piece_id=EIXEGMVHMSTD6CYM7RRUWC2QKRSLHDKQS4BGEB3ACO2GRB4DV4YQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.782978122 (290h20m30.214058253s) [noise=true , address=104.36.82.6:4894 , piece_id=BCOP2ZHKGB32NEB32EDDK52UPYMFELZBVEB2BL2ICEGZPQRAKJZQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.783443162 (290h20m30.214523293s) [noise=true , address=104.36.82.35:4594 , piece_id=SKAGFSN7JXMN2IDANUCNVAXNIBOUGZWUVTROGHMO3PCJTJIUR7RQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.783467699 (290h20m30.21454782s) [noise=true , address=104.36.82.14:4232 , piece_id=XUQRQHMFKT63OMJAFRGCOJQKOUKOTKR6S7MZ3LYITSJ3APAFLVAQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.783786900 (290h20m30.214867021s) [noise=true , address=104.36.82.46:4497 , piece_id=7K525RLFBAVFPLOT4EWHXI3JGB65NRVFU73E6PADY3E3EVG5ZVUQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.783833079 (290h20m30.21491321s) [noise=true , address=104.36.82.16:4313 , piece_id=JFEOFDD5E43EBZ4ZCR2IUJDLLOHTX5F4CJPMCW5VQZBSFD2MPAJA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784126249 (290h20m30.21520638s) [noise=true , address=77.90.31.13:4630 , piece_id=SOMMPKDCEMB5P6TWBZ6CAETQ2EXS6ZHG7OGJTN4WWMKDEQTRB5EQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784266808 (290h20m30.215346939s) [noise=true , address=104.36.82.7:4921 , piece_id=KR3WXLMBYHPQW6GKFBZCNDVCO55AF5HFDW7GHY4A35NBF2VBUJSA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784433086 (290h20m30.215513217s) [noise=true , address=45.91.116.6:4977 , piece_id=J5N6DS7OEG35Z33NNXBGZEODPH7SDH3PF4DMGSLGUP6NUSW7ENLA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784595918 (290h20m30.215676049s) [noise=true , address=79.127.219.48:4097 , piece_id=V75X5QZCVTWNI5NCU76VV6N6RBWZKGSCM774GKX4ECZT6YYMIDDA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784728401 (290h20m30.215808522s) [noise=true , address=104.36.82.47:4522 , piece_id=GOAP7AK22ZEKDOEEPDASHKWKRLESMZE74LNT6C3OJ5REUP7CVE4A, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784933665 (290h20m30.216013796s) [noise=true , address=104.36.82.45:4906 , piece_id=OKWLO7XOVCLZUHSPZETTFE7UE7RKPCE3SCNTZIKYJ7JHAY5A6ZPQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.785323050 (290h20m30.216403181s) [noise=true , address=104.36.82.19:4431 , piece_id=JZUV44RZ4TEKFS2DAVSBKDDGLVNS2W7WYVJNFFOK53ST3KA377TA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.785615279 (290h20m30.21669541s) [noise=true , address=45.91.116.12:4233 , piece_id=ZV3EN2CHYXKSOJWJKKJFERYKP3GOLBIXP2IRYYB53RSANIPVROMA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.786508417 (290h20m30.217588538s) [noise=true , address=104.36.82.17:4357 , piece_id=QID6STASSMKYKSVG3AFJZYKW5SC4A6BZ6UCDZK2BXK2AJM6FUVTQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.786789605 (290h20m30.217869736s) [noise=true , address=104.36.82.5:4870 , piece_id=753PO332XLQWWNLOG3NX3L7C7PQE53CTKOLOZR5Z4YKGTQS7OR6Q, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.787036868 (290h20m30.218116999s) [noise=true , address=77.90.31.16:4741 , piece_id=O5KXY2E7HG46FF2UTH6ZF3EX743HR5L5YQMXYHXKXTHRVP6ACF5A, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.787284692 (290h20m30.218364823s) [noise=true , address=104.36.82.15:4285 , piece_id=HAURDWBRWSZSPR7N3MI3G3ZLXXNAYGX6OZOF7XX4QLTX76FUQYLA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:37.274592041 (290h20m31.705672162s) [upload=301935]: Next returned nil segment
Aug 20 19:46:37.274608742 (290h20m31.705688863s) [upload=301935]: Waiting for error group managing segments...
Aug 20 19:46:37.718793251 (290h20m32.149873382s) [noise=true , address=45.91.116.11:4139 , piece_id=EIXEGMVHMSTD6CYM7RRUWC2QKRSLHDKQS4BGEB3ACO2GRB4DV4YQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.724876681 (290h20m32.155956802s) [noise=true , address=79.127.219.48:4097 , piece_id=V75X5QZCVTWNI5NCU76VV6N6RBWZKGSCM774GKX4ECZT6YYMIDDA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.755285034 (290h20m32.186365155s) [noise=true , address=45.91.116.6:4977 , piece_id=J5N6DS7OEG35Z33NNXBGZEODPH7SDH3PF4DMGSLGUP6NUSW7ENLA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.758827161 (290h20m32.189907302s) [noise=true , address=45.91.116.12:4233 , piece_id=ZV3EN2CHYXKSOJWJKKJFERYKP3GOLBIXP2IRYYB53RSANIPVROMA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.764552074 (290h20m32.195632205s) [noise=true , address=104.36.82.35:4594 , piece_id=SKAGFSN7JXMN2IDANUCNVAXNIBOUGZWUVTROGHMO3PCJTJIUR7RQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.765617844 (290h20m32.196697975s) [noise=true , address=104.36.82.14:4232 , piece_id=XUQRQHMFKT63OMJAFRGCOJQKOUKOTKR6S7MZ3LYITSJ3APAFLVAQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.774034979 (290h20m32.20511511s) [noise=true , address=77.90.31.13:4630 , piece_id=SOMMPKDCEMB5P6TWBZ6CAETQ2EXS6ZHG7OGJTN4WWMKDEQTRB5EQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.778493710 (290h20m32.209573841s) [noise=true , address=104.36.82.6:4894 , piece_id=BCOP2ZHKGB32NEB32EDDK52UPYMFELZBVEB2BL2ICEGZPQRAKJZQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.783648643 (290h20m32.214728774s) [noise=true , address=104.36.82.19:4431 , piece_id=JZUV44RZ4TEKFS2DAVSBKDDGLVNS2W7WYVJNFFOK53ST3KA377TA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.791004407 (290h20m32.222084539s) [noise=true , address=104.36.82.46:4497 , piece_id=7K525RLFBAVFPLOT4EWHXI3JGB65NRVFU73E6PADY3E3EVG5ZVUQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.817249904 (290h20m32.248330066s) [noise=true , address=104.36.82.15:4285 , piece_id=HAURDWBRWSZSPR7N3MI3G3ZLXXNAYGX6OZOF7XX4QLTX76FUQYLA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.823175083 (290h20m32.254255214s) [noise=true , address=104.36.82.45:4906 , piece_id=OKWLO7XOVCLZUHSPZETTFE7UE7RKPCE3SCNTZIKYJ7JHAY5A6ZPQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.823260386 (290h20m32.254340507s) [noise=true , address=104.36.82.47:4522 , piece_id=GOAP7AK22ZEKDOEEPDASHKWKRLESMZE74LNT6C3OJ5REUP7CVE4A, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.824825110 (290h20m32.255905241s) [noise=true , address=104.36.82.5:4870 , piece_id=753PO332XLQWWNLOG3NX3L7C7PQE53CTKOLOZR5Z4YKGTQS7OR6Q, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.824841570 (290h20m32.255921702s) [seg_pos={0 0}, upload=301935]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:46:37.824942223 (290h20m32.256022385s) [noise=true , address=104.36.82.7:4921 , piece_id=KR3WXLMBYHPQW6GKFBZCNDVCO55AF5HFDW7GHY4A35NBF2VBUJSA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QKJQDHC2wE9GjN8T92Ah33d6dyA2z3tqM1jg8tUp3J7B8cHww): protocol: expected piece hash; context canceled; EOF
Aug 20 19:46:37.824956762 (290h20m32.256036893s) [noise=true , address=104.36.82.17:4357 , piece_id=QID6STASSMKYKSVG3AFJZYKW5SC4A6BZ6UCDZK2BXK2AJM6FUVTQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1K1edm26dQy31zzdfsqmrnAdgJ28EJZiiKj1GzpeCMwEBYWEp9): protocol: expected piece hash; context canceled; EOF
Aug 20 19:46:37.824995385 (290h20m32.256075506s) [noise=true , address=77.90.31.16:4741 , piece_id=O5KXY2E7HG46FF2UTH6ZF3EX743HR5L5YQMXYHXKXTHRVP6ACF5A, seg_pos={0 0}, upload=301935]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8MCviRyA85FwyuN3sXF9pwWQnP6mki6Ux68Eefx42BeWUcNR): protocol: expected piece hash; context canceled; EOF
Aug 20 19:46:37.825031364 (290h20m32.256111495s) [noise=true , address=104.36.82.16:4313 , piece_id=JFEOFDD5E43EBZ4ZCR2IUJDLLOHTX5F4CJPMCW5VQZBSFD2MPAJA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJzsvcbhmuGGQyUHPVALuTiwt2rmrtRkEY8R1P1AfsUr33kDA): protocol: expected piece hash; context canceled; EOF
Aug 20 19:46:37.825059598 (290h20m32.256139729s) [seg_pos={0 0}, upload=301935]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:46:37.825125795 (290h20m32.256205926s) [upload=301935]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:46:37.825130444 (290h20m32.256210565s) [upload=301935]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:46:38.140237098 (290h20m32.571317229s) [upload=301935]: Done uploading segments...
Aug 20 19:46:38.140257598 (290h20m32.571337729s) [upload=301935]: Upload finished. err: <nil>
Duration: 5.863896113s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.............X...............X.X.....X..................X...] duration:
5.944570706s
FAIL (2025-08-20 19:48:53 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 19:46:35.328710793 (290h20m29.759790914s) [upload=301935]: Starting upload
Aug 20 19:46:35.328776057 (290h20m29.759856188s) [upload=301935]: Done starting upload
Aug 20 19:46:35.328901979 (290h20m29.75998211s) [upload=301935]: Uploading segments...
Aug 20 19:46:35.328981070 (290h20m29.760061211s) [upload=301935]: Got next segment. Inline: false
Aug 20 19:46:35.329016868 (290h20m29.760096989s) [upload=301935]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:46:35.329022900 (290h20m29.760103031s) [upload=301935]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:46:35.782862692 (290h20m30.213942833s) [seg_pos={0 0}, upload=301935]: Begin upload segment...
Aug 20 19:46:35.782927867 (290h20m30.214007998s) [seg_pos={0 0}, upload=301935]: Done begin upload segment.
Aug 20 19:46:35.782959487 (290h20m30.214039618s) [noise=true , address=45.91.116.11:4139 , piece_id=EIXEGMVHMSTD6CYM7RRUWC2QKRSLHDKQS4BGEB3ACO2GRB4DV4YQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.782978122 (290h20m30.214058253s) [noise=true , address=104.36.82.6:4894 , piece_id=BCOP2ZHKGB32NEB32EDDK52UPYMFELZBVEB2BL2ICEGZPQRAKJZQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.783443162 (290h20m30.214523293s) [noise=true , address=104.36.82.35:4594 , piece_id=SKAGFSN7JXMN2IDANUCNVAXNIBOUGZWUVTROGHMO3PCJTJIUR7RQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.783467699 (290h20m30.21454782s) [noise=true , address=104.36.82.14:4232 , piece_id=XUQRQHMFKT63OMJAFRGCOJQKOUKOTKR6S7MZ3LYITSJ3APAFLVAQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.783786900 (290h20m30.214867021s) [noise=true , address=104.36.82.46:4497 , piece_id=7K525RLFBAVFPLOT4EWHXI3JGB65NRVFU73E6PADY3E3EVG5ZVUQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.783833079 (290h20m30.21491321s) [noise=true , address=104.36.82.16:4313 , piece_id=JFEOFDD5E43EBZ4ZCR2IUJDLLOHTX5F4CJPMCW5VQZBSFD2MPAJA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784126249 (290h20m30.21520638s) [noise=true , address=77.90.31.13:4630 , piece_id=SOMMPKDCEMB5P6TWBZ6CAETQ2EXS6ZHG7OGJTN4WWMKDEQTRB5EQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784266808 (290h20m30.215346939s) [noise=true , address=104.36.82.7:4921 , piece_id=KR3WXLMBYHPQW6GKFBZCNDVCO55AF5HFDW7GHY4A35NBF2VBUJSA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784433086 (290h20m30.215513217s) [noise=true , address=45.91.116.6:4977 , piece_id=J5N6DS7OEG35Z33NNXBGZEODPH7SDH3PF4DMGSLGUP6NUSW7ENLA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784595918 (290h20m30.215676049s) [noise=true , address=79.127.219.48:4097 , piece_id=V75X5QZCVTWNI5NCU76VV6N6RBWZKGSCM774GKX4ECZT6YYMIDDA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784728401 (290h20m30.215808522s) [noise=true , address=104.36.82.47:4522 , piece_id=GOAP7AK22ZEKDOEEPDASHKWKRLESMZE74LNT6C3OJ5REUP7CVE4A, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784933665 (290h20m30.216013796s) [noise=true , address=104.36.82.45:4906 , piece_id=OKWLO7XOVCLZUHSPZETTFE7UE7RKPCE3SCNTZIKYJ7JHAY5A6ZPQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.785323050 (290h20m30.216403181s) [noise=true , address=104.36.82.19:4431 , piece_id=JZUV44RZ4TEKFS2DAVSBKDDGLVNS2W7WYVJNFFOK53ST3KA377TA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.785615279 (290h20m30.21669541s) [noise=true , address=45.91.116.12:4233 , piece_id=ZV3EN2CHYXKSOJWJKKJFERYKP3GOLBIXP2IRYYB53RSANIPVROMA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.786508417 (290h20m30.217588538s) [noise=true , address=104.36.82.17:4357 , piece_id=QID6STASSMKYKSVG3AFJZYKW5SC4A6BZ6UCDZK2BXK2AJM6FUVTQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.786789605 (290h20m30.217869736s) [noise=true , address=104.36.82.5:4870 , piece_id=753PO332XLQWWNLOG3NX3L7C7PQE53CTKOLOZR5Z4YKGTQS7OR6Q, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.787036868 (290h20m30.218116999s) [noise=true , address=77.90.31.16:4741 , piece_id=O5KXY2E7HG46FF2UTH6ZF3EX743HR5L5YQMXYHXKXTHRVP6ACF5A, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.787284692 (290h20m30.218364823s) [noise=true , address=104.36.82.15:4285 , piece_id=HAURDWBRWSZSPR7N3MI3G3ZLXXNAYGX6OZOF7XX4QLTX76FUQYLA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:37.274592041 (290h20m31.705672162s) [upload=301935]: Next returned nil segment
Aug 20 19:46:37.274608742 (290h20m31.705688863s) [upload=301935]: Waiting for error group managing segments...
Aug 20 19:46:37.718793251 (290h20m32.149873382s) [noise=true , address=45.91.116.11:4139 , piece_id=EIXEGMVHMSTD6CYM7RRUWC2QKRSLHDKQS4BGEB3ACO2GRB4DV4YQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.724876681 (290h20m32.155956802s) [noise=true , address=79.127.219.48:4097 , piece_id=V75X5QZCVTWNI5NCU76VV6N6RBWZKGSCM774GKX4ECZT6YYMIDDA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.755285034 (290h20m32.186365155s) [noise=true , address=45.91.116.6:4977 , piece_id=J5N6DS7OEG35Z33NNXBGZEODPH7SDH3PF4DMGSLGUP6NUSW7ENLA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.758827161 (290h20m32.189907302s) [noise=true , address=45.91.116.12:4233 , piece_id=ZV3EN2CHYXKSOJWJKKJFERYKP3GOLBIXP2IRYYB53RSANIPVROMA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.764552074 (290h20m32.195632205s) [noise=true , address=104.36.82.35:4594 , piece_id=SKAGFSN7JXMN2IDANUCNVAXNIBOUGZWUVTROGHMO3PCJTJIUR7RQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.765617844 (290h20m32.196697975s) [noise=true , address=104.36.82.14:4232 , piece_id=XUQRQHMFKT63OMJAFRGCOJQKOUKOTKR6S7MZ3LYITSJ3APAFLVAQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.774034979 (290h20m32.20511511s) [noise=true , address=77.90.31.13:4630 , piece_id=SOMMPKDCEMB5P6TWBZ6CAETQ2EXS6ZHG7OGJTN4WWMKDEQTRB5EQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.778493710 (290h20m32.209573841s) [noise=true , address=104.36.82.6:4894 , piece_id=BCOP2ZHKGB32NEB32EDDK52UPYMFELZBVEB2BL2ICEGZPQRAKJZQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.783648643 (290h20m32.214728774s) [noise=true , address=104.36.82.19:4431 , piece_id=JZUV44RZ4TEKFS2DAVSBKDDGLVNS2W7WYVJNFFOK53ST3KA377TA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.791004407 (290h20m32.222084539s) [noise=true , address=104.36.82.46:4497 , piece_id=7K525RLFBAVFPLOT4EWHXI3JGB65NRVFU73E6PADY3E3EVG5ZVUQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.817249904 (290h20m32.248330066s) [noise=true , address=104.36.82.15:4285 , piece_id=HAURDWBRWSZSPR7N3MI3G3ZLXXNAYGX6OZOF7XX4QLTX76FUQYLA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.823175083 (290h20m32.254255214s) [noise=true , address=104.36.82.45:4906 , piece_id=OKWLO7XOVCLZUHSPZETTFE7UE7RKPCE3SCNTZIKYJ7JHAY5A6ZPQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.823260386 (290h20m32.254340507s) [noise=true , address=104.36.82.47:4522 , piece_id=GOAP7AK22ZEKDOEEPDASHKWKRLESMZE74LNT6C3OJ5REUP7CVE4A, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.824825110 (290h20m32.255905241s) [noise=true , address=104.36.82.5:4870 , piece_id=753PO332XLQWWNLOG3NX3L7C7PQE53CTKOLOZR5Z4YKGTQS7OR6Q, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.824841570 (290h20m32.255921702s) [seg_pos={0 0}, upload=301935]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:46:37.824942223 (290h20m32.256022385s) [noise=true , address=104.36.82.7:4921 , piece_id=KR3WXLMBYHPQW6GKFBZCNDVCO55AF5HFDW7GHY4A35NBF2VBUJSA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QKJQDHC2wE9GjN8T92Ah33d6dyA2z3tqM1jg8tUp3J7B8cHww): protocol: expected piece hash; context canceled; EOF
Aug 20 19:46:37.824956762 (290h20m32.256036893s) [noise=true , address=104.36.82.17:4357 , piece_id=QID6STASSMKYKSVG3AFJZYKW5SC4A6BZ6UCDZK2BXK2AJM6FUVTQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1K1edm26dQy31zzdfsqmrnAdgJ28EJZiiKj1GzpeCMwEBYWEp9): protocol: expected piece hash; context canceled; EOF
Aug 20 19:46:37.824995385 (290h20m32.256075506s) [noise=true , address=77.90.31.16:4741 , piece_id=O5KXY2E7HG46FF2UTH6ZF3EX743HR5L5YQMXYHXKXTHRVP6ACF5A, seg_pos={0 0}, upload=301935]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8MCviRyA85FwyuN3sXF9pwWQnP6mki6Ux68Eefx42BeWUcNR): protocol: expected piece hash; context canceled; EOF
Aug 20 19:46:37.825031364 (290h20m32.256111495s) [noise=true , address=104.36.82.16:4313 , piece_id=JFEOFDD5E43EBZ4ZCR2IUJDLLOHTX5F4CJPMCW5VQZBSFD2MPAJA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJzsvcbhmuGGQyUHPVALuTiwt2rmrtRkEY8R1P1AfsUr33kDA): protocol: expected piece hash; context canceled; EOF
Aug 20 19:46:37.825059598 (290h20m32.256139729s) [seg_pos={0 0}, upload=301935]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:46:37.825125795 (290h20m32.256205926s) [upload=301935]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:46:37.825130444 (290h20m32.256210565s) [upload=301935]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:46:38.140237098 (290h20m32.571317229s) [upload=301935]: Done uploading segments...
Aug 20 19:46:38.140257598 (290h20m32.571337729s) [upload=301935]: Upload finished. err: <nil>
Duration: 5.944596916s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [........X.........X.....................X...................] duration:
1.847698648s
FAIL (2025-08-20 19:48:14 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.847731812s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..............X...............X.X.....X..................X..] duration:
6.002739943s
FAIL (2025-08-20 19:48:04 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 19:46:35.328710793 (290h20m29.759790914s) [upload=301935]: Starting upload
Aug 20 19:46:35.328776057 (290h20m29.759856188s) [upload=301935]: Done starting upload
Aug 20 19:46:35.328901979 (290h20m29.75998211s) [upload=301935]: Uploading segments...
Aug 20 19:46:35.328981070 (290h20m29.760061211s) [upload=301935]: Got next segment. Inline: false
Aug 20 19:46:35.329016868 (290h20m29.760096989s) [upload=301935]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:46:35.329022900 (290h20m29.760103031s) [upload=301935]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:46:35.782862692 (290h20m30.213942833s) [seg_pos={0 0}, upload=301935]: Begin upload segment...
Aug 20 19:46:35.782927867 (290h20m30.214007998s) [seg_pos={0 0}, upload=301935]: Done begin upload segment.
Aug 20 19:46:35.782959487 (290h20m30.214039618s) [noise=true , address=45.91.116.11:4139 , piece_id=EIXEGMVHMSTD6CYM7RRUWC2QKRSLHDKQS4BGEB3ACO2GRB4DV4YQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.782978122 (290h20m30.214058253s) [noise=true , address=104.36.82.6:4894 , piece_id=BCOP2ZHKGB32NEB32EDDK52UPYMFELZBVEB2BL2ICEGZPQRAKJZQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.783443162 (290h20m30.214523293s) [noise=true , address=104.36.82.35:4594 , piece_id=SKAGFSN7JXMN2IDANUCNVAXNIBOUGZWUVTROGHMO3PCJTJIUR7RQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.783467699 (290h20m30.21454782s) [noise=true , address=104.36.82.14:4232 , piece_id=XUQRQHMFKT63OMJAFRGCOJQKOUKOTKR6S7MZ3LYITSJ3APAFLVAQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.783786900 (290h20m30.214867021s) [noise=true , address=104.36.82.46:4497 , piece_id=7K525RLFBAVFPLOT4EWHXI3JGB65NRVFU73E6PADY3E3EVG5ZVUQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.783833079 (290h20m30.21491321s) [noise=true , address=104.36.82.16:4313 , piece_id=JFEOFDD5E43EBZ4ZCR2IUJDLLOHTX5F4CJPMCW5VQZBSFD2MPAJA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784126249 (290h20m30.21520638s) [noise=true , address=77.90.31.13:4630 , piece_id=SOMMPKDCEMB5P6TWBZ6CAETQ2EXS6ZHG7OGJTN4WWMKDEQTRB5EQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784266808 (290h20m30.215346939s) [noise=true , address=104.36.82.7:4921 , piece_id=KR3WXLMBYHPQW6GKFBZCNDVCO55AF5HFDW7GHY4A35NBF2VBUJSA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784433086 (290h20m30.215513217s) [noise=true , address=45.91.116.6:4977 , piece_id=J5N6DS7OEG35Z33NNXBGZEODPH7SDH3PF4DMGSLGUP6NUSW7ENLA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784595918 (290h20m30.215676049s) [noise=true , address=79.127.219.48:4097 , piece_id=V75X5QZCVTWNI5NCU76VV6N6RBWZKGSCM774GKX4ECZT6YYMIDDA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784728401 (290h20m30.215808522s) [noise=true , address=104.36.82.47:4522 , piece_id=GOAP7AK22ZEKDOEEPDASHKWKRLESMZE74LNT6C3OJ5REUP7CVE4A, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784933665 (290h20m30.216013796s) [noise=true , address=104.36.82.45:4906 , piece_id=OKWLO7XOVCLZUHSPZETTFE7UE7RKPCE3SCNTZIKYJ7JHAY5A6ZPQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.785323050 (290h20m30.216403181s) [noise=true , address=104.36.82.19:4431 , piece_id=JZUV44RZ4TEKFS2DAVSBKDDGLVNS2W7WYVJNFFOK53ST3KA377TA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.785615279 (290h20m30.21669541s) [noise=true , address=45.91.116.12:4233 , piece_id=ZV3EN2CHYXKSOJWJKKJFERYKP3GOLBIXP2IRYYB53RSANIPVROMA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.786508417 (290h20m30.217588538s) [noise=true , address=104.36.82.17:4357 , piece_id=QID6STASSMKYKSVG3AFJZYKW5SC4A6BZ6UCDZK2BXK2AJM6FUVTQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.786789605 (290h20m30.217869736s) [noise=true , address=104.36.82.5:4870 , piece_id=753PO332XLQWWNLOG3NX3L7C7PQE53CTKOLOZR5Z4YKGTQS7OR6Q, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.787036868 (290h20m30.218116999s) [noise=true , address=77.90.31.16:4741 , piece_id=O5KXY2E7HG46FF2UTH6ZF3EX743HR5L5YQMXYHXKXTHRVP6ACF5A, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.787284692 (290h20m30.218364823s) [noise=true , address=104.36.82.15:4285 , piece_id=HAURDWBRWSZSPR7N3MI3G3ZLXXNAYGX6OZOF7XX4QLTX76FUQYLA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:37.274592041 (290h20m31.705672162s) [upload=301935]: Next returned nil segment
Aug 20 19:46:37.274608742 (290h20m31.705688863s) [upload=301935]: Waiting for error group managing segments...
Aug 20 19:46:37.718793251 (290h20m32.149873382s) [noise=true , address=45.91.116.11:4139 , piece_id=EIXEGMVHMSTD6CYM7RRUWC2QKRSLHDKQS4BGEB3ACO2GRB4DV4YQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.724876681 (290h20m32.155956802s) [noise=true , address=79.127.219.48:4097 , piece_id=V75X5QZCVTWNI5NCU76VV6N6RBWZKGSCM774GKX4ECZT6YYMIDDA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.755285034 (290h20m32.186365155s) [noise=true , address=45.91.116.6:4977 , piece_id=J5N6DS7OEG35Z33NNXBGZEODPH7SDH3PF4DMGSLGUP6NUSW7ENLA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.758827161 (290h20m32.189907302s) [noise=true , address=45.91.116.12:4233 , piece_id=ZV3EN2CHYXKSOJWJKKJFERYKP3GOLBIXP2IRYYB53RSANIPVROMA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.764552074 (290h20m32.195632205s) [noise=true , address=104.36.82.35:4594 , piece_id=SKAGFSN7JXMN2IDANUCNVAXNIBOUGZWUVTROGHMO3PCJTJIUR7RQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.765617844 (290h20m32.196697975s) [noise=true , address=104.36.82.14:4232 , piece_id=XUQRQHMFKT63OMJAFRGCOJQKOUKOTKR6S7MZ3LYITSJ3APAFLVAQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.774034979 (290h20m32.20511511s) [noise=true , address=77.90.31.13:4630 , piece_id=SOMMPKDCEMB5P6TWBZ6CAETQ2EXS6ZHG7OGJTN4WWMKDEQTRB5EQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.778493710 (290h20m32.209573841s) [noise=true , address=104.36.82.6:4894 , piece_id=BCOP2ZHKGB32NEB32EDDK52UPYMFELZBVEB2BL2ICEGZPQRAKJZQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.783648643 (290h20m32.214728774s) [noise=true , address=104.36.82.19:4431 , piece_id=JZUV44RZ4TEKFS2DAVSBKDDGLVNS2W7WYVJNFFOK53ST3KA377TA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.791004407 (290h20m32.222084539s) [noise=true , address=104.36.82.46:4497 , piece_id=7K525RLFBAVFPLOT4EWHXI3JGB65NRVFU73E6PADY3E3EVG5ZVUQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.817249904 (290h20m32.248330066s) [noise=true , address=104.36.82.15:4285 , piece_id=HAURDWBRWSZSPR7N3MI3G3ZLXXNAYGX6OZOF7XX4QLTX76FUQYLA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.823175083 (290h20m32.254255214s) [noise=true , address=104.36.82.45:4906 , piece_id=OKWLO7XOVCLZUHSPZETTFE7UE7RKPCE3SCNTZIKYJ7JHAY5A6ZPQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.823260386 (290h20m32.254340507s) [noise=true , address=104.36.82.47:4522 , piece_id=GOAP7AK22ZEKDOEEPDASHKWKRLESMZE74LNT6C3OJ5REUP7CVE4A, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.824825110 (290h20m32.255905241s) [noise=true , address=104.36.82.5:4870 , piece_id=753PO332XLQWWNLOG3NX3L7C7PQE53CTKOLOZR5Z4YKGTQS7OR6Q, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.824841570 (290h20m32.255921702s) [seg_pos={0 0}, upload=301935]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:46:37.824942223 (290h20m32.256022385s) [noise=true , address=104.36.82.7:4921 , piece_id=KR3WXLMBYHPQW6GKFBZCNDVCO55AF5HFDW7GHY4A35NBF2VBUJSA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QKJQDHC2wE9GjN8T92Ah33d6dyA2z3tqM1jg8tUp3J7B8cHww): protocol: expected piece hash; context canceled; EOF
Aug 20 19:46:37.824956762 (290h20m32.256036893s) [noise=true , address=104.36.82.17:4357 , piece_id=QID6STASSMKYKSVG3AFJZYKW5SC4A6BZ6UCDZK2BXK2AJM6FUVTQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1K1edm26dQy31zzdfsqmrnAdgJ28EJZiiKj1GzpeCMwEBYWEp9): protocol: expected piece hash; context canceled; EOF
Aug 20 19:46:37.824995385 (290h20m32.256075506s) [noise=true , address=77.90.31.16:4741 , piece_id=O5KXY2E7HG46FF2UTH6ZF3EX743HR5L5YQMXYHXKXTHRVP6ACF5A, seg_pos={0 0}, upload=301935]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8MCviRyA85FwyuN3sXF9pwWQnP6mki6Ux68Eefx42BeWUcNR): protocol: expected piece hash; context canceled; EOF
Aug 20 19:46:37.825031364 (290h20m32.256111495s) [noise=true , address=104.36.82.16:4313 , piece_id=JFEOFDD5E43EBZ4ZCR2IUJDLLOHTX5F4CJPMCW5VQZBSFD2MPAJA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJzsvcbhmuGGQyUHPVALuTiwt2rmrtRkEY8R1P1AfsUr33kDA): protocol: expected piece hash; context canceled; EOF
Aug 20 19:46:37.825059598 (290h20m32.256139729s) [seg_pos={0 0}, upload=301935]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:46:37.825125795 (290h20m32.256205926s) [upload=301935]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:46:37.825130444 (290h20m32.256210565s) [upload=301935]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:46:38.140237098 (290h20m32.571317229s) [upload=301935]: Done uploading segments...
Aug 20 19:46:38.140257598 (290h20m32.571337729s) [upload=301935]: Upload finished. err: <nil>
Duration: 6.002808023s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...............X...............X.X.....X..................X.] duration:
5.776909433s
FAIL (2025-08-20 19:47:23 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 19:46:35.328710793 (290h20m29.759790914s) [upload=301935]: Starting upload
Aug 20 19:46:35.328776057 (290h20m29.759856188s) [upload=301935]: Done starting upload
Aug 20 19:46:35.328901979 (290h20m29.75998211s) [upload=301935]: Uploading segments...
Aug 20 19:46:35.328981070 (290h20m29.760061211s) [upload=301935]: Got next segment. Inline: false
Aug 20 19:46:35.329016868 (290h20m29.760096989s) [upload=301935]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:46:35.329022900 (290h20m29.760103031s) [upload=301935]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:46:35.782862692 (290h20m30.213942833s) [seg_pos={0 0}, upload=301935]: Begin upload segment...
Aug 20 19:46:35.782927867 (290h20m30.214007998s) [seg_pos={0 0}, upload=301935]: Done begin upload segment.
Aug 20 19:46:35.782959487 (290h20m30.214039618s) [noise=true , address=45.91.116.11:4139 , piece_id=EIXEGMVHMSTD6CYM7RRUWC2QKRSLHDKQS4BGEB3ACO2GRB4DV4YQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.782978122 (290h20m30.214058253s) [noise=true , address=104.36.82.6:4894 , piece_id=BCOP2ZHKGB32NEB32EDDK52UPYMFELZBVEB2BL2ICEGZPQRAKJZQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.783443162 (290h20m30.214523293s) [noise=true , address=104.36.82.35:4594 , piece_id=SKAGFSN7JXMN2IDANUCNVAXNIBOUGZWUVTROGHMO3PCJTJIUR7RQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.783467699 (290h20m30.21454782s) [noise=true , address=104.36.82.14:4232 , piece_id=XUQRQHMFKT63OMJAFRGCOJQKOUKOTKR6S7MZ3LYITSJ3APAFLVAQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.783786900 (290h20m30.214867021s) [noise=true , address=104.36.82.46:4497 , piece_id=7K525RLFBAVFPLOT4EWHXI3JGB65NRVFU73E6PADY3E3EVG5ZVUQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.783833079 (290h20m30.21491321s) [noise=true , address=104.36.82.16:4313 , piece_id=JFEOFDD5E43EBZ4ZCR2IUJDLLOHTX5F4CJPMCW5VQZBSFD2MPAJA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784126249 (290h20m30.21520638s) [noise=true , address=77.90.31.13:4630 , piece_id=SOMMPKDCEMB5P6TWBZ6CAETQ2EXS6ZHG7OGJTN4WWMKDEQTRB5EQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784266808 (290h20m30.215346939s) [noise=true , address=104.36.82.7:4921 , piece_id=KR3WXLMBYHPQW6GKFBZCNDVCO55AF5HFDW7GHY4A35NBF2VBUJSA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784433086 (290h20m30.215513217s) [noise=true , address=45.91.116.6:4977 , piece_id=J5N6DS7OEG35Z33NNXBGZEODPH7SDH3PF4DMGSLGUP6NUSW7ENLA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784595918 (290h20m30.215676049s) [noise=true , address=79.127.219.48:4097 , piece_id=V75X5QZCVTWNI5NCU76VV6N6RBWZKGSCM774GKX4ECZT6YYMIDDA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784728401 (290h20m30.215808522s) [noise=true , address=104.36.82.47:4522 , piece_id=GOAP7AK22ZEKDOEEPDASHKWKRLESMZE74LNT6C3OJ5REUP7CVE4A, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784933665 (290h20m30.216013796s) [noise=true , address=104.36.82.45:4906 , piece_id=OKWLO7XOVCLZUHSPZETTFE7UE7RKPCE3SCNTZIKYJ7JHAY5A6ZPQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.785323050 (290h20m30.216403181s) [noise=true , address=104.36.82.19:4431 , piece_id=JZUV44RZ4TEKFS2DAVSBKDDGLVNS2W7WYVJNFFOK53ST3KA377TA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.785615279 (290h20m30.21669541s) [noise=true , address=45.91.116.12:4233 , piece_id=ZV3EN2CHYXKSOJWJKKJFERYKP3GOLBIXP2IRYYB53RSANIPVROMA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.786508417 (290h20m30.217588538s) [noise=true , address=104.36.82.17:4357 , piece_id=QID6STASSMKYKSVG3AFJZYKW5SC4A6BZ6UCDZK2BXK2AJM6FUVTQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.786789605 (290h20m30.217869736s) [noise=true , address=104.36.82.5:4870 , piece_id=753PO332XLQWWNLOG3NX3L7C7PQE53CTKOLOZR5Z4YKGTQS7OR6Q, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.787036868 (290h20m30.218116999s) [noise=true , address=77.90.31.16:4741 , piece_id=O5KXY2E7HG46FF2UTH6ZF3EX743HR5L5YQMXYHXKXTHRVP6ACF5A, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.787284692 (290h20m30.218364823s) [noise=true , address=104.36.82.15:4285 , piece_id=HAURDWBRWSZSPR7N3MI3G3ZLXXNAYGX6OZOF7XX4QLTX76FUQYLA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:37.274592041 (290h20m31.705672162s) [upload=301935]: Next returned nil segment
Aug 20 19:46:37.274608742 (290h20m31.705688863s) [upload=301935]: Waiting for error group managing segments...
Aug 20 19:46:37.718793251 (290h20m32.149873382s) [noise=true , address=45.91.116.11:4139 , piece_id=EIXEGMVHMSTD6CYM7RRUWC2QKRSLHDKQS4BGEB3ACO2GRB4DV4YQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.724876681 (290h20m32.155956802s) [noise=true , address=79.127.219.48:4097 , piece_id=V75X5QZCVTWNI5NCU76VV6N6RBWZKGSCM774GKX4ECZT6YYMIDDA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.755285034 (290h20m32.186365155s) [noise=true , address=45.91.116.6:4977 , piece_id=J5N6DS7OEG35Z33NNXBGZEODPH7SDH3PF4DMGSLGUP6NUSW7ENLA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.758827161 (290h20m32.189907302s) [noise=true , address=45.91.116.12:4233 , piece_id=ZV3EN2CHYXKSOJWJKKJFERYKP3GOLBIXP2IRYYB53RSANIPVROMA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.764552074 (290h20m32.195632205s) [noise=true , address=104.36.82.35:4594 , piece_id=SKAGFSN7JXMN2IDANUCNVAXNIBOUGZWUVTROGHMO3PCJTJIUR7RQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.765617844 (290h20m32.196697975s) [noise=true , address=104.36.82.14:4232 , piece_id=XUQRQHMFKT63OMJAFRGCOJQKOUKOTKR6S7MZ3LYITSJ3APAFLVAQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.774034979 (290h20m32.20511511s) [noise=true , address=77.90.31.13:4630 , piece_id=SOMMPKDCEMB5P6TWBZ6CAETQ2EXS6ZHG7OGJTN4WWMKDEQTRB5EQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.778493710 (290h20m32.209573841s) [noise=true , address=104.36.82.6:4894 , piece_id=BCOP2ZHKGB32NEB32EDDK52UPYMFELZBVEB2BL2ICEGZPQRAKJZQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.783648643 (290h20m32.214728774s) [noise=true , address=104.36.82.19:4431 , piece_id=JZUV44RZ4TEKFS2DAVSBKDDGLVNS2W7WYVJNFFOK53ST3KA377TA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.791004407 (290h20m32.222084539s) [noise=true , address=104.36.82.46:4497 , piece_id=7K525RLFBAVFPLOT4EWHXI3JGB65NRVFU73E6PADY3E3EVG5ZVUQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.817249904 (290h20m32.248330066s) [noise=true , address=104.36.82.15:4285 , piece_id=HAURDWBRWSZSPR7N3MI3G3ZLXXNAYGX6OZOF7XX4QLTX76FUQYLA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.823175083 (290h20m32.254255214s) [noise=true , address=104.36.82.45:4906 , piece_id=OKWLO7XOVCLZUHSPZETTFE7UE7RKPCE3SCNTZIKYJ7JHAY5A6ZPQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.823260386 (290h20m32.254340507s) [noise=true , address=104.36.82.47:4522 , piece_id=GOAP7AK22ZEKDOEEPDASHKWKRLESMZE74LNT6C3OJ5REUP7CVE4A, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.824825110 (290h20m32.255905241s) [noise=true , address=104.36.82.5:4870 , piece_id=753PO332XLQWWNLOG3NX3L7C7PQE53CTKOLOZR5Z4YKGTQS7OR6Q, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.824841570 (290h20m32.255921702s) [seg_pos={0 0}, upload=301935]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:46:37.824942223 (290h20m32.256022385s) [noise=true , address=104.36.82.7:4921 , piece_id=KR3WXLMBYHPQW6GKFBZCNDVCO55AF5HFDW7GHY4A35NBF2VBUJSA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QKJQDHC2wE9GjN8T92Ah33d6dyA2z3tqM1jg8tUp3J7B8cHww): protocol: expected piece hash; context canceled; EOF
Aug 20 19:46:37.824956762 (290h20m32.256036893s) [noise=true , address=104.36.82.17:4357 , piece_id=QID6STASSMKYKSVG3AFJZYKW5SC4A6BZ6UCDZK2BXK2AJM6FUVTQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1K1edm26dQy31zzdfsqmrnAdgJ28EJZiiKj1GzpeCMwEBYWEp9): protocol: expected piece hash; context canceled; EOF
Aug 20 19:46:37.824995385 (290h20m32.256075506s) [noise=true , address=77.90.31.16:4741 , piece_id=O5KXY2E7HG46FF2UTH6ZF3EX743HR5L5YQMXYHXKXTHRVP6ACF5A, seg_pos={0 0}, upload=301935]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8MCviRyA85FwyuN3sXF9pwWQnP6mki6Ux68Eefx42BeWUcNR): protocol: expected piece hash; context canceled; EOF
Aug 20 19:46:37.825031364 (290h20m32.256111495s) [noise=true , address=104.36.82.16:4313 , piece_id=JFEOFDD5E43EBZ4ZCR2IUJDLLOHTX5F4CJPMCW5VQZBSFD2MPAJA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJzsvcbhmuGGQyUHPVALuTiwt2rmrtRkEY8R1P1AfsUr33kDA): protocol: expected piece hash; context canceled; EOF
Aug 20 19:46:37.825059598 (290h20m32.256139729s) [seg_pos={0 0}, upload=301935]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:46:37.825125795 (290h20m32.256205926s) [upload=301935]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:46:37.825130444 (290h20m32.256210565s) [upload=301935]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:46:38.140237098 (290h20m32.571317229s) [upload=301935]: Done uploading segments...
Aug 20 19:46:38.140257598 (290h20m32.571337729s) [upload=301935]: Upload finished. err: <nil>
Duration: 5.776937607s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.........X.........X.....................X..................] duration:
1.876424182s
FAIL (2025-08-20 19:47:02 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.876448768s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [................X...............X.X.....X..................X] duration:
4.15060231s
FAIL (2025-08-20 19:46:38 UTC)
orbiter warning:
operation: DownloadObject
======ERROR======
uplink: object not found ("orbiter_us_0/4M")
======LOGS======
Aug 20 19:46:35.328710793 (290h20m29.759790914s) [upload=301935]: Starting upload
Aug 20 19:46:35.328776057 (290h20m29.759856188s) [upload=301935]: Done starting upload
Aug 20 19:46:35.328901979 (290h20m29.75998211s) [upload=301935]: Uploading segments...
Aug 20 19:46:35.328981070 (290h20m29.760061211s) [upload=301935]: Got next segment. Inline: false
Aug 20 19:46:35.329016868 (290h20m29.760096989s) [upload=301935]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:46:35.329022900 (290h20m29.760103031s) [upload=301935]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:46:35.782862692 (290h20m30.213942833s) [seg_pos={0 0}, upload=301935]: Begin upload segment...
Aug 20 19:46:35.782927867 (290h20m30.214007998s) [seg_pos={0 0}, upload=301935]: Done begin upload segment.
Aug 20 19:46:35.782959487 (290h20m30.214039618s) [noise=true , address=45.91.116.11:4139 , piece_id=EIXEGMVHMSTD6CYM7RRUWC2QKRSLHDKQS4BGEB3ACO2GRB4DV4YQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.782978122 (290h20m30.214058253s) [noise=true , address=104.36.82.6:4894 , piece_id=BCOP2ZHKGB32NEB32EDDK52UPYMFELZBVEB2BL2ICEGZPQRAKJZQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.783443162 (290h20m30.214523293s) [noise=true , address=104.36.82.35:4594 , piece_id=SKAGFSN7JXMN2IDANUCNVAXNIBOUGZWUVTROGHMO3PCJTJIUR7RQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.783467699 (290h20m30.21454782s) [noise=true , address=104.36.82.14:4232 , piece_id=XUQRQHMFKT63OMJAFRGCOJQKOUKOTKR6S7MZ3LYITSJ3APAFLVAQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.783786900 (290h20m30.214867021s) [noise=true , address=104.36.82.46:4497 , piece_id=7K525RLFBAVFPLOT4EWHXI3JGB65NRVFU73E6PADY3E3EVG5ZVUQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.783833079 (290h20m30.21491321s) [noise=true , address=104.36.82.16:4313 , piece_id=JFEOFDD5E43EBZ4ZCR2IUJDLLOHTX5F4CJPMCW5VQZBSFD2MPAJA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784126249 (290h20m30.21520638s) [noise=true , address=77.90.31.13:4630 , piece_id=SOMMPKDCEMB5P6TWBZ6CAETQ2EXS6ZHG7OGJTN4WWMKDEQTRB5EQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784266808 (290h20m30.215346939s) [noise=true , address=104.36.82.7:4921 , piece_id=KR3WXLMBYHPQW6GKFBZCNDVCO55AF5HFDW7GHY4A35NBF2VBUJSA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784433086 (290h20m30.215513217s) [noise=true , address=45.91.116.6:4977 , piece_id=J5N6DS7OEG35Z33NNXBGZEODPH7SDH3PF4DMGSLGUP6NUSW7ENLA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784595918 (290h20m30.215676049s) [noise=true , address=79.127.219.48:4097 , piece_id=V75X5QZCVTWNI5NCU76VV6N6RBWZKGSCM774GKX4ECZT6YYMIDDA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784728401 (290h20m30.215808522s) [noise=true , address=104.36.82.47:4522 , piece_id=GOAP7AK22ZEKDOEEPDASHKWKRLESMZE74LNT6C3OJ5REUP7CVE4A, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.784933665 (290h20m30.216013796s) [noise=true , address=104.36.82.45:4906 , piece_id=OKWLO7XOVCLZUHSPZETTFE7UE7RKPCE3SCNTZIKYJ7JHAY5A6ZPQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.785323050 (290h20m30.216403181s) [noise=true , address=104.36.82.19:4431 , piece_id=JZUV44RZ4TEKFS2DAVSBKDDGLVNS2W7WYVJNFFOK53ST3KA377TA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.785615279 (290h20m30.21669541s) [noise=true , address=45.91.116.12:4233 , piece_id=ZV3EN2CHYXKSOJWJKKJFERYKP3GOLBIXP2IRYYB53RSANIPVROMA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.786508417 (290h20m30.217588538s) [noise=true , address=104.36.82.17:4357 , piece_id=QID6STASSMKYKSVG3AFJZYKW5SC4A6BZ6UCDZK2BXK2AJM6FUVTQ, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.786789605 (290h20m30.217869736s) [noise=true , address=104.36.82.5:4870 , piece_id=753PO332XLQWWNLOG3NX3L7C7PQE53CTKOLOZR5Z4YKGTQS7OR6Q, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.787036868 (290h20m30.218116999s) [noise=true , address=77.90.31.16:4741 , piece_id=O5KXY2E7HG46FF2UTH6ZF3EX743HR5L5YQMXYHXKXTHRVP6ACF5A, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:35.787284692 (290h20m30.218364823s) [noise=true , address=104.36.82.15:4285 , piece_id=HAURDWBRWSZSPR7N3MI3G3ZLXXNAYGX6OZOF7XX4QLTX76FUQYLA, seg_pos={0 0}, upload=301935]: Uploading piece...
Aug 20 19:46:37.274592041 (290h20m31.705672162s) [upload=301935]: Next returned nil segment
Aug 20 19:46:37.274608742 (290h20m31.705688863s) [upload=301935]: Waiting for error group managing segments...
Aug 20 19:46:37.718793251 (290h20m32.149873382s) [noise=true , address=45.91.116.11:4139 , piece_id=EIXEGMVHMSTD6CYM7RRUWC2QKRSLHDKQS4BGEB3ACO2GRB4DV4YQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.724876681 (290h20m32.155956802s) [noise=true , address=79.127.219.48:4097 , piece_id=V75X5QZCVTWNI5NCU76VV6N6RBWZKGSCM774GKX4ECZT6YYMIDDA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.755285034 (290h20m32.186365155s) [noise=true , address=45.91.116.6:4977 , piece_id=J5N6DS7OEG35Z33NNXBGZEODPH7SDH3PF4DMGSLGUP6NUSW7ENLA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.758827161 (290h20m32.189907302s) [noise=true , address=45.91.116.12:4233 , piece_id=ZV3EN2CHYXKSOJWJKKJFERYKP3GOLBIXP2IRYYB53RSANIPVROMA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.764552074 (290h20m32.195632205s) [noise=true , address=104.36.82.35:4594 , piece_id=SKAGFSN7JXMN2IDANUCNVAXNIBOUGZWUVTROGHMO3PCJTJIUR7RQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.765617844 (290h20m32.196697975s) [noise=true , address=104.36.82.14:4232 , piece_id=XUQRQHMFKT63OMJAFRGCOJQKOUKOTKR6S7MZ3LYITSJ3APAFLVAQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.774034979 (290h20m32.20511511s) [noise=true , address=77.90.31.13:4630 , piece_id=SOMMPKDCEMB5P6TWBZ6CAETQ2EXS6ZHG7OGJTN4WWMKDEQTRB5EQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.778493710 (290h20m32.209573841s) [noise=true , address=104.36.82.6:4894 , piece_id=BCOP2ZHKGB32NEB32EDDK52UPYMFELZBVEB2BL2ICEGZPQRAKJZQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.783648643 (290h20m32.214728774s) [noise=true , address=104.36.82.19:4431 , piece_id=JZUV44RZ4TEKFS2DAVSBKDDGLVNS2W7WYVJNFFOK53ST3KA377TA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.791004407 (290h20m32.222084539s) [noise=true , address=104.36.82.46:4497 , piece_id=7K525RLFBAVFPLOT4EWHXI3JGB65NRVFU73E6PADY3E3EVG5ZVUQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.817249904 (290h20m32.248330066s) [noise=true , address=104.36.82.15:4285 , piece_id=HAURDWBRWSZSPR7N3MI3G3ZLXXNAYGX6OZOF7XX4QLTX76FUQYLA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.823175083 (290h20m32.254255214s) [noise=true , address=104.36.82.45:4906 , piece_id=OKWLO7XOVCLZUHSPZETTFE7UE7RKPCE3SCNTZIKYJ7JHAY5A6ZPQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.823260386 (290h20m32.254340507s) [noise=true , address=104.36.82.47:4522 , piece_id=GOAP7AK22ZEKDOEEPDASHKWKRLESMZE74LNT6C3OJ5REUP7CVE4A, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.824825110 (290h20m32.255905241s) [noise=true , address=104.36.82.5:4870 , piece_id=753PO332XLQWWNLOG3NX3L7C7PQE53CTKOLOZR5Z4YKGTQS7OR6Q, seg_pos={0 0}, upload=301935]: Done uploading piece. err: <nil>
Aug 20 19:46:37.824841570 (290h20m32.255921702s) [seg_pos={0 0}, upload=301935]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:46:37.824942223 (290h20m32.256022385s) [noise=true , address=104.36.82.7:4921 , piece_id=KR3WXLMBYHPQW6GKFBZCNDVCO55AF5HFDW7GHY4A35NBF2VBUJSA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12QKJQDHC2wE9GjN8T92Ah33d6dyA2z3tqM1jg8tUp3J7B8cHww): protocol: expected piece hash; context canceled; EOF
Aug 20 19:46:37.824956762 (290h20m32.256036893s) [noise=true , address=104.36.82.17:4357 , piece_id=QID6STASSMKYKSVG3AFJZYKW5SC4A6BZ6UCDZK2BXK2AJM6FUVTQ, seg_pos={0 0}, upload=301935]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1K1edm26dQy31zzdfsqmrnAdgJ28EJZiiKj1GzpeCMwEBYWEp9): protocol: expected piece hash; context canceled; EOF
Aug 20 19:46:37.824995385 (290h20m32.256075506s) [noise=true , address=77.90.31.16:4741 , piece_id=O5KXY2E7HG46FF2UTH6ZF3EX743HR5L5YQMXYHXKXTHRVP6ACF5A, seg_pos={0 0}, upload=301935]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12G8MCviRyA85FwyuN3sXF9pwWQnP6mki6Ux68Eefx42BeWUcNR): protocol: expected piece hash; context canceled; EOF
Aug 20 19:46:37.825031364 (290h20m32.256111495s) [noise=true , address=104.36.82.16:4313 , piece_id=JFEOFDD5E43EBZ4ZCR2IUJDLLOHTX5F4CJPMCW5VQZBSFD2MPAJA, seg_pos={0 0}, upload=301935]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1nJzsvcbhmuGGQyUHPVALuTiwt2rmrtRkEY8R1P1AfsUr33kDA): protocol: expected piece hash; context canceled; EOF
Aug 20 19:46:37.825059598 (290h20m32.256139729s) [seg_pos={0 0}, upload=301935]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:46:37.825125795 (290h20m32.256205926s) [upload=301935]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:46:37.825130444 (290h20m32.256210565s) [upload=301935]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:46:38.140237098 (290h20m32.571317229s) [upload=301935]: Done uploading segments...
Aug 20 19:46:38.140257598 (290h20m32.571337729s) [upload=301935]: Upload finished. err: <nil>
Duration: 4.150628892s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..........X.........X.....................X.................] duration:
2.010477333s
FAIL (2025-08-20 19:46:08 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.010503644s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
4 out of 60 is failed (threshold=3) [.................X...............X.X.....X..................] duration:
5.861870205s
FAIL (2025-08-20 19:46:01 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b568cadd53075896d9a9f67a3ed84e708560fd1069bc449791b9daceb2cffb3f != before 639e53acd3452d04d003bb90e49eefbb5504d1634d098b840e64a50ff78f495a
======LOGS======
Aug 20 19:32:32.089131116 (290h6m26.520211247s) [upload=301687]: Starting upload
Aug 20 19:32:32.089177264 (290h6m26.520257396s) [upload=301687]: Done starting upload
Aug 20 19:32:32.089246688 (290h6m26.520326869s) [upload=301687]: Uploading segments...
Aug 20 19:32:32.089367208 (290h6m26.520447339s) [upload=301687]: Got next segment. Inline: false
Aug 20 19:32:32.089397816 (290h6m26.520477947s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:32:32.089404389 (290h6m26.52048452s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:32:32.613157041 (290h6m27.044237172s) [seg_pos={0 0}, upload=301687]: Begin upload segment...
Aug 20 19:32:32.613209281 (290h6m27.044289413s) [seg_pos={0 0}, upload=301687]: Done begin upload segment.
Aug 20 19:32:32.613229410 (290h6m27.044309541s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613339010 (290h6m27.044419141s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613653632 (290h6m27.044733753s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613660916 (290h6m27.044741047s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613955018 (290h6m27.045035149s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613979585 (290h6m27.045059716s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614215267 (290h6m27.045295398s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614281794 (290h6m27.045361925s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614514720 (290h6m27.045594851s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614542102 (290h6m27.045622233s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614732957 (290h6m27.045813088s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614800887 (290h6m27.045881008s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615062678 (290h6m27.046142809s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615336983 (290h6m27.046417114s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615568766 (290h6m27.046648897s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615798575 (290h6m27.046878706s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617005426 (290h6m27.048085557s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617682230 (290h6m27.048772541s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:34.105865393 (290h6m28.536945524s) [upload=301687]: Next returned nil segment
Aug 20 19:32:34.105881013 (290h6m28.536961144s) [upload=301687]: Waiting for error group managing segments...
Aug 20 19:32:34.539014618 (290h6m28.970094749s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.556969872 (290h6m28.988049993s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.557556945 (290h6m28.988637076s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.571050404 (290h6m29.002130535s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.591770689 (290h6m29.02285082s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.605821684 (290h6m29.036901815s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.618279771 (290h6m29.049359902s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.626789182 (290h6m29.057869313s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.647669324 (290h6m29.078749455s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.655712994 (290h6m29.086793125s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.673077660 (290h6m29.104157791s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.699084139 (290h6m29.13016427s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.718394457 (290h6m29.149474578s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774747912 (290h6m29.205828043s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774777999 (290h6m29.20585813s) [seg_pos={0 0}, upload=301687]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:32:34.774902227 (290h6m29.205982358s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.774962362 (290h6m29.206042493s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aqgkDxFY3xZa9s2vq1DdCFFX2725aDicrxfvoYuXPfe4ozkHV): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775005355 (290h6m29.206085486s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775063957 (290h6m29.206144078s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z8JVuzQEZEbm8iKcAVmtfQNaEQxP9EG1exJDL2MozCv6cVoQk): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775102200 (290h6m29.206182331s) [seg_pos={0 0}, upload=301687]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:32:34.775192874 (290h6m29.206273005s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:32:34.775197803 (290h6m29.206277934s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:32:35.133554531 (290h6m29.564634662s) [upload=301687]: Done uploading segments...
Aug 20 19:32:35.133574119 (290h6m29.56465425s) [upload=301687]: Upload finished. err: <nil>
Duration: 5.861899262s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [X.................X...............X.X.....X.................] duration:
5.926079115s
FAIL (2025-08-20 19:45:35 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b568cadd53075896d9a9f67a3ed84e708560fd1069bc449791b9daceb2cffb3f != before 639e53acd3452d04d003bb90e49eefbb5504d1634d098b840e64a50ff78f495a
======LOGS======
Aug 20 19:32:32.089131116 (290h6m26.520211247s) [upload=301687]: Starting upload
Aug 20 19:32:32.089177264 (290h6m26.520257396s) [upload=301687]: Done starting upload
Aug 20 19:32:32.089246688 (290h6m26.520326869s) [upload=301687]: Uploading segments...
Aug 20 19:32:32.089367208 (290h6m26.520447339s) [upload=301687]: Got next segment. Inline: false
Aug 20 19:32:32.089397816 (290h6m26.520477947s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:32:32.089404389 (290h6m26.52048452s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:32:32.613157041 (290h6m27.044237172s) [seg_pos={0 0}, upload=301687]: Begin upload segment...
Aug 20 19:32:32.613209281 (290h6m27.044289413s) [seg_pos={0 0}, upload=301687]: Done begin upload segment.
Aug 20 19:32:32.613229410 (290h6m27.044309541s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613339010 (290h6m27.044419141s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613653632 (290h6m27.044733753s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613660916 (290h6m27.044741047s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613955018 (290h6m27.045035149s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613979585 (290h6m27.045059716s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614215267 (290h6m27.045295398s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614281794 (290h6m27.045361925s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614514720 (290h6m27.045594851s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614542102 (290h6m27.045622233s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614732957 (290h6m27.045813088s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614800887 (290h6m27.045881008s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615062678 (290h6m27.046142809s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615336983 (290h6m27.046417114s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615568766 (290h6m27.046648897s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615798575 (290h6m27.046878706s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617005426 (290h6m27.048085557s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617682230 (290h6m27.048772541s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:34.105865393 (290h6m28.536945524s) [upload=301687]: Next returned nil segment
Aug 20 19:32:34.105881013 (290h6m28.536961144s) [upload=301687]: Waiting for error group managing segments...
Aug 20 19:32:34.539014618 (290h6m28.970094749s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.556969872 (290h6m28.988049993s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.557556945 (290h6m28.988637076s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.571050404 (290h6m29.002130535s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.591770689 (290h6m29.02285082s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.605821684 (290h6m29.036901815s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.618279771 (290h6m29.049359902s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.626789182 (290h6m29.057869313s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.647669324 (290h6m29.078749455s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.655712994 (290h6m29.086793125s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.673077660 (290h6m29.104157791s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.699084139 (290h6m29.13016427s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.718394457 (290h6m29.149474578s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774747912 (290h6m29.205828043s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774777999 (290h6m29.20585813s) [seg_pos={0 0}, upload=301687]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:32:34.774902227 (290h6m29.205982358s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.774962362 (290h6m29.206042493s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aqgkDxFY3xZa9s2vq1DdCFFX2725aDicrxfvoYuXPfe4ozkHV): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775005355 (290h6m29.206085486s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775063957 (290h6m29.206144078s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z8JVuzQEZEbm8iKcAVmtfQNaEQxP9EG1exJDL2MozCv6cVoQk): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775102200 (290h6m29.206182331s) [seg_pos={0 0}, upload=301687]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:32:34.775192874 (290h6m29.206273005s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:32:34.775197803 (290h6m29.206277934s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:32:35.133554531 (290h6m29.564634662s) [upload=301687]: Done uploading segments...
Aug 20 19:32:35.133574119 (290h6m29.56465425s) [upload=301687]: Upload finished. err: <nil>
Duration: 5.926103042s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [...........X.........X.....................X................] duration:
1.881636505s
FAIL (2025-08-20 19:44:54 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.881663577s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [.X.................X...............X.X.....X................] duration:
5.876188852s
FAIL (2025-08-20 19:44:21 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b568cadd53075896d9a9f67a3ed84e708560fd1069bc449791b9daceb2cffb3f != before 639e53acd3452d04d003bb90e49eefbb5504d1634d098b840e64a50ff78f495a
======LOGS======
Aug 20 19:32:32.089131116 (290h6m26.520211247s) [upload=301687]: Starting upload
Aug 20 19:32:32.089177264 (290h6m26.520257396s) [upload=301687]: Done starting upload
Aug 20 19:32:32.089246688 (290h6m26.520326869s) [upload=301687]: Uploading segments...
Aug 20 19:32:32.089367208 (290h6m26.520447339s) [upload=301687]: Got next segment. Inline: false
Aug 20 19:32:32.089397816 (290h6m26.520477947s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:32:32.089404389 (290h6m26.52048452s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:32:32.613157041 (290h6m27.044237172s) [seg_pos={0 0}, upload=301687]: Begin upload segment...
Aug 20 19:32:32.613209281 (290h6m27.044289413s) [seg_pos={0 0}, upload=301687]: Done begin upload segment.
Aug 20 19:32:32.613229410 (290h6m27.044309541s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613339010 (290h6m27.044419141s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613653632 (290h6m27.044733753s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613660916 (290h6m27.044741047s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613955018 (290h6m27.045035149s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613979585 (290h6m27.045059716s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614215267 (290h6m27.045295398s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614281794 (290h6m27.045361925s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614514720 (290h6m27.045594851s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614542102 (290h6m27.045622233s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614732957 (290h6m27.045813088s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614800887 (290h6m27.045881008s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615062678 (290h6m27.046142809s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615336983 (290h6m27.046417114s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615568766 (290h6m27.046648897s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615798575 (290h6m27.046878706s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617005426 (290h6m27.048085557s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617682230 (290h6m27.048772541s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:34.105865393 (290h6m28.536945524s) [upload=301687]: Next returned nil segment
Aug 20 19:32:34.105881013 (290h6m28.536961144s) [upload=301687]: Waiting for error group managing segments...
Aug 20 19:32:34.539014618 (290h6m28.970094749s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.556969872 (290h6m28.988049993s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.557556945 (290h6m28.988637076s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.571050404 (290h6m29.002130535s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.591770689 (290h6m29.02285082s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.605821684 (290h6m29.036901815s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.618279771 (290h6m29.049359902s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.626789182 (290h6m29.057869313s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.647669324 (290h6m29.078749455s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.655712994 (290h6m29.086793125s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.673077660 (290h6m29.104157791s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.699084139 (290h6m29.13016427s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.718394457 (290h6m29.149474578s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774747912 (290h6m29.205828043s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774777999 (290h6m29.20585813s) [seg_pos={0 0}, upload=301687]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:32:34.774902227 (290h6m29.205982358s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.774962362 (290h6m29.206042493s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aqgkDxFY3xZa9s2vq1DdCFFX2725aDicrxfvoYuXPfe4ozkHV): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775005355 (290h6m29.206085486s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775063957 (290h6m29.206144078s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z8JVuzQEZEbm8iKcAVmtfQNaEQxP9EG1exJDL2MozCv6cVoQk): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775102200 (290h6m29.206182331s) [seg_pos={0 0}, upload=301687]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:32:34.775192874 (290h6m29.206273005s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:32:34.775197803 (290h6m29.206277934s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:32:35.133554531 (290h6m29.564634662s) [upload=301687]: Done uploading segments...
Aug 20 19:32:35.133574119 (290h6m29.56465425s) [upload=301687]: Upload finished. err: <nil>
Duration: 5.876215393s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [..X.................X...............X.X.....X...............] duration:
5.783861188s
FAIL (2025-08-20 19:43:57 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b568cadd53075896d9a9f67a3ed84e708560fd1069bc449791b9daceb2cffb3f != before 639e53acd3452d04d003bb90e49eefbb5504d1634d098b840e64a50ff78f495a
======LOGS======
Aug 20 19:32:32.089131116 (290h6m26.520211247s) [upload=301687]: Starting upload
Aug 20 19:32:32.089177264 (290h6m26.520257396s) [upload=301687]: Done starting upload
Aug 20 19:32:32.089246688 (290h6m26.520326869s) [upload=301687]: Uploading segments...
Aug 20 19:32:32.089367208 (290h6m26.520447339s) [upload=301687]: Got next segment. Inline: false
Aug 20 19:32:32.089397816 (290h6m26.520477947s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:32:32.089404389 (290h6m26.52048452s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:32:32.613157041 (290h6m27.044237172s) [seg_pos={0 0}, upload=301687]: Begin upload segment...
Aug 20 19:32:32.613209281 (290h6m27.044289413s) [seg_pos={0 0}, upload=301687]: Done begin upload segment.
Aug 20 19:32:32.613229410 (290h6m27.044309541s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613339010 (290h6m27.044419141s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613653632 (290h6m27.044733753s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613660916 (290h6m27.044741047s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613955018 (290h6m27.045035149s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613979585 (290h6m27.045059716s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614215267 (290h6m27.045295398s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614281794 (290h6m27.045361925s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614514720 (290h6m27.045594851s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614542102 (290h6m27.045622233s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614732957 (290h6m27.045813088s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614800887 (290h6m27.045881008s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615062678 (290h6m27.046142809s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615336983 (290h6m27.046417114s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615568766 (290h6m27.046648897s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615798575 (290h6m27.046878706s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617005426 (290h6m27.048085557s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617682230 (290h6m27.048772541s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:34.105865393 (290h6m28.536945524s) [upload=301687]: Next returned nil segment
Aug 20 19:32:34.105881013 (290h6m28.536961144s) [upload=301687]: Waiting for error group managing segments...
Aug 20 19:32:34.539014618 (290h6m28.970094749s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.556969872 (290h6m28.988049993s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.557556945 (290h6m28.988637076s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.571050404 (290h6m29.002130535s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.591770689 (290h6m29.02285082s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.605821684 (290h6m29.036901815s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.618279771 (290h6m29.049359902s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.626789182 (290h6m29.057869313s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.647669324 (290h6m29.078749455s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.655712994 (290h6m29.086793125s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.673077660 (290h6m29.104157791s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.699084139 (290h6m29.13016427s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.718394457 (290h6m29.149474578s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774747912 (290h6m29.205828043s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774777999 (290h6m29.20585813s) [seg_pos={0 0}, upload=301687]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:32:34.774902227 (290h6m29.205982358s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.774962362 (290h6m29.206042493s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aqgkDxFY3xZa9s2vq1DdCFFX2725aDicrxfvoYuXPfe4ozkHV): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775005355 (290h6m29.206085486s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775063957 (290h6m29.206144078s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z8JVuzQEZEbm8iKcAVmtfQNaEQxP9EG1exJDL2MozCv6cVoQk): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775102200 (290h6m29.206182331s) [seg_pos={0 0}, upload=301687]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:32:34.775192874 (290h6m29.206273005s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:32:34.775197803 (290h6m29.206277934s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:32:35.133554531 (290h6m29.564634662s) [upload=301687]: Done uploading segments...
Aug 20 19:32:35.133574119 (290h6m29.56465425s) [upload=301687]: Upload finished. err: <nil>
Duration: 5.783887457s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [............X.........X.....................X...............] duration:
2.055368907s
FAIL (2025-08-20 19:43:57 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 2.055401439s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.remote)antiblip:
5 out of 60 is failed (threshold=3) [...X.................X...............X.X.....X..............] duration:
5.716935303s
FAIL (2025-08-20 19:43:19 UTC)
orbiter warning:
operation: sync2.Copy
======ERROR======
digest mismatch when downloading object (sj://uptime-checks-placement-20/orbiter_us_0/4M):: after b568cadd53075896d9a9f67a3ed84e708560fd1069bc449791b9daceb2cffb3f != before 639e53acd3452d04d003bb90e49eefbb5504d1634d098b840e64a50ff78f495a
======LOGS======
Aug 20 19:32:32.089131116 (290h6m26.520211247s) [upload=301687]: Starting upload
Aug 20 19:32:32.089177264 (290h6m26.520257396s) [upload=301687]: Done starting upload
Aug 20 19:32:32.089246688 (290h6m26.520326869s) [upload=301687]: Uploading segments...
Aug 20 19:32:32.089367208 (290h6m26.520447339s) [upload=301687]: Got next segment. Inline: false
Aug 20 19:32:32.089397816 (290h6m26.520477947s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectBegin
Aug 20 19:32:32.089404389 (290h6m26.52048452s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentBegin
Aug 20 19:32:32.613157041 (290h6m27.044237172s) [seg_pos={0 0}, upload=301687]: Begin upload segment...
Aug 20 19:32:32.613209281 (290h6m27.044289413s) [seg_pos={0 0}, upload=301687]: Done begin upload segment.
Aug 20 19:32:32.613229410 (290h6m27.044309541s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613339010 (290h6m27.044419141s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613653632 (290h6m27.044733753s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613660916 (290h6m27.044741047s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613955018 (290h6m27.045035149s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.613979585 (290h6m27.045059716s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614215267 (290h6m27.045295398s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614281794 (290h6m27.045361925s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614514720 (290h6m27.045594851s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614542102 (290h6m27.045622233s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614732957 (290h6m27.045813088s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.614800887 (290h6m27.045881008s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615062678 (290h6m27.046142809s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615336983 (290h6m27.046417114s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615568766 (290h6m27.046648897s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.615798575 (290h6m27.046878706s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617005426 (290h6m27.048085557s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:32.617682230 (290h6m27.048772541s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Uploading piece...
Aug 20 19:32:34.105865393 (290h6m28.536945524s) [upload=301687]: Next returned nil segment
Aug 20 19:32:34.105881013 (290h6m28.536961144s) [upload=301687]: Waiting for error group managing segments...
Aug 20 19:32:34.539014618 (290h6m28.970094749s) [noise=true , address=45.91.116.11:4133 , piece_id=EI4GL53AVPYVRWT4GQ2TQSB7VGOS6OCKNHI7MAQ5F7F5FAWIDAXA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.556969872 (290h6m28.988049993s) [noise=true , address=77.90.31.18:4829 , piece_id=EJZJ7WCWI2SD2ANDYCCZGNS4XDCVD3TEXOUX2MGGW76SAEKIQC2A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.557556945 (290h6m28.988637076s) [noise=true , address=79.127.219.47:4072 , piece_id=2YVNXMCQYA7GG4DQXWOGGBRWJ2SDYUGZXFOGZRJMUVSBNSRTTSVA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.571050404 (290h6m29.002130535s) [noise=true , address=104.36.82.5:4858 , piece_id=WDJ43TUFR42Q4EXE2RZIPHVKS7444HZQHFFVPPQ62LMOINVBLGSA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.591770689 (290h6m29.02285082s) [noise=true , address=45.91.116.9:4272 , piece_id=5VMCK7CMW3EURWSYFFULUPXVGWX76SUM5ZGQQSHDCAEMZBJAIUZQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.605821684 (290h6m29.036901815s) [noise=true , address=77.90.31.13:4635 , piece_id=RU2KMSZU52EFOPPYJP6DJOJNH3IIQQQNBHHPKEUX2F5W2KL64KNQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.618279771 (290h6m29.049359902s) [noise=true , address=77.90.31.10:4541 , piece_id=QETIKBVKIJZS6DUCYHCTR5P7FKK7F4SM2AALVKKE4ANEIJNW42BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.626789182 (290h6m29.057869313s) [noise=true , address=104.36.82.11:4120 , piece_id=3Y7BGV5PWKZSTKRTORXGL3JY42LLJKPTI7E2CRZ5QHSTUIRSEAPQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.647669324 (290h6m29.078749455s) [noise=true , address=104.36.82.51:4083 , piece_id=3CBUBK6HS7QUIKXLPO7O3SPAIYSJ6C6KP67UUHTY73NF6BA2LDTA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.655712994 (290h6m29.086793125s) [noise=true , address=104.36.82.42:4825 , piece_id=L5QTC455QVAJ7EMSCTW2RRGD3AEJF3QM2PQHYLFGSV4GFIKISNXQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.673077660 (290h6m29.104157791s) [noise=true , address=77.90.31.18:4812 , piece_id=QNXFUTWJ4AHIVDTRAVSNRAHTZGCNLOENU6CX62PHRVF3H7HIP35A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.699084139 (290h6m29.13016427s) [noise=true , address=45.91.116.10:4087 , piece_id=Z6N4R2NI62DAGNXX3DJ674W2RCLBBP2IN3ASCF27BGHG3GQOBO6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.718394457 (290h6m29.149474578s) [noise=true , address=45.91.116.6:4993 , piece_id=BN6AMUBKR7YHUUUKDTFJCSGEU55QGLARXEBO6TQPA6BOS75CONWA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774747912 (290h6m29.205828043s) [noise=true , address=45.91.116.4:4949 , piece_id=VIL3C3INLHN7XJ4PSK47ZVBS6OA45BMRN2E3ICWPQAXPZ6MRJ7BA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: <nil>
Aug 20 19:32:34.774777999 (290h6m29.20585813s) [seg_pos={0 0}, upload=301687]: Segment reached optimal threshold of 14 pieces.
Aug 20 19:32:34.774902227 (290h6m29.205982358s) [noise=true , address=104.36.82.23:4479 , piece_id=LDCSWFKP3JODWXRSICWJAVOHDNQZYIUKVCLRHYFIYYCU5IFTK55A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14Nnr21538kCTXCDrzPpSHYWAsnd85aT3A3jKPyLcuMvSShjAW): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.774962362 (290h6m29.206042493s) [noise=true , address=77.90.31.21:4884 , piece_id=GAILEKKREJAY2HXZCYEGEEFQOCSKGNXYWIMA7ASOPQS35ZTJUEJA, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12aqgkDxFY3xZa9s2vq1DdCFFX2725aDicrxfvoYuXPfe4ozkHV): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775005355 (290h6m29.206085486s) [noise=true , address=77.90.31.11:4583 , piece_id=NPOV6MEWAKCTMSZTTD62ABHO353UYP53EKQQBE6IVJ2AMFNCQZDQ, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Ttdx6LHmuAt8JVC7arCDgWjm9eLadjeaEw17F12btoXuSiq9t): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775063957 (290h6m29.206144078s) [noise=true , address=104.36.82.49:4994 , piece_id=H7YSFWO2XOXLVUECASV6ZHWZZ6W4Y6BBHFC3AH46DBRRDPE6DG6A, seg_pos={0 0}, upload=301687]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12Z8JVuzQEZEbm8iKcAVmtfQNaEQxP9EG1exJDL2MozCv6cVoQk): protocol: expected piece hash; context canceled; EOF
Aug 20 19:32:34.775102200 (290h6m29.206182331s) [seg_pos={0 0}, upload=301687]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil>
Aug 20 19:32:34.775192874 (290h6m29.206273005s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_SegmentCommit
Aug 20 19:32:34.775197803 (290h6m29.206277934s) [upload=301687]: Flush batch item: *pb.BatchRequestItem_ObjectCommit
Aug 20 19:32:35.133554531 (290h6m29.564634662s) [upload=301687]: Done uploading segments...
Aug 20 19:32:35.133574119 (290h6m29.56465425s) [upload=301687]: Upload finished. err: <nil>
Duration: 5.716963748s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [.............X.........X.....................X..............] duration:
1.945404394s
FAIL (2025-08-20 19:43:18 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.945430596s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "orbiter_us_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.metainfo_projects.inline)antiblip:
3 out of 60 is failed (threshold=3) [..............X.........X.....................X.............] duration:
1.837269894s
FAIL (2025-08-20 19:42:47 UTC)
orbiter warning: operation: Commit ======ERROR====== uplink: too many requests ======LOGS====== Aug 20 19:32:32.902946106 (290h6m27.334026237s) [upload=301688]: Starting upload Aug 20 19:32:32.902993046 (290h6m27.334073167s) [upload=301688]: Done starting upload Aug 20 19:32:32.903046258 (290h6m27.334126389s) [upload=301688]: Uploading segments... Aug 20 19:32:32.903079781 (290h6m27.334159913s) [upload=301688]: Got next segment. Inline: true Aug 20 19:32:32.903083599 (290h6m27.33416373s) [upload=301688]: Waiting for error group managing segments... Aug 20 19:32:32.903115199 (290h6m27.33419533s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectBegin Aug 20 19:32:32.903118957 (290h6m27.334199088s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_SegmentMakeInline Aug 20 19:32:32.903121382 (290h6m27.334201513s) [upload=301688]: Flush batch item: *pb.BatchRequestItem_ObjectCommit Aug 20 19:32:33.116305882 (290h6m27.547386013s) [upload=301688]: Done uploading segments... Aug 20 19:32:33.116324156 (290h6m27.547404288s) [upload=301688]: Upload finished. err: metaclient: Too Many Requests
Duration: 1.837301215s
core
uplink
us-select-1
us1-placement-20
metainfo-projects
|