Orbiter History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 2.016199179s FAIL (2025-09-08 13:03:42 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 8 12:52:02.555135038 (47h23m38.594708158s) [upload=41633]: Starting upload Sep 8 12:52:02.555196977 (47h23m38.594770097s) [upload=41633]: Done starting upload Sep 8 12:52:02.555253495 (47h23m38.594826615s) [upload=41633]: Uploading segments... Sep 8 12:52:02.555294603 (47h23m38.594867724s) [upload=41633]: Got next segment. Inline: true Sep 8 12:52:02.555299713 (47h23m38.594872863s) [upload=41633]: Waiting for error group managing segments... Sep 8 12:52:02.555361933 (47h23m38.594935053s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:52:02.555370799 (47h23m38.59494392s) [upload=41633]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 8 12:52:02.555374877 (47h23m38.594948007s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:52:16.516475371 (47h23m52.556048491s) [upload=41633]: Done uploading segments... Sep 8 12:52:16.516495109 (47h23m52.556068249s) [upload=41633]: Upload finished. err: <nil> Duration:* 2.016222864s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 6.143786625s FAIL (2025-09-08 13:03:39 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 6.14384231s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...........................................X................] duration: 6.71408651s FAIL (2025-09-08 13:03:31 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 6.714118921s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [...X..............X.....X.............X..X..XX.......X......] duration: 23.245016354s FAIL (2025-09-08 13:03:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:58:23.524515845 (47h29m59.564088965s) [upload=41724]: Starting upload Sep 8 12:58:23.524579717 (47h29m59.564152837s) [upload=41724]: Done starting upload Sep 8 12:58:23.524687924 (47h29m59.564261114s) [upload=41724]: Uploading segments... Sep 8 12:58:23.524844213 (47h29m59.564417333s) [upload=41724]: Got next segment. Inline: false Sep 8 12:58:23.524877657 (47h29m59.564450777s) [upload=41724]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:58:23.524895441 (47h29m59.564468561s) [upload=41724]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:58:23.809411399 (47h29m59.848984519s) [seg_pos={0 0}, upload=41724]: Begin upload segment... Sep 8 12:58:23.809451727 (47h29m59.849024847s) [seg_pos={0 0}, upload=41724]: Done begin upload segment. Sep 8 12:58:23.809470893 (47h29m59.849044013s) [noise=true , address=45.91.116.7:4009 , piece_id=LIWABT4ZVNFTFJGURN7FRYQHL2UOBMFGL6PCNCIAWM5UJETUAPIA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.809476925 (47h29m59.849050035s) [noise=true , address=77.90.31.14:4663 , piece_id=2DEH6T75MWICVVLNBRMJQCM4INW6NH7BHCTFQJ5YNSOHHRUL7EYA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.809898000 (47h29m59.849471111s) [noise=true , address=45.91.116.9:4262 , piece_id=4O5QLOWKMSMB4DT6P7AXYEJYFN7AAEVBQ5NFQQNU3YJAZPAW4ARA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.809906086 (47h29m59.849479206s) [noise=true , address=45.91.116.14:4189 , piece_id=Y53JPFVZ5XTMTECDEOFOQITLPCCBMFKPWFKOTV5YKJTKL4TAOTXA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810205008 (47h29m59.849778128s) [noise=true , address=45.91.116.8:4047 , piece_id=MQYS7HJF6TGRHTIYVSHXDOSJCWZ6LUA5T4NG334XR4XIANX74XGA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810263540 (47h29m59.84983666s) [noise=true , address=145.79.227.16:4912 , piece_id=4W6SZTNDKYFF3MQUOK72NQAG4O4PINB7KGUT4HT6TR6EESBPGJOQ, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810513619 (47h29m59.850086739s) [noise=true , address=45.91.116.9:4263 , piece_id=KLU7YBMSWODYK46STGQOGALWPP5CSIE3GPI2E4GPGJMHF2ZFHFZA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810614752 (47h29m59.850187872s) [noise=true , address=77.90.31.14:4662 , piece_id=TDXVPRZI3H3PKC4EFQNXGVCXJCDRSTBNLIRYTBZK6HQ6NNYT6W7Q, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810807110 (47h29m59.85038023s) [noise=true , address=77.90.31.12:4592 , piece_id=6VBYEVZ5A35C636R756RAMIVTZKIWCTMQY3EV2SECWBI5EZ4SYXQ, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810883356 (47h29m59.850456466s) [noise=true , address=77.90.31.16:4735 , piece_id=VXKNEYHEIKZH6BEWOBFDTG7ADV5IZCH5RIHBZ3QIZT4S3OW6HYNA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.811073019 (47h29m59.850646139s) [noise=true , address=77.90.31.17:4771 , piece_id=DRNS6VPHVLBAHV3XXL7TCDUQXGOLGAYOH3NTOZ3YEL46KXBCHAWQ, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.811320322 (47h29m59.850893442s) [noise=true , address=77.90.31.10:4517 , piece_id=JW57FGCENDLLPWCNOHPG2TR5PMARD64EHBHSYZO76ECQJ63CMELA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.811577274 (47h29m59.851150394s) [noise=true , address=77.90.31.21:4877 , piece_id=XHW4LJQM5PNMX7IMHH2IPFN6F7GYKWLPIY2CVO4ZRQXV2E4CKS3A, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.811768991 (47h29m59.851342101s) [noise=true , address=45.91.116.14:4191 , piece_id=EP47P42QIJQPE5TXYHKPPAQP73ZSML63FBY5SPT3A7VXDY3YIOAA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.812181651 (47h29m59.851754761s) [noise=true , address=145.79.227.7:4293 , piece_id=FJ4YAV75LGHP2KHEMAOZ3JD6IBVJVIW7VDXGKBK5IZU7BBNFWDTA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.812383567 (47h29m59.851956687s) [noise=true , address=45.91.116.4:4937 , piece_id=TSGQ2CJYQHUAZRLJM2C3P776AMLQC6Q5I6PXDEJWOXOBQJ7QIGVQ, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:25.652811059 (47h30m1.692384179s) [upload=41724]: Next returned nil segment Sep 8 12:58:25.652828102 (47h30m1.692401242s) [upload=41724]: Waiting for error group managing segments... Sep 8 12:58:25.994321981 (47h30m2.033895101s) [noise=true , address=45.91.116.9:4263 , piece_id=KLU7YBMSWODYK46STGQOGALWPP5CSIE3GPI2E4GPGJMHF2ZFHFZA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.015028906 (47h30m2.054602026s) [noise=true , address=77.90.31.12:4592 , piece_id=6VBYEVZ5A35C636R756RAMIVTZKIWCTMQY3EV2SECWBI5EZ4SYXQ, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.017396505 (47h30m2.056969626s) [noise=true , address=77.90.31.14:4663 , piece_id=2DEH6T75MWICVVLNBRMJQCM4INW6NH7BHCTFQJ5YNSOHHRUL7EYA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.024482014 (47h30m2.064055135s) [noise=true , address=145.79.227.16:4912 , piece_id=4W6SZTNDKYFF3MQUOK72NQAG4O4PINB7KGUT4HT6TR6EESBPGJOQ, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.049167051 (47h30m2.088740171s) [noise=true , address=45.91.116.4:4937 , piece_id=TSGQ2CJYQHUAZRLJM2C3P776AMLQC6Q5I6PXDEJWOXOBQJ7QIGVQ, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.074326225 (47h30m2.113899345s) [noise=true , address=45.91.116.8:4047 , piece_id=MQYS7HJF6TGRHTIYVSHXDOSJCWZ6LUA5T4NG334XR4XIANX74XGA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.082953774 (47h30m2.122526894s) [noise=true , address=45.91.116.7:4009 , piece_id=LIWABT4ZVNFTFJGURN7FRYQHL2UOBMFGL6PCNCIAWM5UJETUAPIA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.090187216 (47h30m2.129760336s) [noise=true , address=45.91.116.9:4262 , piece_id=4O5QLOWKMSMB4DT6P7AXYEJYFN7AAEVBQ5NFQQNU3YJAZPAW4ARA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.092439706 (47h30m2.132012826s) [noise=true , address=145.79.227.7:4293 , piece_id=FJ4YAV75LGHP2KHEMAOZ3JD6IBVJVIW7VDXGKBK5IZU7BBNFWDTA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.093601158 (47h30m2.133174278s) [noise=true , address=77.90.31.14:4662 , piece_id=TDXVPRZI3H3PKC4EFQNXGVCXJCDRSTBNLIRYTBZK6HQ6NNYT6W7Q, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.115577672 (47h30m2.155150782s) [noise=true , address=77.90.31.21:4877 , piece_id=XHW4LJQM5PNMX7IMHH2IPFN6F7GYKWLPIY2CVO4ZRQXV2E4CKS3A, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.135872617 (47h30m2.175445737s) [noise=true , address=77.90.31.17:4771 , piece_id=DRNS6VPHVLBAHV3XXL7TCDUQXGOLGAYOH3NTOZ3YEL46KXBCHAWQ, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.151798182 (47h30m2.191371302s) [noise=true , address=77.90.31.10:4517 , piece_id=JW57FGCENDLLPWCNOHPG2TR5PMARD64EHBHSYZO76ECQJ63CMELA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.151817569 (47h30m2.191390679s) [seg_pos={0 0}, upload=41724]: Segment reached optimal threshold of 13 pieces. Sep 8 12:58:26.151927329 (47h30m2.191500449s) [noise=true , address=45.91.116.14:4191 , piece_id=EP47P42QIJQPE5TXYHKPPAQP73ZSML63FBY5SPT3A7VXDY3YIOAA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF Sep 8 12:58:26.151995800 (47h30m2.19156892s) [noise=true , address=45.91.116.14:4189 , piece_id=Y53JPFVZ5XTMTECDEOFOQITLPCCBMFKPWFKOTV5YKJTKL4TAOTXA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N): protocol: expected piece hash; context canceled; EOF Sep 8 12:58:26.152125829 (47h30m2.191698949s) [noise=true , address=77.90.31.16:4735 , piece_id=VXKNEYHEIKZH6BEWOBFDTG7ADV5IZCH5RIHBZ3QIZT4S3OW6HYNA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 8 12:58:26.152185463 (47h30m2.191758613s) [seg_pos={0 0}, upload=41724]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:58:26.152295744 (47h30m2.191868864s) [upload=41724]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:58:26.152300793 (47h30m2.191873914s) [upload=41724]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:58:26.563915584 (47h30m2.603488704s) [upload=41724]: Done uploading segments... Sep 8 12:58:26.563935643 (47h30m2.603508763s) [upload=41724]: Upload finished. err: <nil> Duration: 23.245043595s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 6.202216988s FAIL (2025-09-08 13:03:09 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 6.202241285s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 6.387799352s FAIL (2025-09-08 13:03:04 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 6.387820502s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [............................................X...............] duration: 4.984115046s FAIL (2025-09-08 13:03:01 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , address=185.167.204.205:4002 , piece_id=P2VKYEMEX4R6VGFYVMMOIWJZSVSZY7EDNIDZYJNZWMMXY5YP7JWA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908064709 (47h23m37.947637839s) [noise=true , address=185.167.204.205:4016 , piece_id=ZMZHXMMSMOTDJT2LSJKE5JIKUS5W6JKQ6SHS42MZ63EZEEV5CGTA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908200809 (47h23m37.947773929s) [noise=true , address=81.171.14.70:4033 , piece_id=OHA6HWHGV36NRAT5D4WGRNRN6EEOYQUA6Y5I75RCIYC3SPRXY4UQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908480745 (47h23m37.948053865s) [noise=true , address=81.171.14.70:4043 , piece_id=JZXWCJ2JRKO6WE6MHINF5RXTC2TTD5BGPC33AVFB3557WR5IFBKQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908498108 (47h23m37.948071228s) [noise=true , address=89.149.201.147:4017 , piece_id=N6FF5VCQI3MQ4744RTIFBBNBA4X5DNOZRQAYVVFFX47EQH4O66NA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908737456 (47h23m37.948310587s) [noise=true , address=185.167.204.206:4056 , piece_id=VA66O3ZBJOT5SW2ON4JWP6JOZPFKJ2JZ26AD5AMABABDBLCKU2CA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908745231 (47h23m37.948318351s) [noise=true , address=185.167.204.205:4022 , piece_id=SMWWQAV5TZ7MRJUQSICU75EHQ5BM2AQJLLC3KHEU3VHMAIQWRUZA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908984940 (47h23m37.94855806s) [noise=true , address=81.171.14.70:4047 , piece_id=XWJX7ULTH5WIPZELAYH2CO54AC4QG4VZHZEH7FZJV4BG66EKHRLA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909059853 (47h23m37.948632973s) [noise=true , address=185.167.204.206:4049 , piece_id=SZ72BTAFZ6JUT5RYCIZTAKQXUXNOZX55W26EUDZ5KYI4IDBXKHRQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909330891 (47h23m37.948904011s) [noise=true , address=81.171.14.70:4030 , piece_id=47AKDIHLE6ZTTO3SWU5MU4F3AWEDWZRPHOTL3DVKRC7HSVFF6UXA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909571772 (47h23m37.949144902s) [noise=true , address=185.167.204.205:4036 , piece_id=RVF5AQQOZZZTQZ5GQIGYZNQ3XWIWWYOE3EXQSPGJH3DGS4TWIKFQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909826580 (47h23m37.94939971s) [noise=true , address=185.167.204.206:4062 , piece_id=2DGUDQ3I7LWD5JI4JLP7UH44QVGVQBNIBTLAF32U5GMSWYBV5ATA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:02.740717802 (47h23m38.780290912s) [upload=41632]: Next returned nil segment Sep 8 12:52:02.740761787 (47h23m38.780334907s) [upload=41632]: Waiting for error group managing segments... Sep 8 12:52:03.121855814 (47h23m39.161428934s) [noise=true , address=81.171.14.70:4030 , piece_id=47AKDIHLE6ZTTO3SWU5MU4F3AWEDWZRPHOTL3DVKRC7HSVFF6UXA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.123575474 (47h23m39.163148584s) [noise=true , address=81.171.14.70:4043 , piece_id=JZXWCJ2JRKO6WE6MHINF5RXTC2TTD5BGPC33AVFB3557WR5IFBKQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.143395772 (47h23m39.182968892s) [noise=true , address=81.171.14.70:4047 , piece_id=XWJX7ULTH5WIPZELAYH2CO54AC4QG4VZHZEH7FZJV4BG66EKHRLA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.181951872 (47h23m39.221525002s) [noise=true , address=81.171.14.70:4025 , piece_id=VELILLTRG7STUSJ3QMCLOVWPEE2FPBXAB25X3N2EAXHWET2OGKIA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.193380100 (47h23m39.23295326s) [noise=true , address=89.149.201.147:4016 , piece_id=TB6YA2YQESSLV2RCL34LZ46TES542GVMADM2FQTSLOTZJINL2RGA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.194591699 (47h23m39.234164819s) [noise=true , address=81.171.14.70:4036 , piece_id=BAXE23H4TD4P75TEIX2BFUZHUWXNBQANYG3QB6DEAC5FIH4ETG5A, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.209005330 (47h23m39.24857844s) [noise=true , address=81.171.14.70:4033 , piece_id=OHA6HWHGV36NRAT5D4WGRNRN6EEOYQUA6Y5I75RCIYC3SPRXY4UQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.209649973 (47h23m39.249223093s) [noise=true , address=89.149.201.147:4017 , piece_id=N6FF5VCQI3MQ4744RTIFBBNBA4X5DNOZRQAYVVFFX47EQH4O66NA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.213619009 (47h23m39.253192129s) [noise=true , address=81.171.14.70:4038 , piece_id=3UU55QG3GNAAPQAFXG3KQRH22GCGDGK5E7AEQGNVGYTNCBEGZ4ZQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.228963311 (47h23m39.268536431s) [noise=true , address=81.171.14.70:4041 , piece_id=FZJNDCJWTURN7B477OISN66VDCWU4NOTNRQKYFRKCROBM73WMQWA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.251825980 (47h23m39.2913991s) [noise=true , address=89.149.201.147:4018 , piece_id=MR4IUTFZHI7RC36ZBWAXLRRLP2T7N22SODRUSAAG5D5SSPNYBVVQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.253349455 (47h23m39.292922575s) [noise=true , address=89.149.201.147:4013 , piece_id=ZI6UVH6AEG3WYLORGNUTFPKS4WXXOG6KQ36KAEVJRGXJHLDULSXQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:44.115838176 (47h24m20.155411296s) [noise=true , address=185.167.204.205:4036 , piece_id=RVF5AQQOZZZTQZ5GQIGYZNQ3XWIWWYOE3EXQSPGJH3DGS4TWIKFQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:46.267485246 (47h24m22.307058366s) [noise=true , address=185.167.204.205:4023 , piece_id=LLPUGCULEDSTBHP2S5UCAMMFKNNASOGM2TT57JWGB5P34XE2Z6AA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:46.714425193 (47h24m22.753998313s) [noise=true , address=185.167.204.206:4051 , piece_id=7H54IWRCHR7WD7CQCJGXXHL65PXVYXMBX2ZO2MQW4IQRD446QEDQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:47.345341250 (47h24m23.38491438s) [noise=true , address=185.167.204.206:4062 , piece_id=2DGUDQ3I7LWD5JI4JLP7UH44QVGVQBNIBTLAF32U5GMSWYBV5ATA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:47.540765927 (47h24m23.580339047s) [noise=true , address=185.167.204.206:4064 , piece_id=HUT57RGU53Z4DHPF4EK46WBVQSFQCTYBWZXWXTOQQ7YE43YOXLJA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:48.269023964 (47h24m24.308597084s) [noise=true , address=185.167.204.206:4049 , piece_id=SZ72BTAFZ6JUT5RYCIZTAKQXUXNOZX55W26EUDZ5KYI4IDBXKHRQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:49.663456087 (47h24m25.703029207s) [noise=true , address=185.167.204.206:4071 , piece_id=YNIPZ3QB6GZZOXJAPRFY252FTH6EXV4EGDQLVAIP52YINRYSHKPQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:49.804977327 (47h24m25.844550447s) [noise=true , address=185.167.204.205:4020 , piece_id=GEGJPVGYDJ6ZUBXFZUATDENPTB4HS5AD2TW3UC52QKF7Q7PX377Q, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:50.266767870 (47h24m26.306340991s) [noise=true , address=185.167.204.205:4006 , piece_id=N7L47O3UJ34GIXJODWCPMJ42WS6ZHMQD64FX2JWX7KG2GKRB7FPQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:51.679203615 (47h24m27.718776735s) [noise=true , address=185.167.204.205:4033 , piece_id=GKRNZPWHIHBDW56KU2QK2GT2WXTMNH72SEFJGQWUGHWXVGKH7GOA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:53.979229196 (47h24m30.018802306s) [noise=true , address=185.167.204.205:4002 , piece_id=P2VKYEMEX4R6VGFYVMMOIWJZSVSZY7EDNIDZYJNZWMMXY5YP7JWA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:54.287962666 (47h24m30.327535796s) [noise=true , address=185.167.204.206:4068 , piece_id=GOGCJYBA2BWBI62V7HCX3XA7GKFOVRYMDTFAFPNTRL752JXCTBOA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:57.053910939 (47h24m33.093484059s) [noise=true , address=185.167.204.205:4016 , piece_id=ZMZHXMMSMOTDJT2LSJKE5JIKUS5W6JKQ6SHS42MZ63EZEEV5CGTA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:53:00.495738039 (47h24m36.535311159s) [noise=true , address=185.167.204.206:4056 , piece_id=VA66O3ZBJOT5SW2ON4JWP6JOZPFKJ2JZ26AD5AMABABDBLCKU2CA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:53:00.495764069 (47h24m36.535337179s) [seg_pos={0 0}, upload=41632]: Segment reached optimal threshold of 26 pieces. Sep 8 12:53:00.495926510 (47h24m36.53549963s) [noise=true , address=185.167.204.206:4053 , piece_id=VGMH5NZYOLHWCB3HGM6XOUHZSIPSOXSB7VE3H4WO6WOBVOLXMAAQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:00.495949313 (47h24m36.535522434s) [noise=true , address=185.167.204.205:4022 , piece_id=SMWWQAV5TZ7MRJUQSICU75EHQ5BM2AQJLLC3KHEU3VHMAIQWRUZA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj): protocol: write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection; write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection Sep 8 12:53:00.495998858 (47h24m36.535571989s) [seg_pos={0 0}, upload=41632]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 8 12:53:00.496094631 (47h24m36.535667751s) [upload=41632]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:53:00.496100823 (47h24m36.535673983s) [upload=41632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:53:00.792131065 (47h24m36.831704185s) [upload=41632]: Done uploading segments... Sep 8 12:53:00.792150421 (47h24m36.831723541s) [upload=41632]: Upload finished. err: <nil> Duration: 4.984138211s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 9.858306765s FAIL (2025-09-08 13:02:53 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:52:19.209925757 (47h23m55.249498877s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:52:21.143429848 (47h23m57.183002958s) [seg_pos={0 0}, upload=41635]: Begin upload segment... Sep 8 12:52:21.143471006 (47h23m57.183044126s) [seg_pos={0 0}, upload=41635]: Done begin upload segment. Sep 8 12:52:21.143498478 (47h23m57.183071598s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143534477 (47h23m57.183107597s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143860912 (47h23m57.183434032s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143864980 (47h23m57.1834381s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144135457 (47h23m57.183708577s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144291937 (47h23m57.183865077s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144407437 (47h23m57.183980567s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144641045 (47h23m57.184214165s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144668087 (47h23m57.184241197s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144887907 (47h23m57.184461027s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144896333 (47h23m57.184469453s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145098310 (47h23m57.18467143s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145108870 (47h23m57.18468199s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145309754 (47h23m57.184882874s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145316237 (47h23m57.184889357s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145514747 (47h23m57.185087867s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145525216 (47h23m57.185098336s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.146735122 (47h23m57.186308242s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:45.888145215 (47h24m21.927718335s) [upload=41635]: Next returned nil segment Sep 8 12:52:45.888163901 (47h24m21.927737021s) [upload=41635]: Waiting for error group managing segments... Sep 8 12:52:46.918997605 (47h24m22.958570725s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.350218563 (47h24m23.389791683s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.720042654 (47h24m23.759615774s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.579584090 (47h24m24.61915721s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.691947615 (47h24m24.731520735s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:50.187188921 (47h24m26.226762041s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.025054049 (47h24m27.064627169s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.869450123 (47h24m27.909023243s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:52.281020669 (47h24m28.320593779s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.216000424 (47h24m31.255573544s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.266129620 (47h24m31.30570274s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.401392292 (47h24m31.440965412s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:59.964108673 (47h24m36.003681813s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232210648 (47h24m38.271783768s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232242008 (47h24m38.271815128s) [seg_pos={0 0}, upload=41635]: Segment reached optimal threshold of 14 pieces. Sep 8 12:53:02.232380182 (47h24m38.271953312s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XQRaEnpa6KAKuBWL9eRUvPeurEiFaMbjjvDuUkbfq3MT5NWeW): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232447741 (47h24m38.272020871s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wXqePK1kK7iBo6wHcbqkRmkED8LGJ3rzQNJAWa14cHYhx1oyB): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232512285 (47h24m38.272085415s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12htsH8bL33XpUeEstKHb2yeL6TNLusbdRmms9bwzmVCHkej2Xo): protocol: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection Sep 8 12:53:02.232542232 (47h24m38.272115352s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uthP31WaBmn37h54Q6z9ZMtYRY6K8917Ms4kwyyADqu4EXPJy): protocol: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection Sep 8 12:53:02.232562410 (47h24m38.27213553s) [seg_pos={0 0}, upload=41635]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 8 12:53:02.232635761 (47h24m38.272208891s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:53:02.232642724 (47h24m38.272215844s) [upload=41635]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:53:03.008884431 (47h24m39.048457561s) [upload=41635]: Done uploading segments... Sep 8 12:53:03.008909649 (47h24m39.048482789s) [upload=41635]: Upload finished. err: <nil> Duration:* 9.85833571s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 3.243821405s FAIL (2025-09-08 13:02:48 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 3.243846453s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 2.306386883s FAIL (2025-09-08 13:02:45 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 8 12:52:02.555135038 (47h23m38.594708158s) [upload=41633]: Starting upload Sep 8 12:52:02.555196977 (47h23m38.594770097s) [upload=41633]: Done starting upload Sep 8 12:52:02.555253495 (47h23m38.594826615s) [upload=41633]: Uploading segments... Sep 8 12:52:02.555294603 (47h23m38.594867724s) [upload=41633]: Got next segment. Inline: true Sep 8 12:52:02.555299713 (47h23m38.594872863s) [upload=41633]: Waiting for error group managing segments... Sep 8 12:52:02.555361933 (47h23m38.594935053s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:52:02.555370799 (47h23m38.59494392s) [upload=41633]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 8 12:52:02.555374877 (47h23m38.594948007s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:52:16.516475371 (47h23m52.556048491s) [upload=41633]: Done uploading segments... Sep 8 12:52:16.516495109 (47h23m52.556068249s) [upload=41633]: Upload finished. err: <nil> Duration:* 2.306416981s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.378830057s FAIL (2025-09-08 13:02:43 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.378848162s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 19.398104688s FAIL (2025-09-08 13:02:40 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:52:19.209925757 (47h23m55.249498877s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:52:21.143429848 (47h23m57.183002958s) [seg_pos={0 0}, upload=41635]: Begin upload segment... Sep 8 12:52:21.143471006 (47h23m57.183044126s) [seg_pos={0 0}, upload=41635]: Done begin upload segment. Sep 8 12:52:21.143498478 (47h23m57.183071598s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143534477 (47h23m57.183107597s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143860912 (47h23m57.183434032s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143864980 (47h23m57.1834381s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144135457 (47h23m57.183708577s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144291937 (47h23m57.183865077s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144407437 (47h23m57.183980567s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144641045 (47h23m57.184214165s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144668087 (47h23m57.184241197s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144887907 (47h23m57.184461027s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144896333 (47h23m57.184469453s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145098310 (47h23m57.18467143s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145108870 (47h23m57.18468199s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145309754 (47h23m57.184882874s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145316237 (47h23m57.184889357s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145514747 (47h23m57.185087867s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145525216 (47h23m57.185098336s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.146735122 (47h23m57.186308242s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:45.888145215 (47h24m21.927718335s) [upload=41635]: Next returned nil segment Sep 8 12:52:45.888163901 (47h24m21.927737021s) [upload=41635]: Waiting for error group managing segments... Sep 8 12:52:46.918997605 (47h24m22.958570725s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.350218563 (47h24m23.389791683s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.720042654 (47h24m23.759615774s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.579584090 (47h24m24.61915721s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.691947615 (47h24m24.731520735s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:50.187188921 (47h24m26.226762041s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.025054049 (47h24m27.064627169s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.869450123 (47h24m27.909023243s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:52.281020669 (47h24m28.320593779s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.216000424 (47h24m31.255573544s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.266129620 (47h24m31.30570274s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.401392292 (47h24m31.440965412s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:59.964108673 (47h24m36.003681813s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232210648 (47h24m38.271783768s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232242008 (47h24m38.271815128s) [seg_pos={0 0}, upload=41635]: Segment reached optimal threshold of 14 pieces. Sep 8 12:53:02.232380182 (47h24m38.271953312s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XQRaEnpa6KAKuBWL9eRUvPeurEiFaMbjjvDuUkbfq3MT5NWeW): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232447741 (47h24m38.272020871s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wXqePK1kK7iBo6wHcbqkRmkED8LGJ3rzQNJAWa14cHYhx1oyB): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232512285 (47h24m38.272085415s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12htsH8bL33XpUeEstKHb2yeL6TNLusbdRmms9bwzmVCHkej2Xo): protocol: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection Sep 8 12:53:02.232542232 (47h24m38.272115352s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uthP31WaBmn37h54Q6z9ZMtYRY6K8917Ms4kwyyADqu4EXPJy): protocol: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection Sep 8 12:53:02.232562410 (47h24m38.27213553s) [seg_pos={0 0}, upload=41635]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 8 12:53:02.232635761 (47h24m38.272208891s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:53:02.232642724 (47h24m38.272215844s) [upload=41635]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:53:03.008884431 (47h24m39.048457561s) [upload=41635]: Done uploading segments... Sep 8 12:53:03.008909649 (47h24m39.048482789s) [upload=41635]: Upload finished. err: <nil> Duration:* 19.398176474s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 12.057531312s FAIL (2025-09-08 13:02:27 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 12.05755665s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 3.834077133s FAIL (2025-09-08 13:02:26 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 8 12:52:02.555135038 (47h23m38.594708158s) [upload=41633]: Starting upload Sep 8 12:52:02.555196977 (47h23m38.594770097s) [upload=41633]: Done starting upload Sep 8 12:52:02.555253495 (47h23m38.594826615s) [upload=41633]: Uploading segments... Sep 8 12:52:02.555294603 (47h23m38.594867724s) [upload=41633]: Got next segment. Inline: true Sep 8 12:52:02.555299713 (47h23m38.594872863s) [upload=41633]: Waiting for error group managing segments... Sep 8 12:52:02.555361933 (47h23m38.594935053s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:52:02.555370799 (47h23m38.59494392s) [upload=41633]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 8 12:52:02.555374877 (47h23m38.594948007s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:52:16.516475371 (47h23m52.556048491s) [upload=41633]: Done uploading segments... Sep 8 12:52:16.516495109 (47h23m52.556068249s) [upload=41633]: Upload finished. err: <nil> Duration:* 3.834105048s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 29.913431837s FAIL (2025-09-08 13:02:21 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:52:19.209925757 (47h23m55.249498877s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:52:21.143429848 (47h23m57.183002958s) [seg_pos={0 0}, upload=41635]: Begin upload segment... Sep 8 12:52:21.143471006 (47h23m57.183044126s) [seg_pos={0 0}, upload=41635]: Done begin upload segment. Sep 8 12:52:21.143498478 (47h23m57.183071598s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143534477 (47h23m57.183107597s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143860912 (47h23m57.183434032s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143864980 (47h23m57.1834381s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144135457 (47h23m57.183708577s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144291937 (47h23m57.183865077s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144407437 (47h23m57.183980567s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144641045 (47h23m57.184214165s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144668087 (47h23m57.184241197s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144887907 (47h23m57.184461027s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144896333 (47h23m57.184469453s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145098310 (47h23m57.18467143s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145108870 (47h23m57.18468199s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145309754 (47h23m57.184882874s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145316237 (47h23m57.184889357s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145514747 (47h23m57.185087867s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145525216 (47h23m57.185098336s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.146735122 (47h23m57.186308242s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:45.888145215 (47h24m21.927718335s) [upload=41635]: Next returned nil segment Sep 8 12:52:45.888163901 (47h24m21.927737021s) [upload=41635]: Waiting for error group managing segments... Sep 8 12:52:46.918997605 (47h24m22.958570725s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.350218563 (47h24m23.389791683s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.720042654 (47h24m23.759615774s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.579584090 (47h24m24.61915721s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.691947615 (47h24m24.731520735s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:50.187188921 (47h24m26.226762041s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.025054049 (47h24m27.064627169s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.869450123 (47h24m27.909023243s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:52.281020669 (47h24m28.320593779s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.216000424 (47h24m31.255573544s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.266129620 (47h24m31.30570274s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.401392292 (47h24m31.440965412s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:59.964108673 (47h24m36.003681813s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232210648 (47h24m38.271783768s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232242008 (47h24m38.271815128s) [seg_pos={0 0}, upload=41635]: Segment reached optimal threshold of 14 pieces. Sep 8 12:53:02.232380182 (47h24m38.271953312s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XQRaEnpa6KAKuBWL9eRUvPeurEiFaMbjjvDuUkbfq3MT5NWeW): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232447741 (47h24m38.272020871s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wXqePK1kK7iBo6wHcbqkRmkED8LGJ3rzQNJAWa14cHYhx1oyB): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232512285 (47h24m38.272085415s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12htsH8bL33XpUeEstKHb2yeL6TNLusbdRmms9bwzmVCHkej2Xo): protocol: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection Sep 8 12:53:02.232542232 (47h24m38.272115352s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uthP31WaBmn37h54Q6z9ZMtYRY6K8917Ms4kwyyADqu4EXPJy): protocol: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection Sep 8 12:53:02.232562410 (47h24m38.27213553s) [seg_pos={0 0}, upload=41635]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 8 12:53:02.232635761 (47h24m38.272208891s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:53:02.232642724 (47h24m38.272215844s) [upload=41635]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:53:03.008884431 (47h24m39.048457561s) [upload=41635]: Done uploading segments... Sep 8 12:53:03.008909649 (47h24m39.048482789s) [upload=41635]: Upload finished. err: <nil> Duration:* 29.913531417s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 6.059859117s FAIL (2025-09-08 13:02:15 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 6.059882752s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.............................................X..............] duration: 5.048288546s FAIL (2025-09-08 13:02:12 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , address=185.167.204.205:4002 , piece_id=P2VKYEMEX4R6VGFYVMMOIWJZSVSZY7EDNIDZYJNZWMMXY5YP7JWA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908064709 (47h23m37.947637839s) [noise=true , address=185.167.204.205:4016 , piece_id=ZMZHXMMSMOTDJT2LSJKE5JIKUS5W6JKQ6SHS42MZ63EZEEV5CGTA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908200809 (47h23m37.947773929s) [noise=true , address=81.171.14.70:4033 , piece_id=OHA6HWHGV36NRAT5D4WGRNRN6EEOYQUA6Y5I75RCIYC3SPRXY4UQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908480745 (47h23m37.948053865s) [noise=true , address=81.171.14.70:4043 , piece_id=JZXWCJ2JRKO6WE6MHINF5RXTC2TTD5BGPC33AVFB3557WR5IFBKQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908498108 (47h23m37.948071228s) [noise=true , address=89.149.201.147:4017 , piece_id=N6FF5VCQI3MQ4744RTIFBBNBA4X5DNOZRQAYVVFFX47EQH4O66NA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908737456 (47h23m37.948310587s) [noise=true , address=185.167.204.206:4056 , piece_id=VA66O3ZBJOT5SW2ON4JWP6JOZPFKJ2JZ26AD5AMABABDBLCKU2CA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908745231 (47h23m37.948318351s) [noise=true , address=185.167.204.205:4022 , piece_id=SMWWQAV5TZ7MRJUQSICU75EHQ5BM2AQJLLC3KHEU3VHMAIQWRUZA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908984940 (47h23m37.94855806s) [noise=true , address=81.171.14.70:4047 , piece_id=XWJX7ULTH5WIPZELAYH2CO54AC4QG4VZHZEH7FZJV4BG66EKHRLA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909059853 (47h23m37.948632973s) [noise=true , address=185.167.204.206:4049 , piece_id=SZ72BTAFZ6JUT5RYCIZTAKQXUXNOZX55W26EUDZ5KYI4IDBXKHRQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909330891 (47h23m37.948904011s) [noise=true , address=81.171.14.70:4030 , piece_id=47AKDIHLE6ZTTO3SWU5MU4F3AWEDWZRPHOTL3DVKRC7HSVFF6UXA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909571772 (47h23m37.949144902s) [noise=true , address=185.167.204.205:4036 , piece_id=RVF5AQQOZZZTQZ5GQIGYZNQ3XWIWWYOE3EXQSPGJH3DGS4TWIKFQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909826580 (47h23m37.94939971s) [noise=true , address=185.167.204.206:4062 , piece_id=2DGUDQ3I7LWD5JI4JLP7UH44QVGVQBNIBTLAF32U5GMSWYBV5ATA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:02.740717802 (47h23m38.780290912s) [upload=41632]: Next returned nil segment Sep 8 12:52:02.740761787 (47h23m38.780334907s) [upload=41632]: Waiting for error group managing segments... Sep 8 12:52:03.121855814 (47h23m39.161428934s) [noise=true , address=81.171.14.70:4030 , piece_id=47AKDIHLE6ZTTO3SWU5MU4F3AWEDWZRPHOTL3DVKRC7HSVFF6UXA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.123575474 (47h23m39.163148584s) [noise=true , address=81.171.14.70:4043 , piece_id=JZXWCJ2JRKO6WE6MHINF5RXTC2TTD5BGPC33AVFB3557WR5IFBKQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.143395772 (47h23m39.182968892s) [noise=true , address=81.171.14.70:4047 , piece_id=XWJX7ULTH5WIPZELAYH2CO54AC4QG4VZHZEH7FZJV4BG66EKHRLA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.181951872 (47h23m39.221525002s) [noise=true , address=81.171.14.70:4025 , piece_id=VELILLTRG7STUSJ3QMCLOVWPEE2FPBXAB25X3N2EAXHWET2OGKIA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.193380100 (47h23m39.23295326s) [noise=true , address=89.149.201.147:4016 , piece_id=TB6YA2YQESSLV2RCL34LZ46TES542GVMADM2FQTSLOTZJINL2RGA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.194591699 (47h23m39.234164819s) [noise=true , address=81.171.14.70:4036 , piece_id=BAXE23H4TD4P75TEIX2BFUZHUWXNBQANYG3QB6DEAC5FIH4ETG5A, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.209005330 (47h23m39.24857844s) [noise=true , address=81.171.14.70:4033 , piece_id=OHA6HWHGV36NRAT5D4WGRNRN6EEOYQUA6Y5I75RCIYC3SPRXY4UQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.209649973 (47h23m39.249223093s) [noise=true , address=89.149.201.147:4017 , piece_id=N6FF5VCQI3MQ4744RTIFBBNBA4X5DNOZRQAYVVFFX47EQH4O66NA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.213619009 (47h23m39.253192129s) [noise=true , address=81.171.14.70:4038 , piece_id=3UU55QG3GNAAPQAFXG3KQRH22GCGDGK5E7AEQGNVGYTNCBEGZ4ZQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.228963311 (47h23m39.268536431s) [noise=true , address=81.171.14.70:4041 , piece_id=FZJNDCJWTURN7B477OISN66VDCWU4NOTNRQKYFRKCROBM73WMQWA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.251825980 (47h23m39.2913991s) [noise=true , address=89.149.201.147:4018 , piece_id=MR4IUTFZHI7RC36ZBWAXLRRLP2T7N22SODRUSAAG5D5SSPNYBVVQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.253349455 (47h23m39.292922575s) [noise=true , address=89.149.201.147:4013 , piece_id=ZI6UVH6AEG3WYLORGNUTFPKS4WXXOG6KQ36KAEVJRGXJHLDULSXQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:44.115838176 (47h24m20.155411296s) [noise=true , address=185.167.204.205:4036 , piece_id=RVF5AQQOZZZTQZ5GQIGYZNQ3XWIWWYOE3EXQSPGJH3DGS4TWIKFQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:46.267485246 (47h24m22.307058366s) [noise=true , address=185.167.204.205:4023 , piece_id=LLPUGCULEDSTBHP2S5UCAMMFKNNASOGM2TT57JWGB5P34XE2Z6AA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:46.714425193 (47h24m22.753998313s) [noise=true , address=185.167.204.206:4051 , piece_id=7H54IWRCHR7WD7CQCJGXXHL65PXVYXMBX2ZO2MQW4IQRD446QEDQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:47.345341250 (47h24m23.38491438s) [noise=true , address=185.167.204.206:4062 , piece_id=2DGUDQ3I7LWD5JI4JLP7UH44QVGVQBNIBTLAF32U5GMSWYBV5ATA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:47.540765927 (47h24m23.580339047s) [noise=true , address=185.167.204.206:4064 , piece_id=HUT57RGU53Z4DHPF4EK46WBVQSFQCTYBWZXWXTOQQ7YE43YOXLJA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:48.269023964 (47h24m24.308597084s) [noise=true , address=185.167.204.206:4049 , piece_id=SZ72BTAFZ6JUT5RYCIZTAKQXUXNOZX55W26EUDZ5KYI4IDBXKHRQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:49.663456087 (47h24m25.703029207s) [noise=true , address=185.167.204.206:4071 , piece_id=YNIPZ3QB6GZZOXJAPRFY252FTH6EXV4EGDQLVAIP52YINRYSHKPQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:49.804977327 (47h24m25.844550447s) [noise=true , address=185.167.204.205:4020 , piece_id=GEGJPVGYDJ6ZUBXFZUATDENPTB4HS5AD2TW3UC52QKF7Q7PX377Q, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:50.266767870 (47h24m26.306340991s) [noise=true , address=185.167.204.205:4006 , piece_id=N7L47O3UJ34GIXJODWCPMJ42WS6ZHMQD64FX2JWX7KG2GKRB7FPQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:51.679203615 (47h24m27.718776735s) [noise=true , address=185.167.204.205:4033 , piece_id=GKRNZPWHIHBDW56KU2QK2GT2WXTMNH72SEFJGQWUGHWXVGKH7GOA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:53.979229196 (47h24m30.018802306s) [noise=true , address=185.167.204.205:4002 , piece_id=P2VKYEMEX4R6VGFYVMMOIWJZSVSZY7EDNIDZYJNZWMMXY5YP7JWA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:54.287962666 (47h24m30.327535796s) [noise=true , address=185.167.204.206:4068 , piece_id=GOGCJYBA2BWBI62V7HCX3XA7GKFOVRYMDTFAFPNTRL752JXCTBOA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:57.053910939 (47h24m33.093484059s) [noise=true , address=185.167.204.205:4016 , piece_id=ZMZHXMMSMOTDJT2LSJKE5JIKUS5W6JKQ6SHS42MZ63EZEEV5CGTA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:53:00.495738039 (47h24m36.535311159s) [noise=true , address=185.167.204.206:4056 , piece_id=VA66O3ZBJOT5SW2ON4JWP6JOZPFKJ2JZ26AD5AMABABDBLCKU2CA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:53:00.495764069 (47h24m36.535337179s) [seg_pos={0 0}, upload=41632]: Segment reached optimal threshold of 26 pieces. Sep 8 12:53:00.495926510 (47h24m36.53549963s) [noise=true , address=185.167.204.206:4053 , piece_id=VGMH5NZYOLHWCB3HGM6XOUHZSIPSOXSB7VE3H4WO6WOBVOLXMAAQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:00.495949313 (47h24m36.535522434s) [noise=true , address=185.167.204.205:4022 , piece_id=SMWWQAV5TZ7MRJUQSICU75EHQ5BM2AQJLLC3KHEU3VHMAIQWRUZA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj): protocol: write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection; write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection Sep 8 12:53:00.495998858 (47h24m36.535571989s) [seg_pos={0 0}, upload=41632]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 8 12:53:00.496094631 (47h24m36.535667751s) [upload=41632]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:53:00.496100823 (47h24m36.535673983s) [upload=41632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:53:00.792131065 (47h24m36.831704185s) [upload=41632]: Done uploading segments... Sep 8 12:53:00.792150421 (47h24m36.831723541s) [upload=41632]: Upload finished. err: <nil> Duration: 5.048315538s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [....X..............X.....X.............X..X..XX.......X.....] duration: 12.959476392s FAIL (2025-09-08 13:02:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:58:23.524515845 (47h29m59.564088965s) [upload=41724]: Starting upload Sep 8 12:58:23.524579717 (47h29m59.564152837s) [upload=41724]: Done starting upload Sep 8 12:58:23.524687924 (47h29m59.564261114s) [upload=41724]: Uploading segments... Sep 8 12:58:23.524844213 (47h29m59.564417333s) [upload=41724]: Got next segment. Inline: false Sep 8 12:58:23.524877657 (47h29m59.564450777s) [upload=41724]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:58:23.524895441 (47h29m59.564468561s) [upload=41724]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:58:23.809411399 (47h29m59.848984519s) [seg_pos={0 0}, upload=41724]: Begin upload segment... Sep 8 12:58:23.809451727 (47h29m59.849024847s) [seg_pos={0 0}, upload=41724]: Done begin upload segment. Sep 8 12:58:23.809470893 (47h29m59.849044013s) [noise=true , address=45.91.116.7:4009 , piece_id=LIWABT4ZVNFTFJGURN7FRYQHL2UOBMFGL6PCNCIAWM5UJETUAPIA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.809476925 (47h29m59.849050035s) [noise=true , address=77.90.31.14:4663 , piece_id=2DEH6T75MWICVVLNBRMJQCM4INW6NH7BHCTFQJ5YNSOHHRUL7EYA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.809898000 (47h29m59.849471111s) [noise=true , address=45.91.116.9:4262 , piece_id=4O5QLOWKMSMB4DT6P7AXYEJYFN7AAEVBQ5NFQQNU3YJAZPAW4ARA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.809906086 (47h29m59.849479206s) [noise=true , address=45.91.116.14:4189 , piece_id=Y53JPFVZ5XTMTECDEOFOQITLPCCBMFKPWFKOTV5YKJTKL4TAOTXA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810205008 (47h29m59.849778128s) [noise=true , address=45.91.116.8:4047 , piece_id=MQYS7HJF6TGRHTIYVSHXDOSJCWZ6LUA5T4NG334XR4XIANX74XGA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810263540 (47h29m59.84983666s) [noise=true , address=145.79.227.16:4912 , piece_id=4W6SZTNDKYFF3MQUOK72NQAG4O4PINB7KGUT4HT6TR6EESBPGJOQ, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810513619 (47h29m59.850086739s) [noise=true , address=45.91.116.9:4263 , piece_id=KLU7YBMSWODYK46STGQOGALWPP5CSIE3GPI2E4GPGJMHF2ZFHFZA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810614752 (47h29m59.850187872s) [noise=true , address=77.90.31.14:4662 , piece_id=TDXVPRZI3H3PKC4EFQNXGVCXJCDRSTBNLIRYTBZK6HQ6NNYT6W7Q, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810807110 (47h29m59.85038023s) [noise=true , address=77.90.31.12:4592 , piece_id=6VBYEVZ5A35C636R756RAMIVTZKIWCTMQY3EV2SECWBI5EZ4SYXQ, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810883356 (47h29m59.850456466s) [noise=true , address=77.90.31.16:4735 , piece_id=VXKNEYHEIKZH6BEWOBFDTG7ADV5IZCH5RIHBZ3QIZT4S3OW6HYNA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.811073019 (47h29m59.850646139s) [noise=true , address=77.90.31.17:4771 , piece_id=DRNS6VPHVLBAHV3XXL7TCDUQXGOLGAYOH3NTOZ3YEL46KXBCHAWQ, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.811320322 (47h29m59.850893442s) [noise=true , address=77.90.31.10:4517 , piece_id=JW57FGCENDLLPWCNOHPG2TR5PMARD64EHBHSYZO76ECQJ63CMELA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.811577274 (47h29m59.851150394s) [noise=true , address=77.90.31.21:4877 , piece_id=XHW4LJQM5PNMX7IMHH2IPFN6F7GYKWLPIY2CVO4ZRQXV2E4CKS3A, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.811768991 (47h29m59.851342101s) [noise=true , address=45.91.116.14:4191 , piece_id=EP47P42QIJQPE5TXYHKPPAQP73ZSML63FBY5SPT3A7VXDY3YIOAA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.812181651 (47h29m59.851754761s) [noise=true , address=145.79.227.7:4293 , piece_id=FJ4YAV75LGHP2KHEMAOZ3JD6IBVJVIW7VDXGKBK5IZU7BBNFWDTA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.812383567 (47h29m59.851956687s) [noise=true , address=45.91.116.4:4937 , piece_id=TSGQ2CJYQHUAZRLJM2C3P776AMLQC6Q5I6PXDEJWOXOBQJ7QIGVQ, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:25.652811059 (47h30m1.692384179s) [upload=41724]: Next returned nil segment Sep 8 12:58:25.652828102 (47h30m1.692401242s) [upload=41724]: Waiting for error group managing segments... Sep 8 12:58:25.994321981 (47h30m2.033895101s) [noise=true , address=45.91.116.9:4263 , piece_id=KLU7YBMSWODYK46STGQOGALWPP5CSIE3GPI2E4GPGJMHF2ZFHFZA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.015028906 (47h30m2.054602026s) [noise=true , address=77.90.31.12:4592 , piece_id=6VBYEVZ5A35C636R756RAMIVTZKIWCTMQY3EV2SECWBI5EZ4SYXQ, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.017396505 (47h30m2.056969626s) [noise=true , address=77.90.31.14:4663 , piece_id=2DEH6T75MWICVVLNBRMJQCM4INW6NH7BHCTFQJ5YNSOHHRUL7EYA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.024482014 (47h30m2.064055135s) [noise=true , address=145.79.227.16:4912 , piece_id=4W6SZTNDKYFF3MQUOK72NQAG4O4PINB7KGUT4HT6TR6EESBPGJOQ, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.049167051 (47h30m2.088740171s) [noise=true , address=45.91.116.4:4937 , piece_id=TSGQ2CJYQHUAZRLJM2C3P776AMLQC6Q5I6PXDEJWOXOBQJ7QIGVQ, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.074326225 (47h30m2.113899345s) [noise=true , address=45.91.116.8:4047 , piece_id=MQYS7HJF6TGRHTIYVSHXDOSJCWZ6LUA5T4NG334XR4XIANX74XGA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.082953774 (47h30m2.122526894s) [noise=true , address=45.91.116.7:4009 , piece_id=LIWABT4ZVNFTFJGURN7FRYQHL2UOBMFGL6PCNCIAWM5UJETUAPIA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.090187216 (47h30m2.129760336s) [noise=true , address=45.91.116.9:4262 , piece_id=4O5QLOWKMSMB4DT6P7AXYEJYFN7AAEVBQ5NFQQNU3YJAZPAW4ARA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.092439706 (47h30m2.132012826s) [noise=true , address=145.79.227.7:4293 , piece_id=FJ4YAV75LGHP2KHEMAOZ3JD6IBVJVIW7VDXGKBK5IZU7BBNFWDTA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.093601158 (47h30m2.133174278s) [noise=true , address=77.90.31.14:4662 , piece_id=TDXVPRZI3H3PKC4EFQNXGVCXJCDRSTBNLIRYTBZK6HQ6NNYT6W7Q, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.115577672 (47h30m2.155150782s) [noise=true , address=77.90.31.21:4877 , piece_id=XHW4LJQM5PNMX7IMHH2IPFN6F7GYKWLPIY2CVO4ZRQXV2E4CKS3A, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.135872617 (47h30m2.175445737s) [noise=true , address=77.90.31.17:4771 , piece_id=DRNS6VPHVLBAHV3XXL7TCDUQXGOLGAYOH3NTOZ3YEL46KXBCHAWQ, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.151798182 (47h30m2.191371302s) [noise=true , address=77.90.31.10:4517 , piece_id=JW57FGCENDLLPWCNOHPG2TR5PMARD64EHBHSYZO76ECQJ63CMELA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.151817569 (47h30m2.191390679s) [seg_pos={0 0}, upload=41724]: Segment reached optimal threshold of 13 pieces. Sep 8 12:58:26.151927329 (47h30m2.191500449s) [noise=true , address=45.91.116.14:4191 , piece_id=EP47P42QIJQPE5TXYHKPPAQP73ZSML63FBY5SPT3A7VXDY3YIOAA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF Sep 8 12:58:26.151995800 (47h30m2.19156892s) [noise=true , address=45.91.116.14:4189 , piece_id=Y53JPFVZ5XTMTECDEOFOQITLPCCBMFKPWFKOTV5YKJTKL4TAOTXA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N): protocol: expected piece hash; context canceled; EOF Sep 8 12:58:26.152125829 (47h30m2.191698949s) [noise=true , address=77.90.31.16:4735 , piece_id=VXKNEYHEIKZH6BEWOBFDTG7ADV5IZCH5RIHBZ3QIZT4S3OW6HYNA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 8 12:58:26.152185463 (47h30m2.191758613s) [seg_pos={0 0}, upload=41724]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:58:26.152295744 (47h30m2.191868864s) [upload=41724]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:58:26.152300793 (47h30m2.191873914s) [upload=41724]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:58:26.563915584 (47h30m2.603488704s) [upload=41724]: Done uploading segments... Sep 8 12:58:26.563935643 (47h30m2.603508763s) [upload=41724]: Upload finished. err: <nil> Duration: 12.959500591s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.344921131s FAIL (2025-09-08 13:01:51 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.3449462s edge gateway us-select-1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 5.064344688s FAIL (2025-09-08 13:01:48 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , address=185.167.204.205:4002 , piece_id=P2VKYEMEX4R6VGFYVMMOIWJZSVSZY7EDNIDZYJNZWMMXY5YP7JWA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908064709 (47h23m37.947637839s) [noise=true , address=185.167.204.205:4016 , piece_id=ZMZHXMMSMOTDJT2LSJKE5JIKUS5W6JKQ6SHS42MZ63EZEEV5CGTA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908200809 (47h23m37.947773929s) [noise=true , address=81.171.14.70:4033 , piece_id=OHA6HWHGV36NRAT5D4WGRNRN6EEOYQUA6Y5I75RCIYC3SPRXY4UQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908480745 (47h23m37.948053865s) [noise=true , address=81.171.14.70:4043 , piece_id=JZXWCJ2JRKO6WE6MHINF5RXTC2TTD5BGPC33AVFB3557WR5IFBKQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908498108 (47h23m37.948071228s) [noise=true , address=89.149.201.147:4017 , piece_id=N6FF5VCQI3MQ4744RTIFBBNBA4X5DNOZRQAYVVFFX47EQH4O66NA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908737456 (47h23m37.948310587s) [noise=true , address=185.167.204.206:4056 , piece_id=VA66O3ZBJOT5SW2ON4JWP6JOZPFKJ2JZ26AD5AMABABDBLCKU2CA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908745231 (47h23m37.948318351s) [noise=true , address=185.167.204.205:4022 , piece_id=SMWWQAV5TZ7MRJUQSICU75EHQ5BM2AQJLLC3KHEU3VHMAIQWRUZA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908984940 (47h23m37.94855806s) [noise=true , address=81.171.14.70:4047 , piece_id=XWJX7ULTH5WIPZELAYH2CO54AC4QG4VZHZEH7FZJV4BG66EKHRLA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909059853 (47h23m37.948632973s) [noise=true , address=185.167.204.206:4049 , piece_id=SZ72BTAFZ6JUT5RYCIZTAKQXUXNOZX55W26EUDZ5KYI4IDBXKHRQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909330891 (47h23m37.948904011s) [noise=true , address=81.171.14.70:4030 , piece_id=47AKDIHLE6ZTTO3SWU5MU4F3AWEDWZRPHOTL3DVKRC7HSVFF6UXA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909571772 (47h23m37.949144902s) [noise=true , address=185.167.204.205:4036 , piece_id=RVF5AQQOZZZTQZ5GQIGYZNQ3XWIWWYOE3EXQSPGJH3DGS4TWIKFQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909826580 (47h23m37.94939971s) [noise=true , address=185.167.204.206:4062 , piece_id=2DGUDQ3I7LWD5JI4JLP7UH44QVGVQBNIBTLAF32U5GMSWYBV5ATA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:02.740717802 (47h23m38.780290912s) [upload=41632]: Next returned nil segment Sep 8 12:52:02.740761787 (47h23m38.780334907s) [upload=41632]: Waiting for error group managing segments... Sep 8 12:52:03.121855814 (47h23m39.161428934s) [noise=true , address=81.171.14.70:4030 , piece_id=47AKDIHLE6ZTTO3SWU5MU4F3AWEDWZRPHOTL3DVKRC7HSVFF6UXA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.123575474 (47h23m39.163148584s) [noise=true , address=81.171.14.70:4043 , piece_id=JZXWCJ2JRKO6WE6MHINF5RXTC2TTD5BGPC33AVFB3557WR5IFBKQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.143395772 (47h23m39.182968892s) [noise=true , address=81.171.14.70:4047 , piece_id=XWJX7ULTH5WIPZELAYH2CO54AC4QG4VZHZEH7FZJV4BG66EKHRLA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.181951872 (47h23m39.221525002s) [noise=true , address=81.171.14.70:4025 , piece_id=VELILLTRG7STUSJ3QMCLOVWPEE2FPBXAB25X3N2EAXHWET2OGKIA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.193380100 (47h23m39.23295326s) [noise=true , address=89.149.201.147:4016 , piece_id=TB6YA2YQESSLV2RCL34LZ46TES542GVMADM2FQTSLOTZJINL2RGA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.194591699 (47h23m39.234164819s) [noise=true , address=81.171.14.70:4036 , piece_id=BAXE23H4TD4P75TEIX2BFUZHUWXNBQANYG3QB6DEAC5FIH4ETG5A, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.209005330 (47h23m39.24857844s) [noise=true , address=81.171.14.70:4033 , piece_id=OHA6HWHGV36NRAT5D4WGRNRN6EEOYQUA6Y5I75RCIYC3SPRXY4UQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.209649973 (47h23m39.249223093s) [noise=true , address=89.149.201.147:4017 , piece_id=N6FF5VCQI3MQ4744RTIFBBNBA4X5DNOZRQAYVVFFX47EQH4O66NA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.213619009 (47h23m39.253192129s) [noise=true , address=81.171.14.70:4038 , piece_id=3UU55QG3GNAAPQAFXG3KQRH22GCGDGK5E7AEQGNVGYTNCBEGZ4ZQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.228963311 (47h23m39.268536431s) [noise=true , address=81.171.14.70:4041 , piece_id=FZJNDCJWTURN7B477OISN66VDCWU4NOTNRQKYFRKCROBM73WMQWA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.251825980 (47h23m39.2913991s) [noise=true , address=89.149.201.147:4018 , piece_id=MR4IUTFZHI7RC36ZBWAXLRRLP2T7N22SODRUSAAG5D5SSPNYBVVQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.253349455 (47h23m39.292922575s) [noise=true , address=89.149.201.147:4013 , piece_id=ZI6UVH6AEG3WYLORGNUTFPKS4WXXOG6KQ36KAEVJRGXJHLDULSXQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:44.115838176 (47h24m20.155411296s) [noise=true , address=185.167.204.205:4036 , piece_id=RVF5AQQOZZZTQZ5GQIGYZNQ3XWIWWYOE3EXQSPGJH3DGS4TWIKFQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:46.267485246 (47h24m22.307058366s) [noise=true , address=185.167.204.205:4023 , piece_id=LLPUGCULEDSTBHP2S5UCAMMFKNNASOGM2TT57JWGB5P34XE2Z6AA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:46.714425193 (47h24m22.753998313s) [noise=true , address=185.167.204.206:4051 , piece_id=7H54IWRCHR7WD7CQCJGXXHL65PXVYXMBX2ZO2MQW4IQRD446QEDQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:47.345341250 (47h24m23.38491438s) [noise=true , address=185.167.204.206:4062 , piece_id=2DGUDQ3I7LWD5JI4JLP7UH44QVGVQBNIBTLAF32U5GMSWYBV5ATA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:47.540765927 (47h24m23.580339047s) [noise=true , address=185.167.204.206:4064 , piece_id=HUT57RGU53Z4DHPF4EK46WBVQSFQCTYBWZXWXTOQQ7YE43YOXLJA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:48.269023964 (47h24m24.308597084s) [noise=true , address=185.167.204.206:4049 , piece_id=SZ72BTAFZ6JUT5RYCIZTAKQXUXNOZX55W26EUDZ5KYI4IDBXKHRQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:49.663456087 (47h24m25.703029207s) [noise=true , address=185.167.204.206:4071 , piece_id=YNIPZ3QB6GZZOXJAPRFY252FTH6EXV4EGDQLVAIP52YINRYSHKPQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:49.804977327 (47h24m25.844550447s) [noise=true , address=185.167.204.205:4020 , piece_id=GEGJPVGYDJ6ZUBXFZUATDENPTB4HS5AD2TW3UC52QKF7Q7PX377Q, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:50.266767870 (47h24m26.306340991s) [noise=true , address=185.167.204.205:4006 , piece_id=N7L47O3UJ34GIXJODWCPMJ42WS6ZHMQD64FX2JWX7KG2GKRB7FPQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:51.679203615 (47h24m27.718776735s) [noise=true , address=185.167.204.205:4033 , piece_id=GKRNZPWHIHBDW56KU2QK2GT2WXTMNH72SEFJGQWUGHWXVGKH7GOA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:53.979229196 (47h24m30.018802306s) [noise=true , address=185.167.204.205:4002 , piece_id=P2VKYEMEX4R6VGFYVMMOIWJZSVSZY7EDNIDZYJNZWMMXY5YP7JWA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:54.287962666 (47h24m30.327535796s) [noise=true , address=185.167.204.206:4068 , piece_id=GOGCJYBA2BWBI62V7HCX3XA7GKFOVRYMDTFAFPNTRL752JXCTBOA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:57.053910939 (47h24m33.093484059s) [noise=true , address=185.167.204.205:4016 , piece_id=ZMZHXMMSMOTDJT2LSJKE5JIKUS5W6JKQ6SHS42MZ63EZEEV5CGTA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:53:00.495738039 (47h24m36.535311159s) [noise=true , address=185.167.204.206:4056 , piece_id=VA66O3ZBJOT5SW2ON4JWP6JOZPFKJ2JZ26AD5AMABABDBLCKU2CA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:53:00.495764069 (47h24m36.535337179s) [seg_pos={0 0}, upload=41632]: Segment reached optimal threshold of 26 pieces. Sep 8 12:53:00.495926510 (47h24m36.53549963s) [noise=true , address=185.167.204.206:4053 , piece_id=VGMH5NZYOLHWCB3HGM6XOUHZSIPSOXSB7VE3H4WO6WOBVOLXMAAQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:00.495949313 (47h24m36.535522434s) [noise=true , address=185.167.204.205:4022 , piece_id=SMWWQAV5TZ7MRJUQSICU75EHQ5BM2AQJLLC3KHEU3VHMAIQWRUZA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj): protocol: write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection; write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection Sep 8 12:53:00.495998858 (47h24m36.535571989s) [seg_pos={0 0}, upload=41632]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 8 12:53:00.496094631 (47h24m36.535667751s) [upload=41632]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:53:00.496100823 (47h24m36.535673983s) [upload=41632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:53:00.792131065 (47h24m36.831704185s) [upload=41632]: Done uploading segments... Sep 8 12:53:00.792150421 (47h24m36.831723541s) [upload=41632]: Upload finished. err: <nil> Duration: 5.064376168s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 2.498230648s FAIL (2025-09-08 13:01:33 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.498266347s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [.....X..............X.....X.............X..X..XX.......X....] duration: 21.065797245s FAIL (2025-09-08 13:01:31 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:58:23.524515845 (47h29m59.564088965s) [upload=41724]: Starting upload Sep 8 12:58:23.524579717 (47h29m59.564152837s) [upload=41724]: Done starting upload Sep 8 12:58:23.524687924 (47h29m59.564261114s) [upload=41724]: Uploading segments... Sep 8 12:58:23.524844213 (47h29m59.564417333s) [upload=41724]: Got next segment. Inline: false Sep 8 12:58:23.524877657 (47h29m59.564450777s) [upload=41724]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:58:23.524895441 (47h29m59.564468561s) [upload=41724]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:58:23.809411399 (47h29m59.848984519s) [seg_pos={0 0}, upload=41724]: Begin upload segment... Sep 8 12:58:23.809451727 (47h29m59.849024847s) [seg_pos={0 0}, upload=41724]: Done begin upload segment. Sep 8 12:58:23.809470893 (47h29m59.849044013s) [noise=true , address=45.91.116.7:4009 , piece_id=LIWABT4ZVNFTFJGURN7FRYQHL2UOBMFGL6PCNCIAWM5UJETUAPIA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.809476925 (47h29m59.849050035s) [noise=true , address=77.90.31.14:4663 , piece_id=2DEH6T75MWICVVLNBRMJQCM4INW6NH7BHCTFQJ5YNSOHHRUL7EYA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.809898000 (47h29m59.849471111s) [noise=true , address=45.91.116.9:4262 , piece_id=4O5QLOWKMSMB4DT6P7AXYEJYFN7AAEVBQ5NFQQNU3YJAZPAW4ARA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.809906086 (47h29m59.849479206s) [noise=true , address=45.91.116.14:4189 , piece_id=Y53JPFVZ5XTMTECDEOFOQITLPCCBMFKPWFKOTV5YKJTKL4TAOTXA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810205008 (47h29m59.849778128s) [noise=true , address=45.91.116.8:4047 , piece_id=MQYS7HJF6TGRHTIYVSHXDOSJCWZ6LUA5T4NG334XR4XIANX74XGA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810263540 (47h29m59.84983666s) [noise=true , address=145.79.227.16:4912 , piece_id=4W6SZTNDKYFF3MQUOK72NQAG4O4PINB7KGUT4HT6TR6EESBPGJOQ, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810513619 (47h29m59.850086739s) [noise=true , address=45.91.116.9:4263 , piece_id=KLU7YBMSWODYK46STGQOGALWPP5CSIE3GPI2E4GPGJMHF2ZFHFZA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810614752 (47h29m59.850187872s) [noise=true , address=77.90.31.14:4662 , piece_id=TDXVPRZI3H3PKC4EFQNXGVCXJCDRSTBNLIRYTBZK6HQ6NNYT6W7Q, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810807110 (47h29m59.85038023s) [noise=true , address=77.90.31.12:4592 , piece_id=6VBYEVZ5A35C636R756RAMIVTZKIWCTMQY3EV2SECWBI5EZ4SYXQ, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810883356 (47h29m59.850456466s) [noise=true , address=77.90.31.16:4735 , piece_id=VXKNEYHEIKZH6BEWOBFDTG7ADV5IZCH5RIHBZ3QIZT4S3OW6HYNA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.811073019 (47h29m59.850646139s) [noise=true , address=77.90.31.17:4771 , piece_id=DRNS6VPHVLBAHV3XXL7TCDUQXGOLGAYOH3NTOZ3YEL46KXBCHAWQ, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.811320322 (47h29m59.850893442s) [noise=true , address=77.90.31.10:4517 , piece_id=JW57FGCENDLLPWCNOHPG2TR5PMARD64EHBHSYZO76ECQJ63CMELA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.811577274 (47h29m59.851150394s) [noise=true , address=77.90.31.21:4877 , piece_id=XHW4LJQM5PNMX7IMHH2IPFN6F7GYKWLPIY2CVO4ZRQXV2E4CKS3A, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.811768991 (47h29m59.851342101s) [noise=true , address=45.91.116.14:4191 , piece_id=EP47P42QIJQPE5TXYHKPPAQP73ZSML63FBY5SPT3A7VXDY3YIOAA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.812181651 (47h29m59.851754761s) [noise=true , address=145.79.227.7:4293 , piece_id=FJ4YAV75LGHP2KHEMAOZ3JD6IBVJVIW7VDXGKBK5IZU7BBNFWDTA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.812383567 (47h29m59.851956687s) [noise=true , address=45.91.116.4:4937 , piece_id=TSGQ2CJYQHUAZRLJM2C3P776AMLQC6Q5I6PXDEJWOXOBQJ7QIGVQ, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:25.652811059 (47h30m1.692384179s) [upload=41724]: Next returned nil segment Sep 8 12:58:25.652828102 (47h30m1.692401242s) [upload=41724]: Waiting for error group managing segments... Sep 8 12:58:25.994321981 (47h30m2.033895101s) [noise=true , address=45.91.116.9:4263 , piece_id=KLU7YBMSWODYK46STGQOGALWPP5CSIE3GPI2E4GPGJMHF2ZFHFZA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.015028906 (47h30m2.054602026s) [noise=true , address=77.90.31.12:4592 , piece_id=6VBYEVZ5A35C636R756RAMIVTZKIWCTMQY3EV2SECWBI5EZ4SYXQ, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.017396505 (47h30m2.056969626s) [noise=true , address=77.90.31.14:4663 , piece_id=2DEH6T75MWICVVLNBRMJQCM4INW6NH7BHCTFQJ5YNSOHHRUL7EYA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.024482014 (47h30m2.064055135s) [noise=true , address=145.79.227.16:4912 , piece_id=4W6SZTNDKYFF3MQUOK72NQAG4O4PINB7KGUT4HT6TR6EESBPGJOQ, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.049167051 (47h30m2.088740171s) [noise=true , address=45.91.116.4:4937 , piece_id=TSGQ2CJYQHUAZRLJM2C3P776AMLQC6Q5I6PXDEJWOXOBQJ7QIGVQ, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.074326225 (47h30m2.113899345s) [noise=true , address=45.91.116.8:4047 , piece_id=MQYS7HJF6TGRHTIYVSHXDOSJCWZ6LUA5T4NG334XR4XIANX74XGA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.082953774 (47h30m2.122526894s) [noise=true , address=45.91.116.7:4009 , piece_id=LIWABT4ZVNFTFJGURN7FRYQHL2UOBMFGL6PCNCIAWM5UJETUAPIA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.090187216 (47h30m2.129760336s) [noise=true , address=45.91.116.9:4262 , piece_id=4O5QLOWKMSMB4DT6P7AXYEJYFN7AAEVBQ5NFQQNU3YJAZPAW4ARA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.092439706 (47h30m2.132012826s) [noise=true , address=145.79.227.7:4293 , piece_id=FJ4YAV75LGHP2KHEMAOZ3JD6IBVJVIW7VDXGKBK5IZU7BBNFWDTA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.093601158 (47h30m2.133174278s) [noise=true , address=77.90.31.14:4662 , piece_id=TDXVPRZI3H3PKC4EFQNXGVCXJCDRSTBNLIRYTBZK6HQ6NNYT6W7Q, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.115577672 (47h30m2.155150782s) [noise=true , address=77.90.31.21:4877 , piece_id=XHW4LJQM5PNMX7IMHH2IPFN6F7GYKWLPIY2CVO4ZRQXV2E4CKS3A, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.135872617 (47h30m2.175445737s) [noise=true , address=77.90.31.17:4771 , piece_id=DRNS6VPHVLBAHV3XXL7TCDUQXGOLGAYOH3NTOZ3YEL46KXBCHAWQ, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.151798182 (47h30m2.191371302s) [noise=true , address=77.90.31.10:4517 , piece_id=JW57FGCENDLLPWCNOHPG2TR5PMARD64EHBHSYZO76ECQJ63CMELA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.151817569 (47h30m2.191390679s) [seg_pos={0 0}, upload=41724]: Segment reached optimal threshold of 13 pieces. Sep 8 12:58:26.151927329 (47h30m2.191500449s) [noise=true , address=45.91.116.14:4191 , piece_id=EP47P42QIJQPE5TXYHKPPAQP73ZSML63FBY5SPT3A7VXDY3YIOAA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF Sep 8 12:58:26.151995800 (47h30m2.19156892s) [noise=true , address=45.91.116.14:4189 , piece_id=Y53JPFVZ5XTMTECDEOFOQITLPCCBMFKPWFKOTV5YKJTKL4TAOTXA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N): protocol: expected piece hash; context canceled; EOF Sep 8 12:58:26.152125829 (47h30m2.191698949s) [noise=true , address=77.90.31.16:4735 , piece_id=VXKNEYHEIKZH6BEWOBFDTG7ADV5IZCH5RIHBZ3QIZT4S3OW6HYNA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 8 12:58:26.152185463 (47h30m2.191758613s) [seg_pos={0 0}, upload=41724]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:58:26.152295744 (47h30m2.191868864s) [upload=41724]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:58:26.152300793 (47h30m2.191873914s) [upload=41724]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:58:26.563915584 (47h30m2.603488704s) [upload=41724]: Done uploading segments... Sep 8 12:58:26.563935643 (47h30m2.603508763s) [upload=41724]: Upload finished. err: <nil> Duration: 21.065823836s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 7.492315322s FAIL (2025-09-08 13:01:27 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 7.492345288s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [..............................................X.............] duration: 6.192778476s FAIL (2025-09-08 13:01:21 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 6.192796872s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 12.20147871s FAIL (2025-09-08 13:01:15 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:52:19.209925757 (47h23m55.249498877s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:52:21.143429848 (47h23m57.183002958s) [seg_pos={0 0}, upload=41635]: Begin upload segment... Sep 8 12:52:21.143471006 (47h23m57.183044126s) [seg_pos={0 0}, upload=41635]: Done begin upload segment. Sep 8 12:52:21.143498478 (47h23m57.183071598s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143534477 (47h23m57.183107597s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143860912 (47h23m57.183434032s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143864980 (47h23m57.1834381s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144135457 (47h23m57.183708577s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144291937 (47h23m57.183865077s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144407437 (47h23m57.183980567s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144641045 (47h23m57.184214165s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144668087 (47h23m57.184241197s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144887907 (47h23m57.184461027s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144896333 (47h23m57.184469453s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145098310 (47h23m57.18467143s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145108870 (47h23m57.18468199s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145309754 (47h23m57.184882874s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145316237 (47h23m57.184889357s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145514747 (47h23m57.185087867s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145525216 (47h23m57.185098336s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.146735122 (47h23m57.186308242s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:45.888145215 (47h24m21.927718335s) [upload=41635]: Next returned nil segment Sep 8 12:52:45.888163901 (47h24m21.927737021s) [upload=41635]: Waiting for error group managing segments... Sep 8 12:52:46.918997605 (47h24m22.958570725s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.350218563 (47h24m23.389791683s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.720042654 (47h24m23.759615774s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.579584090 (47h24m24.61915721s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.691947615 (47h24m24.731520735s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:50.187188921 (47h24m26.226762041s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.025054049 (47h24m27.064627169s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.869450123 (47h24m27.909023243s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:52.281020669 (47h24m28.320593779s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.216000424 (47h24m31.255573544s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.266129620 (47h24m31.30570274s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.401392292 (47h24m31.440965412s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:59.964108673 (47h24m36.003681813s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232210648 (47h24m38.271783768s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232242008 (47h24m38.271815128s) [seg_pos={0 0}, upload=41635]: Segment reached optimal threshold of 14 pieces. Sep 8 12:53:02.232380182 (47h24m38.271953312s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XQRaEnpa6KAKuBWL9eRUvPeurEiFaMbjjvDuUkbfq3MT5NWeW): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232447741 (47h24m38.272020871s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wXqePK1kK7iBo6wHcbqkRmkED8LGJ3rzQNJAWa14cHYhx1oyB): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232512285 (47h24m38.272085415s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12htsH8bL33XpUeEstKHb2yeL6TNLusbdRmms9bwzmVCHkej2Xo): protocol: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection Sep 8 12:53:02.232542232 (47h24m38.272115352s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uthP31WaBmn37h54Q6z9ZMtYRY6K8917Ms4kwyyADqu4EXPJy): protocol: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection Sep 8 12:53:02.232562410 (47h24m38.27213553s) [seg_pos={0 0}, upload=41635]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 8 12:53:02.232635761 (47h24m38.272208891s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:53:02.232642724 (47h24m38.272215844s) [upload=41635]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:53:03.008884431 (47h24m39.048457561s) [upload=41635]: Done uploading segments... Sep 8 12:53:03.008909649 (47h24m39.048482789s) [upload=41635]: Upload finished. err: <nil> Duration:* 12.20151009s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 2.302454479s FAIL (2025-09-08 13:01:12 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 8 12:52:02.555135038 (47h23m38.594708158s) [upload=41633]: Starting upload Sep 8 12:52:02.555196977 (47h23m38.594770097s) [upload=41633]: Done starting upload Sep 8 12:52:02.555253495 (47h23m38.594826615s) [upload=41633]: Uploading segments... Sep 8 12:52:02.555294603 (47h23m38.594867724s) [upload=41633]: Got next segment. Inline: true Sep 8 12:52:02.555299713 (47h23m38.594872863s) [upload=41633]: Waiting for error group managing segments... Sep 8 12:52:02.555361933 (47h23m38.594935053s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:52:02.555370799 (47h23m38.59494392s) [upload=41633]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 8 12:52:02.555374877 (47h23m38.594948007s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:52:16.516475371 (47h23m52.556048491s) [upload=41633]: Done uploading segments... Sep 8 12:52:16.516495109 (47h23m52.556068249s) [upload=41633]: Upload finished. err: <nil> Duration:* 2.302489146s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [......X..............X.....X.............X..X..XX.......X...] duration: 17.6223747s FAIL (2025-09-08 13:01:01 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:58:23.524515845 (47h29m59.564088965s) [upload=41724]: Starting upload Sep 8 12:58:23.524579717 (47h29m59.564152837s) [upload=41724]: Done starting upload Sep 8 12:58:23.524687924 (47h29m59.564261114s) [upload=41724]: Uploading segments... Sep 8 12:58:23.524844213 (47h29m59.564417333s) [upload=41724]: Got next segment. Inline: false Sep 8 12:58:23.524877657 (47h29m59.564450777s) [upload=41724]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:58:23.524895441 (47h29m59.564468561s) [upload=41724]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:58:23.809411399 (47h29m59.848984519s) [seg_pos={0 0}, upload=41724]: Begin upload segment... Sep 8 12:58:23.809451727 (47h29m59.849024847s) [seg_pos={0 0}, upload=41724]: Done begin upload segment. Sep 8 12:58:23.809470893 (47h29m59.849044013s) [noise=true , address=45.91.116.7:4009 , piece_id=LIWABT4ZVNFTFJGURN7FRYQHL2UOBMFGL6PCNCIAWM5UJETUAPIA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.809476925 (47h29m59.849050035s) [noise=true , address=77.90.31.14:4663 , piece_id=2DEH6T75MWICVVLNBRMJQCM4INW6NH7BHCTFQJ5YNSOHHRUL7EYA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.809898000 (47h29m59.849471111s) [noise=true , address=45.91.116.9:4262 , piece_id=4O5QLOWKMSMB4DT6P7AXYEJYFN7AAEVBQ5NFQQNU3YJAZPAW4ARA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.809906086 (47h29m59.849479206s) [noise=true , address=45.91.116.14:4189 , piece_id=Y53JPFVZ5XTMTECDEOFOQITLPCCBMFKPWFKOTV5YKJTKL4TAOTXA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810205008 (47h29m59.849778128s) [noise=true , address=45.91.116.8:4047 , piece_id=MQYS7HJF6TGRHTIYVSHXDOSJCWZ6LUA5T4NG334XR4XIANX74XGA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810263540 (47h29m59.84983666s) [noise=true , address=145.79.227.16:4912 , piece_id=4W6SZTNDKYFF3MQUOK72NQAG4O4PINB7KGUT4HT6TR6EESBPGJOQ, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810513619 (47h29m59.850086739s) [noise=true , address=45.91.116.9:4263 , piece_id=KLU7YBMSWODYK46STGQOGALWPP5CSIE3GPI2E4GPGJMHF2ZFHFZA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810614752 (47h29m59.850187872s) [noise=true , address=77.90.31.14:4662 , piece_id=TDXVPRZI3H3PKC4EFQNXGVCXJCDRSTBNLIRYTBZK6HQ6NNYT6W7Q, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810807110 (47h29m59.85038023s) [noise=true , address=77.90.31.12:4592 , piece_id=6VBYEVZ5A35C636R756RAMIVTZKIWCTMQY3EV2SECWBI5EZ4SYXQ, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810883356 (47h29m59.850456466s) [noise=true , address=77.90.31.16:4735 , piece_id=VXKNEYHEIKZH6BEWOBFDTG7ADV5IZCH5RIHBZ3QIZT4S3OW6HYNA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.811073019 (47h29m59.850646139s) [noise=true , address=77.90.31.17:4771 , piece_id=DRNS6VPHVLBAHV3XXL7TCDUQXGOLGAYOH3NTOZ3YEL46KXBCHAWQ, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.811320322 (47h29m59.850893442s) [noise=true , address=77.90.31.10:4517 , piece_id=JW57FGCENDLLPWCNOHPG2TR5PMARD64EHBHSYZO76ECQJ63CMELA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.811577274 (47h29m59.851150394s) [noise=true , address=77.90.31.21:4877 , piece_id=XHW4LJQM5PNMX7IMHH2IPFN6F7GYKWLPIY2CVO4ZRQXV2E4CKS3A, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.811768991 (47h29m59.851342101s) [noise=true , address=45.91.116.14:4191 , piece_id=EP47P42QIJQPE5TXYHKPPAQP73ZSML63FBY5SPT3A7VXDY3YIOAA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.812181651 (47h29m59.851754761s) [noise=true , address=145.79.227.7:4293 , piece_id=FJ4YAV75LGHP2KHEMAOZ3JD6IBVJVIW7VDXGKBK5IZU7BBNFWDTA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.812383567 (47h29m59.851956687s) [noise=true , address=45.91.116.4:4937 , piece_id=TSGQ2CJYQHUAZRLJM2C3P776AMLQC6Q5I6PXDEJWOXOBQJ7QIGVQ, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:25.652811059 (47h30m1.692384179s) [upload=41724]: Next returned nil segment Sep 8 12:58:25.652828102 (47h30m1.692401242s) [upload=41724]: Waiting for error group managing segments... Sep 8 12:58:25.994321981 (47h30m2.033895101s) [noise=true , address=45.91.116.9:4263 , piece_id=KLU7YBMSWODYK46STGQOGALWPP5CSIE3GPI2E4GPGJMHF2ZFHFZA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.015028906 (47h30m2.054602026s) [noise=true , address=77.90.31.12:4592 , piece_id=6VBYEVZ5A35C636R756RAMIVTZKIWCTMQY3EV2SECWBI5EZ4SYXQ, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.017396505 (47h30m2.056969626s) [noise=true , address=77.90.31.14:4663 , piece_id=2DEH6T75MWICVVLNBRMJQCM4INW6NH7BHCTFQJ5YNSOHHRUL7EYA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.024482014 (47h30m2.064055135s) [noise=true , address=145.79.227.16:4912 , piece_id=4W6SZTNDKYFF3MQUOK72NQAG4O4PINB7KGUT4HT6TR6EESBPGJOQ, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.049167051 (47h30m2.088740171s) [noise=true , address=45.91.116.4:4937 , piece_id=TSGQ2CJYQHUAZRLJM2C3P776AMLQC6Q5I6PXDEJWOXOBQJ7QIGVQ, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.074326225 (47h30m2.113899345s) [noise=true , address=45.91.116.8:4047 , piece_id=MQYS7HJF6TGRHTIYVSHXDOSJCWZ6LUA5T4NG334XR4XIANX74XGA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.082953774 (47h30m2.122526894s) [noise=true , address=45.91.116.7:4009 , piece_id=LIWABT4ZVNFTFJGURN7FRYQHL2UOBMFGL6PCNCIAWM5UJETUAPIA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.090187216 (47h30m2.129760336s) [noise=true , address=45.91.116.9:4262 , piece_id=4O5QLOWKMSMB4DT6P7AXYEJYFN7AAEVBQ5NFQQNU3YJAZPAW4ARA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.092439706 (47h30m2.132012826s) [noise=true , address=145.79.227.7:4293 , piece_id=FJ4YAV75LGHP2KHEMAOZ3JD6IBVJVIW7VDXGKBK5IZU7BBNFWDTA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.093601158 (47h30m2.133174278s) [noise=true , address=77.90.31.14:4662 , piece_id=TDXVPRZI3H3PKC4EFQNXGVCXJCDRSTBNLIRYTBZK6HQ6NNYT6W7Q, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.115577672 (47h30m2.155150782s) [noise=true , address=77.90.31.21:4877 , piece_id=XHW4LJQM5PNMX7IMHH2IPFN6F7GYKWLPIY2CVO4ZRQXV2E4CKS3A, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.135872617 (47h30m2.175445737s) [noise=true , address=77.90.31.17:4771 , piece_id=DRNS6VPHVLBAHV3XXL7TCDUQXGOLGAYOH3NTOZ3YEL46KXBCHAWQ, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.151798182 (47h30m2.191371302s) [noise=true , address=77.90.31.10:4517 , piece_id=JW57FGCENDLLPWCNOHPG2TR5PMARD64EHBHSYZO76ECQJ63CMELA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.151817569 (47h30m2.191390679s) [seg_pos={0 0}, upload=41724]: Segment reached optimal threshold of 13 pieces. Sep 8 12:58:26.151927329 (47h30m2.191500449s) [noise=true , address=45.91.116.14:4191 , piece_id=EP47P42QIJQPE5TXYHKPPAQP73ZSML63FBY5SPT3A7VXDY3YIOAA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF Sep 8 12:58:26.151995800 (47h30m2.19156892s) [noise=true , address=45.91.116.14:4189 , piece_id=Y53JPFVZ5XTMTECDEOFOQITLPCCBMFKPWFKOTV5YKJTKL4TAOTXA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N): protocol: expected piece hash; context canceled; EOF Sep 8 12:58:26.152125829 (47h30m2.191698949s) [noise=true , address=77.90.31.16:4735 , piece_id=VXKNEYHEIKZH6BEWOBFDTG7ADV5IZCH5RIHBZ3QIZT4S3OW6HYNA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 8 12:58:26.152185463 (47h30m2.191758613s) [seg_pos={0 0}, upload=41724]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:58:26.152295744 (47h30m2.191868864s) [upload=41724]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:58:26.152300793 (47h30m2.191873914s) [upload=41724]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:58:26.563915584 (47h30m2.603488704s) [upload=41724]: Done uploading segments... Sep 8 12:58:26.563935643 (47h30m2.603508763s) [upload=41724]: Upload finished. err: <nil> Duration: 17.622403855s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 3.3868974s FAIL (2025-09-08 13:00:57 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 8 12:52:02.555135038 (47h23m38.594708158s) [upload=41633]: Starting upload Sep 8 12:52:02.555196977 (47h23m38.594770097s) [upload=41633]: Done starting upload Sep 8 12:52:02.555253495 (47h23m38.594826615s) [upload=41633]: Uploading segments... Sep 8 12:52:02.555294603 (47h23m38.594867724s) [upload=41633]: Got next segment. Inline: true Sep 8 12:52:02.555299713 (47h23m38.594872863s) [upload=41633]: Waiting for error group managing segments... Sep 8 12:52:02.555361933 (47h23m38.594935053s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:52:02.555370799 (47h23m38.59494392s) [upload=41633]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 8 12:52:02.555374877 (47h23m38.594948007s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:52:16.516475371 (47h23m52.556048491s) [upload=41633]: Done uploading segments... Sep 8 12:52:16.516495109 (47h23m52.556068249s) [upload=41633]: Upload finished. err: <nil> Duration:* 3.386920686s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 6.572247348s FAIL (2025-09-08 13:00:56 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 6.572270322s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 4.704387314s FAIL (2025-09-08 13:00:54 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 4.704425377s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 4.99055972s FAIL (2025-09-08 13:00:51 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , address=185.167.204.205:4002 , piece_id=P2VKYEMEX4R6VGFYVMMOIWJZSVSZY7EDNIDZYJNZWMMXY5YP7JWA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908064709 (47h23m37.947637839s) [noise=true , address=185.167.204.205:4016 , piece_id=ZMZHXMMSMOTDJT2LSJKE5JIKUS5W6JKQ6SHS42MZ63EZEEV5CGTA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908200809 (47h23m37.947773929s) [noise=true , address=81.171.14.70:4033 , piece_id=OHA6HWHGV36NRAT5D4WGRNRN6EEOYQUA6Y5I75RCIYC3SPRXY4UQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908480745 (47h23m37.948053865s) [noise=true , address=81.171.14.70:4043 , piece_id=JZXWCJ2JRKO6WE6MHINF5RXTC2TTD5BGPC33AVFB3557WR5IFBKQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908498108 (47h23m37.948071228s) [noise=true , address=89.149.201.147:4017 , piece_id=N6FF5VCQI3MQ4744RTIFBBNBA4X5DNOZRQAYVVFFX47EQH4O66NA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908737456 (47h23m37.948310587s) [noise=true , address=185.167.204.206:4056 , piece_id=VA66O3ZBJOT5SW2ON4JWP6JOZPFKJ2JZ26AD5AMABABDBLCKU2CA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908745231 (47h23m37.948318351s) [noise=true , address=185.167.204.205:4022 , piece_id=SMWWQAV5TZ7MRJUQSICU75EHQ5BM2AQJLLC3KHEU3VHMAIQWRUZA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908984940 (47h23m37.94855806s) [noise=true , address=81.171.14.70:4047 , piece_id=XWJX7ULTH5WIPZELAYH2CO54AC4QG4VZHZEH7FZJV4BG66EKHRLA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909059853 (47h23m37.948632973s) [noise=true , address=185.167.204.206:4049 , piece_id=SZ72BTAFZ6JUT5RYCIZTAKQXUXNOZX55W26EUDZ5KYI4IDBXKHRQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909330891 (47h23m37.948904011s) [noise=true , address=81.171.14.70:4030 , piece_id=47AKDIHLE6ZTTO3SWU5MU4F3AWEDWZRPHOTL3DVKRC7HSVFF6UXA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909571772 (47h23m37.949144902s) [noise=true , address=185.167.204.205:4036 , piece_id=RVF5AQQOZZZTQZ5GQIGYZNQ3XWIWWYOE3EXQSPGJH3DGS4TWIKFQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909826580 (47h23m37.94939971s) [noise=true , address=185.167.204.206:4062 , piece_id=2DGUDQ3I7LWD5JI4JLP7UH44QVGVQBNIBTLAF32U5GMSWYBV5ATA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:02.740717802 (47h23m38.780290912s) [upload=41632]: Next returned nil segment Sep 8 12:52:02.740761787 (47h23m38.780334907s) [upload=41632]: Waiting for error group managing segments... Sep 8 12:52:03.121855814 (47h23m39.161428934s) [noise=true , address=81.171.14.70:4030 , piece_id=47AKDIHLE6ZTTO3SWU5MU4F3AWEDWZRPHOTL3DVKRC7HSVFF6UXA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.123575474 (47h23m39.163148584s) [noise=true , address=81.171.14.70:4043 , piece_id=JZXWCJ2JRKO6WE6MHINF5RXTC2TTD5BGPC33AVFB3557WR5IFBKQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.143395772 (47h23m39.182968892s) [noise=true , address=81.171.14.70:4047 , piece_id=XWJX7ULTH5WIPZELAYH2CO54AC4QG4VZHZEH7FZJV4BG66EKHRLA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.181951872 (47h23m39.221525002s) [noise=true , address=81.171.14.70:4025 , piece_id=VELILLTRG7STUSJ3QMCLOVWPEE2FPBXAB25X3N2EAXHWET2OGKIA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.193380100 (47h23m39.23295326s) [noise=true , address=89.149.201.147:4016 , piece_id=TB6YA2YQESSLV2RCL34LZ46TES542GVMADM2FQTSLOTZJINL2RGA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.194591699 (47h23m39.234164819s) [noise=true , address=81.171.14.70:4036 , piece_id=BAXE23H4TD4P75TEIX2BFUZHUWXNBQANYG3QB6DEAC5FIH4ETG5A, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.209005330 (47h23m39.24857844s) [noise=true , address=81.171.14.70:4033 , piece_id=OHA6HWHGV36NRAT5D4WGRNRN6EEOYQUA6Y5I75RCIYC3SPRXY4UQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.209649973 (47h23m39.249223093s) [noise=true , address=89.149.201.147:4017 , piece_id=N6FF5VCQI3MQ4744RTIFBBNBA4X5DNOZRQAYVVFFX47EQH4O66NA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.213619009 (47h23m39.253192129s) [noise=true , address=81.171.14.70:4038 , piece_id=3UU55QG3GNAAPQAFXG3KQRH22GCGDGK5E7AEQGNVGYTNCBEGZ4ZQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.228963311 (47h23m39.268536431s) [noise=true , address=81.171.14.70:4041 , piece_id=FZJNDCJWTURN7B477OISN66VDCWU4NOTNRQKYFRKCROBM73WMQWA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.251825980 (47h23m39.2913991s) [noise=true , address=89.149.201.147:4018 , piece_id=MR4IUTFZHI7RC36ZBWAXLRRLP2T7N22SODRUSAAG5D5SSPNYBVVQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.253349455 (47h23m39.292922575s) [noise=true , address=89.149.201.147:4013 , piece_id=ZI6UVH6AEG3WYLORGNUTFPKS4WXXOG6KQ36KAEVJRGXJHLDULSXQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:44.115838176 (47h24m20.155411296s) [noise=true , address=185.167.204.205:4036 , piece_id=RVF5AQQOZZZTQZ5GQIGYZNQ3XWIWWYOE3EXQSPGJH3DGS4TWIKFQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:46.267485246 (47h24m22.307058366s) [noise=true , address=185.167.204.205:4023 , piece_id=LLPUGCULEDSTBHP2S5UCAMMFKNNASOGM2TT57JWGB5P34XE2Z6AA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:46.714425193 (47h24m22.753998313s) [noise=true , address=185.167.204.206:4051 , piece_id=7H54IWRCHR7WD7CQCJGXXHL65PXVYXMBX2ZO2MQW4IQRD446QEDQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:47.345341250 (47h24m23.38491438s) [noise=true , address=185.167.204.206:4062 , piece_id=2DGUDQ3I7LWD5JI4JLP7UH44QVGVQBNIBTLAF32U5GMSWYBV5ATA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:47.540765927 (47h24m23.580339047s) [noise=true , address=185.167.204.206:4064 , piece_id=HUT57RGU53Z4DHPF4EK46WBVQSFQCTYBWZXWXTOQQ7YE43YOXLJA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:48.269023964 (47h24m24.308597084s) [noise=true , address=185.167.204.206:4049 , piece_id=SZ72BTAFZ6JUT5RYCIZTAKQXUXNOZX55W26EUDZ5KYI4IDBXKHRQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:49.663456087 (47h24m25.703029207s) [noise=true , address=185.167.204.206:4071 , piece_id=YNIPZ3QB6GZZOXJAPRFY252FTH6EXV4EGDQLVAIP52YINRYSHKPQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:49.804977327 (47h24m25.844550447s) [noise=true , address=185.167.204.205:4020 , piece_id=GEGJPVGYDJ6ZUBXFZUATDENPTB4HS5AD2TW3UC52QKF7Q7PX377Q, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:50.266767870 (47h24m26.306340991s) [noise=true , address=185.167.204.205:4006 , piece_id=N7L47O3UJ34GIXJODWCPMJ42WS6ZHMQD64FX2JWX7KG2GKRB7FPQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:51.679203615 (47h24m27.718776735s) [noise=true , address=185.167.204.205:4033 , piece_id=GKRNZPWHIHBDW56KU2QK2GT2WXTMNH72SEFJGQWUGHWXVGKH7GOA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:53.979229196 (47h24m30.018802306s) [noise=true , address=185.167.204.205:4002 , piece_id=P2VKYEMEX4R6VGFYVMMOIWJZSVSZY7EDNIDZYJNZWMMXY5YP7JWA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:54.287962666 (47h24m30.327535796s) [noise=true , address=185.167.204.206:4068 , piece_id=GOGCJYBA2BWBI62V7HCX3XA7GKFOVRYMDTFAFPNTRL752JXCTBOA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:57.053910939 (47h24m33.093484059s) [noise=true , address=185.167.204.205:4016 , piece_id=ZMZHXMMSMOTDJT2LSJKE5JIKUS5W6JKQ6SHS42MZ63EZEEV5CGTA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:53:00.495738039 (47h24m36.535311159s) [noise=true , address=185.167.204.206:4056 , piece_id=VA66O3ZBJOT5SW2ON4JWP6JOZPFKJ2JZ26AD5AMABABDBLCKU2CA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:53:00.495764069 (47h24m36.535337179s) [seg_pos={0 0}, upload=41632]: Segment reached optimal threshold of 26 pieces. Sep 8 12:53:00.495926510 (47h24m36.53549963s) [noise=true , address=185.167.204.206:4053 , piece_id=VGMH5NZYOLHWCB3HGM6XOUHZSIPSOXSB7VE3H4WO6WOBVOLXMAAQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:00.495949313 (47h24m36.535522434s) [noise=true , address=185.167.204.205:4022 , piece_id=SMWWQAV5TZ7MRJUQSICU75EHQ5BM2AQJLLC3KHEU3VHMAIQWRUZA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj): protocol: write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection; write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection Sep 8 12:53:00.495998858 (47h24m36.535571989s) [seg_pos={0 0}, upload=41632]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 8 12:53:00.496094631 (47h24m36.535667751s) [upload=41632]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:53:00.496100823 (47h24m36.535673983s) [upload=41632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:53:00.792131065 (47h24m36.831704185s) [upload=41632]: Done uploading segments... Sep 8 12:53:00.792150421 (47h24m36.831723541s) [upload=41632]: Upload finished. err: <nil> Duration: 4.990589357s core uplink eu-select-1 eu1-placement-15
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.565332255s FAIL (2025-09-08 13:00:50 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.565362764s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 11.195861367s FAIL (2025-09-08 13:00:46 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:52:19.209925757 (47h23m55.249498877s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:52:21.143429848 (47h23m57.183002958s) [seg_pos={0 0}, upload=41635]: Begin upload segment... Sep 8 12:52:21.143471006 (47h23m57.183044126s) [seg_pos={0 0}, upload=41635]: Done begin upload segment. Sep 8 12:52:21.143498478 (47h23m57.183071598s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143534477 (47h23m57.183107597s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143860912 (47h23m57.183434032s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143864980 (47h23m57.1834381s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144135457 (47h23m57.183708577s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144291937 (47h23m57.183865077s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144407437 (47h23m57.183980567s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144641045 (47h23m57.184214165s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144668087 (47h23m57.184241197s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144887907 (47h23m57.184461027s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144896333 (47h23m57.184469453s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145098310 (47h23m57.18467143s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145108870 (47h23m57.18468199s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145309754 (47h23m57.184882874s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145316237 (47h23m57.184889357s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145514747 (47h23m57.185087867s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145525216 (47h23m57.185098336s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.146735122 (47h23m57.186308242s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:45.888145215 (47h24m21.927718335s) [upload=41635]: Next returned nil segment Sep 8 12:52:45.888163901 (47h24m21.927737021s) [upload=41635]: Waiting for error group managing segments... Sep 8 12:52:46.918997605 (47h24m22.958570725s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.350218563 (47h24m23.389791683s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.720042654 (47h24m23.759615774s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.579584090 (47h24m24.61915721s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.691947615 (47h24m24.731520735s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:50.187188921 (47h24m26.226762041s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.025054049 (47h24m27.064627169s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.869450123 (47h24m27.909023243s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:52.281020669 (47h24m28.320593779s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.216000424 (47h24m31.255573544s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.266129620 (47h24m31.30570274s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.401392292 (47h24m31.440965412s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:59.964108673 (47h24m36.003681813s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232210648 (47h24m38.271783768s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232242008 (47h24m38.271815128s) [seg_pos={0 0}, upload=41635]: Segment reached optimal threshold of 14 pieces. Sep 8 12:53:02.232380182 (47h24m38.271953312s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XQRaEnpa6KAKuBWL9eRUvPeurEiFaMbjjvDuUkbfq3MT5NWeW): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232447741 (47h24m38.272020871s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wXqePK1kK7iBo6wHcbqkRmkED8LGJ3rzQNJAWa14cHYhx1oyB): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232512285 (47h24m38.272085415s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12htsH8bL33XpUeEstKHb2yeL6TNLusbdRmms9bwzmVCHkej2Xo): protocol: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection Sep 8 12:53:02.232542232 (47h24m38.272115352s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uthP31WaBmn37h54Q6z9ZMtYRY6K8917Ms4kwyyADqu4EXPJy): protocol: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection Sep 8 12:53:02.232562410 (47h24m38.27213553s) [seg_pos={0 0}, upload=41635]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 8 12:53:02.232635761 (47h24m38.272208891s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:53:02.232642724 (47h24m38.272215844s) [upload=41635]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:53:03.008884431 (47h24m39.048457561s) [upload=41635]: Done uploading segments... Sep 8 12:53:03.008909649 (47h24m39.048482789s) [upload=41635]: Upload finished. err: <nil> Duration:* 11.195885102s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 2.244277283s FAIL (2025-09-08 13:00:34 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 2.244309776s core uplink us1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.523699082s FAIL (2025-09-08 13:00:27 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.523741152s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [...............................................X............] duration: 7.764115527s FAIL (2025-09-08 13:00:13 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 7.764148551s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 12.933254756s FAIL (2025-09-08 13:00:09 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:52:19.209925757 (47h23m55.249498877s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:52:21.143429848 (47h23m57.183002958s) [seg_pos={0 0}, upload=41635]: Begin upload segment... Sep 8 12:52:21.143471006 (47h23m57.183044126s) [seg_pos={0 0}, upload=41635]: Done begin upload segment. Sep 8 12:52:21.143498478 (47h23m57.183071598s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143534477 (47h23m57.183107597s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143860912 (47h23m57.183434032s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143864980 (47h23m57.1834381s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144135457 (47h23m57.183708577s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144291937 (47h23m57.183865077s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144407437 (47h23m57.183980567s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144641045 (47h23m57.184214165s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144668087 (47h23m57.184241197s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144887907 (47h23m57.184461027s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144896333 (47h23m57.184469453s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145098310 (47h23m57.18467143s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145108870 (47h23m57.18468199s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145309754 (47h23m57.184882874s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145316237 (47h23m57.184889357s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145514747 (47h23m57.185087867s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145525216 (47h23m57.185098336s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.146735122 (47h23m57.186308242s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:45.888145215 (47h24m21.927718335s) [upload=41635]: Next returned nil segment Sep 8 12:52:45.888163901 (47h24m21.927737021s) [upload=41635]: Waiting for error group managing segments... Sep 8 12:52:46.918997605 (47h24m22.958570725s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.350218563 (47h24m23.389791683s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.720042654 (47h24m23.759615774s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.579584090 (47h24m24.61915721s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.691947615 (47h24m24.731520735s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:50.187188921 (47h24m26.226762041s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.025054049 (47h24m27.064627169s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.869450123 (47h24m27.909023243s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:52.281020669 (47h24m28.320593779s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.216000424 (47h24m31.255573544s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.266129620 (47h24m31.30570274s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.401392292 (47h24m31.440965412s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:59.964108673 (47h24m36.003681813s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232210648 (47h24m38.271783768s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232242008 (47h24m38.271815128s) [seg_pos={0 0}, upload=41635]: Segment reached optimal threshold of 14 pieces. Sep 8 12:53:02.232380182 (47h24m38.271953312s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XQRaEnpa6KAKuBWL9eRUvPeurEiFaMbjjvDuUkbfq3MT5NWeW): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232447741 (47h24m38.272020871s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wXqePK1kK7iBo6wHcbqkRmkED8LGJ3rzQNJAWa14cHYhx1oyB): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232512285 (47h24m38.272085415s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12htsH8bL33XpUeEstKHb2yeL6TNLusbdRmms9bwzmVCHkej2Xo): protocol: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection Sep 8 12:53:02.232542232 (47h24m38.272115352s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uthP31WaBmn37h54Q6z9ZMtYRY6K8917Ms4kwyyADqu4EXPJy): protocol: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection Sep 8 12:53:02.232562410 (47h24m38.27213553s) [seg_pos={0 0}, upload=41635]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 8 12:53:02.232635761 (47h24m38.272208891s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:53:02.232642724 (47h24m38.272215844s) [upload=41635]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:53:03.008884431 (47h24m39.048457561s) [upload=41635]: Done uploading segments... Sep 8 12:53:03.008909649 (47h24m39.048482789s) [upload=41635]: Upload finished. err: <nil> Duration:* 12.933307247s core uplink us-select-1 us1-placement-20
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 5.113856299s FAIL (2025-09-08 13:00:04 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , address=185.167.204.205:4002 , piece_id=P2VKYEMEX4R6VGFYVMMOIWJZSVSZY7EDNIDZYJNZWMMXY5YP7JWA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908064709 (47h23m37.947637839s) [noise=true , address=185.167.204.205:4016 , piece_id=ZMZHXMMSMOTDJT2LSJKE5JIKUS5W6JKQ6SHS42MZ63EZEEV5CGTA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908200809 (47h23m37.947773929s) [noise=true , address=81.171.14.70:4033 , piece_id=OHA6HWHGV36NRAT5D4WGRNRN6EEOYQUA6Y5I75RCIYC3SPRXY4UQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908480745 (47h23m37.948053865s) [noise=true , address=81.171.14.70:4043 , piece_id=JZXWCJ2JRKO6WE6MHINF5RXTC2TTD5BGPC33AVFB3557WR5IFBKQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908498108 (47h23m37.948071228s) [noise=true , address=89.149.201.147:4017 , piece_id=N6FF5VCQI3MQ4744RTIFBBNBA4X5DNOZRQAYVVFFX47EQH4O66NA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908737456 (47h23m37.948310587s) [noise=true , address=185.167.204.206:4056 , piece_id=VA66O3ZBJOT5SW2ON4JWP6JOZPFKJ2JZ26AD5AMABABDBLCKU2CA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908745231 (47h23m37.948318351s) [noise=true , address=185.167.204.205:4022 , piece_id=SMWWQAV5TZ7MRJUQSICU75EHQ5BM2AQJLLC3KHEU3VHMAIQWRUZA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908984940 (47h23m37.94855806s) [noise=true , address=81.171.14.70:4047 , piece_id=XWJX7ULTH5WIPZELAYH2CO54AC4QG4VZHZEH7FZJV4BG66EKHRLA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909059853 (47h23m37.948632973s) [noise=true , address=185.167.204.206:4049 , piece_id=SZ72BTAFZ6JUT5RYCIZTAKQXUXNOZX55W26EUDZ5KYI4IDBXKHRQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909330891 (47h23m37.948904011s) [noise=true , address=81.171.14.70:4030 , piece_id=47AKDIHLE6ZTTO3SWU5MU4F3AWEDWZRPHOTL3DVKRC7HSVFF6UXA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909571772 (47h23m37.949144902s) [noise=true , address=185.167.204.205:4036 , piece_id=RVF5AQQOZZZTQZ5GQIGYZNQ3XWIWWYOE3EXQSPGJH3DGS4TWIKFQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909826580 (47h23m37.94939971s) [noise=true , address=185.167.204.206:4062 , piece_id=2DGUDQ3I7LWD5JI4JLP7UH44QVGVQBNIBTLAF32U5GMSWYBV5ATA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:02.740717802 (47h23m38.780290912s) [upload=41632]: Next returned nil segment Sep 8 12:52:02.740761787 (47h23m38.780334907s) [upload=41632]: Waiting for error group managing segments... Sep 8 12:52:03.121855814 (47h23m39.161428934s) [noise=true , address=81.171.14.70:4030 , piece_id=47AKDIHLE6ZTTO3SWU5MU4F3AWEDWZRPHOTL3DVKRC7HSVFF6UXA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.123575474 (47h23m39.163148584s) [noise=true , address=81.171.14.70:4043 , piece_id=JZXWCJ2JRKO6WE6MHINF5RXTC2TTD5BGPC33AVFB3557WR5IFBKQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.143395772 (47h23m39.182968892s) [noise=true , address=81.171.14.70:4047 , piece_id=XWJX7ULTH5WIPZELAYH2CO54AC4QG4VZHZEH7FZJV4BG66EKHRLA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.181951872 (47h23m39.221525002s) [noise=true , address=81.171.14.70:4025 , piece_id=VELILLTRG7STUSJ3QMCLOVWPEE2FPBXAB25X3N2EAXHWET2OGKIA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.193380100 (47h23m39.23295326s) [noise=true , address=89.149.201.147:4016 , piece_id=TB6YA2YQESSLV2RCL34LZ46TES542GVMADM2FQTSLOTZJINL2RGA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.194591699 (47h23m39.234164819s) [noise=true , address=81.171.14.70:4036 , piece_id=BAXE23H4TD4P75TEIX2BFUZHUWXNBQANYG3QB6DEAC5FIH4ETG5A, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.209005330 (47h23m39.24857844s) [noise=true , address=81.171.14.70:4033 , piece_id=OHA6HWHGV36NRAT5D4WGRNRN6EEOYQUA6Y5I75RCIYC3SPRXY4UQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.209649973 (47h23m39.249223093s) [noise=true , address=89.149.201.147:4017 , piece_id=N6FF5VCQI3MQ4744RTIFBBNBA4X5DNOZRQAYVVFFX47EQH4O66NA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.213619009 (47h23m39.253192129s) [noise=true , address=81.171.14.70:4038 , piece_id=3UU55QG3GNAAPQAFXG3KQRH22GCGDGK5E7AEQGNVGYTNCBEGZ4ZQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.228963311 (47h23m39.268536431s) [noise=true , address=81.171.14.70:4041 , piece_id=FZJNDCJWTURN7B477OISN66VDCWU4NOTNRQKYFRKCROBM73WMQWA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.251825980 (47h23m39.2913991s) [noise=true , address=89.149.201.147:4018 , piece_id=MR4IUTFZHI7RC36ZBWAXLRRLP2T7N22SODRUSAAG5D5SSPNYBVVQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.253349455 (47h23m39.292922575s) [noise=true , address=89.149.201.147:4013 , piece_id=ZI6UVH6AEG3WYLORGNUTFPKS4WXXOG6KQ36KAEVJRGXJHLDULSXQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:44.115838176 (47h24m20.155411296s) [noise=true , address=185.167.204.205:4036 , piece_id=RVF5AQQOZZZTQZ5GQIGYZNQ3XWIWWYOE3EXQSPGJH3DGS4TWIKFQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:46.267485246 (47h24m22.307058366s) [noise=true , address=185.167.204.205:4023 , piece_id=LLPUGCULEDSTBHP2S5UCAMMFKNNASOGM2TT57JWGB5P34XE2Z6AA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:46.714425193 (47h24m22.753998313s) [noise=true , address=185.167.204.206:4051 , piece_id=7H54IWRCHR7WD7CQCJGXXHL65PXVYXMBX2ZO2MQW4IQRD446QEDQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:47.345341250 (47h24m23.38491438s) [noise=true , address=185.167.204.206:4062 , piece_id=2DGUDQ3I7LWD5JI4JLP7UH44QVGVQBNIBTLAF32U5GMSWYBV5ATA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:47.540765927 (47h24m23.580339047s) [noise=true , address=185.167.204.206:4064 , piece_id=HUT57RGU53Z4DHPF4EK46WBVQSFQCTYBWZXWXTOQQ7YE43YOXLJA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:48.269023964 (47h24m24.308597084s) [noise=true , address=185.167.204.206:4049 , piece_id=SZ72BTAFZ6JUT5RYCIZTAKQXUXNOZX55W26EUDZ5KYI4IDBXKHRQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:49.663456087 (47h24m25.703029207s) [noise=true , address=185.167.204.206:4071 , piece_id=YNIPZ3QB6GZZOXJAPRFY252FTH6EXV4EGDQLVAIP52YINRYSHKPQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:49.804977327 (47h24m25.844550447s) [noise=true , address=185.167.204.205:4020 , piece_id=GEGJPVGYDJ6ZUBXFZUATDENPTB4HS5AD2TW3UC52QKF7Q7PX377Q, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:50.266767870 (47h24m26.306340991s) [noise=true , address=185.167.204.205:4006 , piece_id=N7L47O3UJ34GIXJODWCPMJ42WS6ZHMQD64FX2JWX7KG2GKRB7FPQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:51.679203615 (47h24m27.718776735s) [noise=true , address=185.167.204.205:4033 , piece_id=GKRNZPWHIHBDW56KU2QK2GT2WXTMNH72SEFJGQWUGHWXVGKH7GOA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:53.979229196 (47h24m30.018802306s) [noise=true , address=185.167.204.205:4002 , piece_id=P2VKYEMEX4R6VGFYVMMOIWJZSVSZY7EDNIDZYJNZWMMXY5YP7JWA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:54.287962666 (47h24m30.327535796s) [noise=true , address=185.167.204.206:4068 , piece_id=GOGCJYBA2BWBI62V7HCX3XA7GKFOVRYMDTFAFPNTRL752JXCTBOA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:57.053910939 (47h24m33.093484059s) [noise=true , address=185.167.204.205:4016 , piece_id=ZMZHXMMSMOTDJT2LSJKE5JIKUS5W6JKQ6SHS42MZ63EZEEV5CGTA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:53:00.495738039 (47h24m36.535311159s) [noise=true , address=185.167.204.206:4056 , piece_id=VA66O3ZBJOT5SW2ON4JWP6JOZPFKJ2JZ26AD5AMABABDBLCKU2CA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:53:00.495764069 (47h24m36.535337179s) [seg_pos={0 0}, upload=41632]: Segment reached optimal threshold of 26 pieces. Sep 8 12:53:00.495926510 (47h24m36.53549963s) [noise=true , address=185.167.204.206:4053 , piece_id=VGMH5NZYOLHWCB3HGM6XOUHZSIPSOXSB7VE3H4WO6WOBVOLXMAAQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:00.495949313 (47h24m36.535522434s) [noise=true , address=185.167.204.205:4022 , piece_id=SMWWQAV5TZ7MRJUQSICU75EHQ5BM2AQJLLC3KHEU3VHMAIQWRUZA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj): protocol: write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection; write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection Sep 8 12:53:00.495998858 (47h24m36.535571989s) [seg_pos={0 0}, upload=41632]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 8 12:53:00.496094631 (47h24m36.535667751s) [upload=41632]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:53:00.496100823 (47h24m36.535673983s) [upload=41632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:53:00.792131065 (47h24m36.831704185s) [upload=41632]: Done uploading segments... Sep 8 12:53:00.792150421 (47h24m36.831723541s) [upload=41632]: Upload finished. err: <nil> Duration: 5.113881157s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [.......X..............X.....X.............X..X..XX.......X..] duration: 12.420931113s FAIL (2025-09-08 13:00:00 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:58:23.524515845 (47h29m59.564088965s) [upload=41724]: Starting upload Sep 8 12:58:23.524579717 (47h29m59.564152837s) [upload=41724]: Done starting upload Sep 8 12:58:23.524687924 (47h29m59.564261114s) [upload=41724]: Uploading segments... Sep 8 12:58:23.524844213 (47h29m59.564417333s) [upload=41724]: Got next segment. Inline: false Sep 8 12:58:23.524877657 (47h29m59.564450777s) [upload=41724]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:58:23.524895441 (47h29m59.564468561s) [upload=41724]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:58:23.809411399 (47h29m59.848984519s) [seg_pos={0 0}, upload=41724]: Begin upload segment... Sep 8 12:58:23.809451727 (47h29m59.849024847s) [seg_pos={0 0}, upload=41724]: Done begin upload segment. Sep 8 12:58:23.809470893 (47h29m59.849044013s) [noise=true , address=45.91.116.7:4009 , piece_id=LIWABT4ZVNFTFJGURN7FRYQHL2UOBMFGL6PCNCIAWM5UJETUAPIA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.809476925 (47h29m59.849050035s) [noise=true , address=77.90.31.14:4663 , piece_id=2DEH6T75MWICVVLNBRMJQCM4INW6NH7BHCTFQJ5YNSOHHRUL7EYA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.809898000 (47h29m59.849471111s) [noise=true , address=45.91.116.9:4262 , piece_id=4O5QLOWKMSMB4DT6P7AXYEJYFN7AAEVBQ5NFQQNU3YJAZPAW4ARA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.809906086 (47h29m59.849479206s) [noise=true , address=45.91.116.14:4189 , piece_id=Y53JPFVZ5XTMTECDEOFOQITLPCCBMFKPWFKOTV5YKJTKL4TAOTXA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810205008 (47h29m59.849778128s) [noise=true , address=45.91.116.8:4047 , piece_id=MQYS7HJF6TGRHTIYVSHXDOSJCWZ6LUA5T4NG334XR4XIANX74XGA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810263540 (47h29m59.84983666s) [noise=true , address=145.79.227.16:4912 , piece_id=4W6SZTNDKYFF3MQUOK72NQAG4O4PINB7KGUT4HT6TR6EESBPGJOQ, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810513619 (47h29m59.850086739s) [noise=true , address=45.91.116.9:4263 , piece_id=KLU7YBMSWODYK46STGQOGALWPP5CSIE3GPI2E4GPGJMHF2ZFHFZA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810614752 (47h29m59.850187872s) [noise=true , address=77.90.31.14:4662 , piece_id=TDXVPRZI3H3PKC4EFQNXGVCXJCDRSTBNLIRYTBZK6HQ6NNYT6W7Q, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810807110 (47h29m59.85038023s) [noise=true , address=77.90.31.12:4592 , piece_id=6VBYEVZ5A35C636R756RAMIVTZKIWCTMQY3EV2SECWBI5EZ4SYXQ, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810883356 (47h29m59.850456466s) [noise=true , address=77.90.31.16:4735 , piece_id=VXKNEYHEIKZH6BEWOBFDTG7ADV5IZCH5RIHBZ3QIZT4S3OW6HYNA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.811073019 (47h29m59.850646139s) [noise=true , address=77.90.31.17:4771 , piece_id=DRNS6VPHVLBAHV3XXL7TCDUQXGOLGAYOH3NTOZ3YEL46KXBCHAWQ, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.811320322 (47h29m59.850893442s) [noise=true , address=77.90.31.10:4517 , piece_id=JW57FGCENDLLPWCNOHPG2TR5PMARD64EHBHSYZO76ECQJ63CMELA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.811577274 (47h29m59.851150394s) [noise=true , address=77.90.31.21:4877 , piece_id=XHW4LJQM5PNMX7IMHH2IPFN6F7GYKWLPIY2CVO4ZRQXV2E4CKS3A, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.811768991 (47h29m59.851342101s) [noise=true , address=45.91.116.14:4191 , piece_id=EP47P42QIJQPE5TXYHKPPAQP73ZSML63FBY5SPT3A7VXDY3YIOAA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.812181651 (47h29m59.851754761s) [noise=true , address=145.79.227.7:4293 , piece_id=FJ4YAV75LGHP2KHEMAOZ3JD6IBVJVIW7VDXGKBK5IZU7BBNFWDTA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.812383567 (47h29m59.851956687s) [noise=true , address=45.91.116.4:4937 , piece_id=TSGQ2CJYQHUAZRLJM2C3P776AMLQC6Q5I6PXDEJWOXOBQJ7QIGVQ, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:25.652811059 (47h30m1.692384179s) [upload=41724]: Next returned nil segment Sep 8 12:58:25.652828102 (47h30m1.692401242s) [upload=41724]: Waiting for error group managing segments... Sep 8 12:58:25.994321981 (47h30m2.033895101s) [noise=true , address=45.91.116.9:4263 , piece_id=KLU7YBMSWODYK46STGQOGALWPP5CSIE3GPI2E4GPGJMHF2ZFHFZA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.015028906 (47h30m2.054602026s) [noise=true , address=77.90.31.12:4592 , piece_id=6VBYEVZ5A35C636R756RAMIVTZKIWCTMQY3EV2SECWBI5EZ4SYXQ, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.017396505 (47h30m2.056969626s) [noise=true , address=77.90.31.14:4663 , piece_id=2DEH6T75MWICVVLNBRMJQCM4INW6NH7BHCTFQJ5YNSOHHRUL7EYA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.024482014 (47h30m2.064055135s) [noise=true , address=145.79.227.16:4912 , piece_id=4W6SZTNDKYFF3MQUOK72NQAG4O4PINB7KGUT4HT6TR6EESBPGJOQ, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.049167051 (47h30m2.088740171s) [noise=true , address=45.91.116.4:4937 , piece_id=TSGQ2CJYQHUAZRLJM2C3P776AMLQC6Q5I6PXDEJWOXOBQJ7QIGVQ, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.074326225 (47h30m2.113899345s) [noise=true , address=45.91.116.8:4047 , piece_id=MQYS7HJF6TGRHTIYVSHXDOSJCWZ6LUA5T4NG334XR4XIANX74XGA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.082953774 (47h30m2.122526894s) [noise=true , address=45.91.116.7:4009 , piece_id=LIWABT4ZVNFTFJGURN7FRYQHL2UOBMFGL6PCNCIAWM5UJETUAPIA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.090187216 (47h30m2.129760336s) [noise=true , address=45.91.116.9:4262 , piece_id=4O5QLOWKMSMB4DT6P7AXYEJYFN7AAEVBQ5NFQQNU3YJAZPAW4ARA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.092439706 (47h30m2.132012826s) [noise=true , address=145.79.227.7:4293 , piece_id=FJ4YAV75LGHP2KHEMAOZ3JD6IBVJVIW7VDXGKBK5IZU7BBNFWDTA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.093601158 (47h30m2.133174278s) [noise=true , address=77.90.31.14:4662 , piece_id=TDXVPRZI3H3PKC4EFQNXGVCXJCDRSTBNLIRYTBZK6HQ6NNYT6W7Q, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.115577672 (47h30m2.155150782s) [noise=true , address=77.90.31.21:4877 , piece_id=XHW4LJQM5PNMX7IMHH2IPFN6F7GYKWLPIY2CVO4ZRQXV2E4CKS3A, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.135872617 (47h30m2.175445737s) [noise=true , address=77.90.31.17:4771 , piece_id=DRNS6VPHVLBAHV3XXL7TCDUQXGOLGAYOH3NTOZ3YEL46KXBCHAWQ, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.151798182 (47h30m2.191371302s) [noise=true , address=77.90.31.10:4517 , piece_id=JW57FGCENDLLPWCNOHPG2TR5PMARD64EHBHSYZO76ECQJ63CMELA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.151817569 (47h30m2.191390679s) [seg_pos={0 0}, upload=41724]: Segment reached optimal threshold of 13 pieces. Sep 8 12:58:26.151927329 (47h30m2.191500449s) [noise=true , address=45.91.116.14:4191 , piece_id=EP47P42QIJQPE5TXYHKPPAQP73ZSML63FBY5SPT3A7VXDY3YIOAA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF Sep 8 12:58:26.151995800 (47h30m2.19156892s) [noise=true , address=45.91.116.14:4189 , piece_id=Y53JPFVZ5XTMTECDEOFOQITLPCCBMFKPWFKOTV5YKJTKL4TAOTXA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N): protocol: expected piece hash; context canceled; EOF Sep 8 12:58:26.152125829 (47h30m2.191698949s) [noise=true , address=77.90.31.16:4735 , piece_id=VXKNEYHEIKZH6BEWOBFDTG7ADV5IZCH5RIHBZ3QIZT4S3OW6HYNA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 8 12:58:26.152185463 (47h30m2.191758613s) [seg_pos={0 0}, upload=41724]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:58:26.152295744 (47h30m2.191868864s) [upload=41724]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:58:26.152300793 (47h30m2.191873914s) [upload=41724]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:58:26.563915584 (47h30m2.603488704s) [upload=41724]: Done uploading segments... Sep 8 12:58:26.563935643 (47h30m2.603508763s) [upload=41724]: Upload finished. err: <nil> Duration: 12.420956041s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 2.14223961s FAIL (2025-09-08 12:59:57 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 8 12:52:02.555135038 (47h23m38.594708158s) [upload=41633]: Starting upload Sep 8 12:52:02.555196977 (47h23m38.594770097s) [upload=41633]: Done starting upload Sep 8 12:52:02.555253495 (47h23m38.594826615s) [upload=41633]: Uploading segments... Sep 8 12:52:02.555294603 (47h23m38.594867724s) [upload=41633]: Got next segment. Inline: true Sep 8 12:52:02.555299713 (47h23m38.594872863s) [upload=41633]: Waiting for error group managing segments... Sep 8 12:52:02.555361933 (47h23m38.594935053s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:52:02.555370799 (47h23m38.59494392s) [upload=41633]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 8 12:52:02.555374877 (47h23m38.594948007s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:52:16.516475371 (47h23m52.556048491s) [upload=41633]: Done uploading segments... Sep 8 12:52:16.516495109 (47h23m52.556068249s) [upload=41633]: Upload finished. err: <nil> Duration:* 2.142261151s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 3.274521578s FAIL (2025-09-08 12:59:51 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 3.274551557s core uplink us1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [........X..............X.....X.............X..X..XX.......X.] duration: 18.211937214s FAIL (2025-09-08 12:59:46 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:58:23.524515845 (47h29m59.564088965s) [upload=41724]: Starting upload Sep 8 12:58:23.524579717 (47h29m59.564152837s) [upload=41724]: Done starting upload Sep 8 12:58:23.524687924 (47h29m59.564261114s) [upload=41724]: Uploading segments... Sep 8 12:58:23.524844213 (47h29m59.564417333s) [upload=41724]: Got next segment. Inline: false Sep 8 12:58:23.524877657 (47h29m59.564450777s) [upload=41724]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:58:23.524895441 (47h29m59.564468561s) [upload=41724]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:58:23.809411399 (47h29m59.848984519s) [seg_pos={0 0}, upload=41724]: Begin upload segment... Sep 8 12:58:23.809451727 (47h29m59.849024847s) [seg_pos={0 0}, upload=41724]: Done begin upload segment. Sep 8 12:58:23.809470893 (47h29m59.849044013s) [noise=true , address=45.91.116.7:4009 , piece_id=LIWABT4ZVNFTFJGURN7FRYQHL2UOBMFGL6PCNCIAWM5UJETUAPIA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.809476925 (47h29m59.849050035s) [noise=true , address=77.90.31.14:4663 , piece_id=2DEH6T75MWICVVLNBRMJQCM4INW6NH7BHCTFQJ5YNSOHHRUL7EYA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.809898000 (47h29m59.849471111s) [noise=true , address=45.91.116.9:4262 , piece_id=4O5QLOWKMSMB4DT6P7AXYEJYFN7AAEVBQ5NFQQNU3YJAZPAW4ARA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.809906086 (47h29m59.849479206s) [noise=true , address=45.91.116.14:4189 , piece_id=Y53JPFVZ5XTMTECDEOFOQITLPCCBMFKPWFKOTV5YKJTKL4TAOTXA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810205008 (47h29m59.849778128s) [noise=true , address=45.91.116.8:4047 , piece_id=MQYS7HJF6TGRHTIYVSHXDOSJCWZ6LUA5T4NG334XR4XIANX74XGA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810263540 (47h29m59.84983666s) [noise=true , address=145.79.227.16:4912 , piece_id=4W6SZTNDKYFF3MQUOK72NQAG4O4PINB7KGUT4HT6TR6EESBPGJOQ, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810513619 (47h29m59.850086739s) [noise=true , address=45.91.116.9:4263 , piece_id=KLU7YBMSWODYK46STGQOGALWPP5CSIE3GPI2E4GPGJMHF2ZFHFZA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810614752 (47h29m59.850187872s) [noise=true , address=77.90.31.14:4662 , piece_id=TDXVPRZI3H3PKC4EFQNXGVCXJCDRSTBNLIRYTBZK6HQ6NNYT6W7Q, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810807110 (47h29m59.85038023s) [noise=true , address=77.90.31.12:4592 , piece_id=6VBYEVZ5A35C636R756RAMIVTZKIWCTMQY3EV2SECWBI5EZ4SYXQ, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810883356 (47h29m59.850456466s) [noise=true , address=77.90.31.16:4735 , piece_id=VXKNEYHEIKZH6BEWOBFDTG7ADV5IZCH5RIHBZ3QIZT4S3OW6HYNA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.811073019 (47h29m59.850646139s) [noise=true , address=77.90.31.17:4771 , piece_id=DRNS6VPHVLBAHV3XXL7TCDUQXGOLGAYOH3NTOZ3YEL46KXBCHAWQ, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.811320322 (47h29m59.850893442s) [noise=true , address=77.90.31.10:4517 , piece_id=JW57FGCENDLLPWCNOHPG2TR5PMARD64EHBHSYZO76ECQJ63CMELA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.811577274 (47h29m59.851150394s) [noise=true , address=77.90.31.21:4877 , piece_id=XHW4LJQM5PNMX7IMHH2IPFN6F7GYKWLPIY2CVO4ZRQXV2E4CKS3A, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.811768991 (47h29m59.851342101s) [noise=true , address=45.91.116.14:4191 , piece_id=EP47P42QIJQPE5TXYHKPPAQP73ZSML63FBY5SPT3A7VXDY3YIOAA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.812181651 (47h29m59.851754761s) [noise=true , address=145.79.227.7:4293 , piece_id=FJ4YAV75LGHP2KHEMAOZ3JD6IBVJVIW7VDXGKBK5IZU7BBNFWDTA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.812383567 (47h29m59.851956687s) [noise=true , address=45.91.116.4:4937 , piece_id=TSGQ2CJYQHUAZRLJM2C3P776AMLQC6Q5I6PXDEJWOXOBQJ7QIGVQ, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:25.652811059 (47h30m1.692384179s) [upload=41724]: Next returned nil segment Sep 8 12:58:25.652828102 (47h30m1.692401242s) [upload=41724]: Waiting for error group managing segments... Sep 8 12:58:25.994321981 (47h30m2.033895101s) [noise=true , address=45.91.116.9:4263 , piece_id=KLU7YBMSWODYK46STGQOGALWPP5CSIE3GPI2E4GPGJMHF2ZFHFZA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.015028906 (47h30m2.054602026s) [noise=true , address=77.90.31.12:4592 , piece_id=6VBYEVZ5A35C636R756RAMIVTZKIWCTMQY3EV2SECWBI5EZ4SYXQ, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.017396505 (47h30m2.056969626s) [noise=true , address=77.90.31.14:4663 , piece_id=2DEH6T75MWICVVLNBRMJQCM4INW6NH7BHCTFQJ5YNSOHHRUL7EYA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.024482014 (47h30m2.064055135s) [noise=true , address=145.79.227.16:4912 , piece_id=4W6SZTNDKYFF3MQUOK72NQAG4O4PINB7KGUT4HT6TR6EESBPGJOQ, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.049167051 (47h30m2.088740171s) [noise=true , address=45.91.116.4:4937 , piece_id=TSGQ2CJYQHUAZRLJM2C3P776AMLQC6Q5I6PXDEJWOXOBQJ7QIGVQ, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.074326225 (47h30m2.113899345s) [noise=true , address=45.91.116.8:4047 , piece_id=MQYS7HJF6TGRHTIYVSHXDOSJCWZ6LUA5T4NG334XR4XIANX74XGA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.082953774 (47h30m2.122526894s) [noise=true , address=45.91.116.7:4009 , piece_id=LIWABT4ZVNFTFJGURN7FRYQHL2UOBMFGL6PCNCIAWM5UJETUAPIA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.090187216 (47h30m2.129760336s) [noise=true , address=45.91.116.9:4262 , piece_id=4O5QLOWKMSMB4DT6P7AXYEJYFN7AAEVBQ5NFQQNU3YJAZPAW4ARA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.092439706 (47h30m2.132012826s) [noise=true , address=145.79.227.7:4293 , piece_id=FJ4YAV75LGHP2KHEMAOZ3JD6IBVJVIW7VDXGKBK5IZU7BBNFWDTA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.093601158 (47h30m2.133174278s) [noise=true , address=77.90.31.14:4662 , piece_id=TDXVPRZI3H3PKC4EFQNXGVCXJCDRSTBNLIRYTBZK6HQ6NNYT6W7Q, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.115577672 (47h30m2.155150782s) [noise=true , address=77.90.31.21:4877 , piece_id=XHW4LJQM5PNMX7IMHH2IPFN6F7GYKWLPIY2CVO4ZRQXV2E4CKS3A, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.135872617 (47h30m2.175445737s) [noise=true , address=77.90.31.17:4771 , piece_id=DRNS6VPHVLBAHV3XXL7TCDUQXGOLGAYOH3NTOZ3YEL46KXBCHAWQ, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.151798182 (47h30m2.191371302s) [noise=true , address=77.90.31.10:4517 , piece_id=JW57FGCENDLLPWCNOHPG2TR5PMARD64EHBHSYZO76ECQJ63CMELA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.151817569 (47h30m2.191390679s) [seg_pos={0 0}, upload=41724]: Segment reached optimal threshold of 13 pieces. Sep 8 12:58:26.151927329 (47h30m2.191500449s) [noise=true , address=45.91.116.14:4191 , piece_id=EP47P42QIJQPE5TXYHKPPAQP73ZSML63FBY5SPT3A7VXDY3YIOAA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF Sep 8 12:58:26.151995800 (47h30m2.19156892s) [noise=true , address=45.91.116.14:4189 , piece_id=Y53JPFVZ5XTMTECDEOFOQITLPCCBMFKPWFKOTV5YKJTKL4TAOTXA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N): protocol: expected piece hash; context canceled; EOF Sep 8 12:58:26.152125829 (47h30m2.191698949s) [noise=true , address=77.90.31.16:4735 , piece_id=VXKNEYHEIKZH6BEWOBFDTG7ADV5IZCH5RIHBZ3QIZT4S3OW6HYNA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 8 12:58:26.152185463 (47h30m2.191758613s) [seg_pos={0 0}, upload=41724]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:58:26.152295744 (47h30m2.191868864s) [upload=41724]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:58:26.152300793 (47h30m2.191873914s) [upload=41724]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:58:26.563915584 (47h30m2.603488704s) [upload=41724]: Done uploading segments... Sep 8 12:58:26.563935643 (47h30m2.603508763s) [upload=41724]: Upload finished. err: <nil> Duration: 18.211960478s core uplink us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (gateway.us1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.489665409s FAIL (2025-09-08 12:59:46 UTC) orbiter warning: operation error S3: PutObject, https response error StatusCode: 0, RequestID: , HostID: , canceled, context deadline exceeded Duration: 2.489694165s edge gateway us-select-1
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 6.182439142s FAIL (2025-09-08 12:59:42 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 6.182463279s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline) antiblip: 1 out of 60 is failed (threshold=3) [..................................................X.........] duration: 2.143925315s FAIL (2025-09-08 12:59:40 UTC) orbiter warning: operation: ListObjects ======ERROR====== uplink: metainfo: metaclient: context deadline exceeded ======LOGS====== Sep 8 12:52:02.555135038 (47h23m38.594708158s) [upload=41633]: Starting upload Sep 8 12:52:02.555196977 (47h23m38.594770097s) [upload=41633]: Done starting upload Sep 8 12:52:02.555253495 (47h23m38.594826615s) [upload=41633]: Uploading segments... Sep 8 12:52:02.555294603 (47h23m38.594867724s) [upload=41633]: Got next segment. Inline: true Sep 8 12:52:02.555299713 (47h23m38.594872863s) [upload=41633]: Waiting for error group managing segments... Sep 8 12:52:02.555361933 (47h23m38.594935053s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:52:02.555370799 (47h23m38.59494392s) [upload=41633]: Flush batch item: pb.BatchRequestItem_SegmentMakeInline Sep 8 12:52:02.555374877 (47h23m38.594948007s) [upload=41633]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:52:16.516475371 (47h23m52.556048491s) [upload=41633]: Done uploading segments... Sep 8 12:52:16.516495109 (47h23m52.556068249s) [upload=41633]: Upload finished. err: <nil> Duration:* 2.14394474s core uplink us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote) antiblip: 1 out of 60 is failed (threshold=3) [................................................X...........] duration: 6.807177199s FAIL (2025-09-08 12:59:38 UTC) orbiter warning: operation: StatBucket uplink: bucket: metaclient: context deadline exceeded Duration: 6.807202146s core uplink us1
checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 4.987736605s FAIL (2025-09-08 12:59:22 UTC) orbiter warning: operation: DownloadObject ======ERROR====== uplink: metaclient: context deadline exceeded ======LOGS====== , address=185.167.204.205:4002 , piece_id=P2VKYEMEX4R6VGFYVMMOIWJZSVSZY7EDNIDZYJNZWMMXY5YP7JWA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908064709 (47h23m37.947637839s) [noise=true , address=185.167.204.205:4016 , piece_id=ZMZHXMMSMOTDJT2LSJKE5JIKUS5W6JKQ6SHS42MZ63EZEEV5CGTA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908200809 (47h23m37.947773929s) [noise=true , address=81.171.14.70:4033 , piece_id=OHA6HWHGV36NRAT5D4WGRNRN6EEOYQUA6Y5I75RCIYC3SPRXY4UQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908480745 (47h23m37.948053865s) [noise=true , address=81.171.14.70:4043 , piece_id=JZXWCJ2JRKO6WE6MHINF5RXTC2TTD5BGPC33AVFB3557WR5IFBKQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908498108 (47h23m37.948071228s) [noise=true , address=89.149.201.147:4017 , piece_id=N6FF5VCQI3MQ4744RTIFBBNBA4X5DNOZRQAYVVFFX47EQH4O66NA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908737456 (47h23m37.948310587s) [noise=true , address=185.167.204.206:4056 , piece_id=VA66O3ZBJOT5SW2ON4JWP6JOZPFKJ2JZ26AD5AMABABDBLCKU2CA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908745231 (47h23m37.948318351s) [noise=true , address=185.167.204.205:4022 , piece_id=SMWWQAV5TZ7MRJUQSICU75EHQ5BM2AQJLLC3KHEU3VHMAIQWRUZA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.908984940 (47h23m37.94855806s) [noise=true , address=81.171.14.70:4047 , piece_id=XWJX7ULTH5WIPZELAYH2CO54AC4QG4VZHZEH7FZJV4BG66EKHRLA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909059853 (47h23m37.948632973s) [noise=true , address=185.167.204.206:4049 , piece_id=SZ72BTAFZ6JUT5RYCIZTAKQXUXNOZX55W26EUDZ5KYI4IDBXKHRQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909330891 (47h23m37.948904011s) [noise=true , address=81.171.14.70:4030 , piece_id=47AKDIHLE6ZTTO3SWU5MU4F3AWEDWZRPHOTL3DVKRC7HSVFF6UXA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909571772 (47h23m37.949144902s) [noise=true , address=185.167.204.205:4036 , piece_id=RVF5AQQOZZZTQZ5GQIGYZNQ3XWIWWYOE3EXQSPGJH3DGS4TWIKFQ, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:01.909826580 (47h23m37.94939971s) [noise=true , address=185.167.204.206:4062 , piece_id=2DGUDQ3I7LWD5JI4JLP7UH44QVGVQBNIBTLAF32U5GMSWYBV5ATA, seg_pos={0 0}, upload=41632]: Uploading piece... Sep 8 12:52:02.740717802 (47h23m38.780290912s) [upload=41632]: Next returned nil segment Sep 8 12:52:02.740761787 (47h23m38.780334907s) [upload=41632]: Waiting for error group managing segments... Sep 8 12:52:03.121855814 (47h23m39.161428934s) [noise=true , address=81.171.14.70:4030 , piece_id=47AKDIHLE6ZTTO3SWU5MU4F3AWEDWZRPHOTL3DVKRC7HSVFF6UXA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.123575474 (47h23m39.163148584s) [noise=true , address=81.171.14.70:4043 , piece_id=JZXWCJ2JRKO6WE6MHINF5RXTC2TTD5BGPC33AVFB3557WR5IFBKQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.143395772 (47h23m39.182968892s) [noise=true , address=81.171.14.70:4047 , piece_id=XWJX7ULTH5WIPZELAYH2CO54AC4QG4VZHZEH7FZJV4BG66EKHRLA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.181951872 (47h23m39.221525002s) [noise=true , address=81.171.14.70:4025 , piece_id=VELILLTRG7STUSJ3QMCLOVWPEE2FPBXAB25X3N2EAXHWET2OGKIA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.193380100 (47h23m39.23295326s) [noise=true , address=89.149.201.147:4016 , piece_id=TB6YA2YQESSLV2RCL34LZ46TES542GVMADM2FQTSLOTZJINL2RGA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.194591699 (47h23m39.234164819s) [noise=true , address=81.171.14.70:4036 , piece_id=BAXE23H4TD4P75TEIX2BFUZHUWXNBQANYG3QB6DEAC5FIH4ETG5A, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.209005330 (47h23m39.24857844s) [noise=true , address=81.171.14.70:4033 , piece_id=OHA6HWHGV36NRAT5D4WGRNRN6EEOYQUA6Y5I75RCIYC3SPRXY4UQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.209649973 (47h23m39.249223093s) [noise=true , address=89.149.201.147:4017 , piece_id=N6FF5VCQI3MQ4744RTIFBBNBA4X5DNOZRQAYVVFFX47EQH4O66NA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.213619009 (47h23m39.253192129s) [noise=true , address=81.171.14.70:4038 , piece_id=3UU55QG3GNAAPQAFXG3KQRH22GCGDGK5E7AEQGNVGYTNCBEGZ4ZQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.228963311 (47h23m39.268536431s) [noise=true , address=81.171.14.70:4041 , piece_id=FZJNDCJWTURN7B477OISN66VDCWU4NOTNRQKYFRKCROBM73WMQWA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.251825980 (47h23m39.2913991s) [noise=true , address=89.149.201.147:4018 , piece_id=MR4IUTFZHI7RC36ZBWAXLRRLP2T7N22SODRUSAAG5D5SSPNYBVVQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:03.253349455 (47h23m39.292922575s) [noise=true , address=89.149.201.147:4013 , piece_id=ZI6UVH6AEG3WYLORGNUTFPKS4WXXOG6KQ36KAEVJRGXJHLDULSXQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:44.115838176 (47h24m20.155411296s) [noise=true , address=185.167.204.205:4036 , piece_id=RVF5AQQOZZZTQZ5GQIGYZNQ3XWIWWYOE3EXQSPGJH3DGS4TWIKFQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:46.267485246 (47h24m22.307058366s) [noise=true , address=185.167.204.205:4023 , piece_id=LLPUGCULEDSTBHP2S5UCAMMFKNNASOGM2TT57JWGB5P34XE2Z6AA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:46.714425193 (47h24m22.753998313s) [noise=true , address=185.167.204.206:4051 , piece_id=7H54IWRCHR7WD7CQCJGXXHL65PXVYXMBX2ZO2MQW4IQRD446QEDQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:47.345341250 (47h24m23.38491438s) [noise=true , address=185.167.204.206:4062 , piece_id=2DGUDQ3I7LWD5JI4JLP7UH44QVGVQBNIBTLAF32U5GMSWYBV5ATA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:47.540765927 (47h24m23.580339047s) [noise=true , address=185.167.204.206:4064 , piece_id=HUT57RGU53Z4DHPF4EK46WBVQSFQCTYBWZXWXTOQQ7YE43YOXLJA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:48.269023964 (47h24m24.308597084s) [noise=true , address=185.167.204.206:4049 , piece_id=SZ72BTAFZ6JUT5RYCIZTAKQXUXNOZX55W26EUDZ5KYI4IDBXKHRQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:49.663456087 (47h24m25.703029207s) [noise=true , address=185.167.204.206:4071 , piece_id=YNIPZ3QB6GZZOXJAPRFY252FTH6EXV4EGDQLVAIP52YINRYSHKPQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:49.804977327 (47h24m25.844550447s) [noise=true , address=185.167.204.205:4020 , piece_id=GEGJPVGYDJ6ZUBXFZUATDENPTB4HS5AD2TW3UC52QKF7Q7PX377Q, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:50.266767870 (47h24m26.306340991s) [noise=true , address=185.167.204.205:4006 , piece_id=N7L47O3UJ34GIXJODWCPMJ42WS6ZHMQD64FX2JWX7KG2GKRB7FPQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:51.679203615 (47h24m27.718776735s) [noise=true , address=185.167.204.205:4033 , piece_id=GKRNZPWHIHBDW56KU2QK2GT2WXTMNH72SEFJGQWUGHWXVGKH7GOA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:53.979229196 (47h24m30.018802306s) [noise=true , address=185.167.204.205:4002 , piece_id=P2VKYEMEX4R6VGFYVMMOIWJZSVSZY7EDNIDZYJNZWMMXY5YP7JWA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:54.287962666 (47h24m30.327535796s) [noise=true , address=185.167.204.206:4068 , piece_id=GOGCJYBA2BWBI62V7HCX3XA7GKFOVRYMDTFAFPNTRL752JXCTBOA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:52:57.053910939 (47h24m33.093484059s) [noise=true , address=185.167.204.205:4016 , piece_id=ZMZHXMMSMOTDJT2LSJKE5JIKUS5W6JKQ6SHS42MZ63EZEEV5CGTA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:53:00.495738039 (47h24m36.535311159s) [noise=true , address=185.167.204.206:4056 , piece_id=VA66O3ZBJOT5SW2ON4JWP6JOZPFKJ2JZ26AD5AMABABDBLCKU2CA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: <nil> Sep 8 12:53:00.495764069 (47h24m36.535337179s) [seg_pos={0 0}, upload=41632]: Segment reached optimal threshold of 26 pieces. Sep 8 12:53:00.495926510 (47h24m36.53549963s) [noise=true , address=185.167.204.206:4053 , piece_id=VGMH5NZYOLHWCB3HGM6XOUHZSIPSOXSB7VE3H4WO6WOBVOLXMAAQ, seg_pos={0 0}, upload=41632]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12SrFttJpndpv7TKJJYsKthWnGWBYQGHpS9CwqTd4mqBP9NCCm8): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:00.495949313 (47h24m36.535522434s) [noise=true , address=185.167.204.205:4022 , piece_id=SMWWQAV5TZ7MRJUQSICU75EHQ5BM2AQJLLC3KHEU3VHMAIQWRUZA, seg_pos={0 0}, upload=41632]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1fT9qH1igPUNfrzpwa2VkBX7heh475sNqoN4Nsf9FYSwi1VmHj): protocol: write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection; write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:42524->185.167.204.205:4022: use of closed network connection Sep 8 12:53:00.495998858 (47h24m36.535571989s) [seg_pos={0 0}, upload=41632]: Done waiting for segment. successful: 26 optimal: 26 errs: <nil> Sep 8 12:53:00.496094631 (47h24m36.535667751s) [upload=41632]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:53:00.496100823 (47h24m36.535673983s) [upload=41632]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:53:00.792131065 (47h24m36.831704185s) [upload=41632]: Done uploading segments... Sep 8 12:53:00.792150421 (47h24m36.831723541s) [upload=41632]: Upload finished. err: <nil> Duration: 4.987768367s core uplink eu-select-1 eu1-placement-15
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote) antiblip: 1 out of 60 is failed (threshold=3) [...................................................X........] duration: 14.763118132s FAIL (2025-09-08 12:59:20 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:52:19.209925757 (47h23m55.249498877s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:52:21.143429848 (47h23m57.183002958s) [seg_pos={0 0}, upload=41635]: Begin upload segment... Sep 8 12:52:21.143471006 (47h23m57.183044126s) [seg_pos={0 0}, upload=41635]: Done begin upload segment. Sep 8 12:52:21.143498478 (47h23m57.183071598s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143534477 (47h23m57.183107597s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143860912 (47h23m57.183434032s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.143864980 (47h23m57.1834381s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144135457 (47h23m57.183708577s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144291937 (47h23m57.183865077s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144407437 (47h23m57.183980567s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144641045 (47h23m57.184214165s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144668087 (47h23m57.184241197s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144887907 (47h23m57.184461027s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.144896333 (47h23m57.184469453s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145098310 (47h23m57.18467143s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145108870 (47h23m57.18468199s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145309754 (47h23m57.184882874s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145316237 (47h23m57.184889357s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145514747 (47h23m57.185087867s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.145525216 (47h23m57.185098336s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:21.146735122 (47h23m57.186308242s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Uploading piece... Sep 8 12:52:45.888145215 (47h24m21.927718335s) [upload=41635]: Next returned nil segment Sep 8 12:52:45.888163901 (47h24m21.927737021s) [upload=41635]: Waiting for error group managing segments... Sep 8 12:52:46.918997605 (47h24m22.958570725s) [noise=true , address=145.79.227.35:4499 , piece_id=MF7UN6QMVE3PNQB4ML4EPKJTU7NRCICD2HZ2EHNKXWLS2BHPYLXQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.350218563 (47h24m23.389791683s) [noise=true , address=145.79.227.52:4458 , piece_id=M634CEKNORZBSCZ2NOOPSBIIIO5MNUPJ5GI52Q3F3KWPXZUIZQUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:47.720042654 (47h24m23.759615774s) [noise=true , address=145.79.227.15:4906 , piece_id=JNEFZPTVAEIZPJQ27EM3C6GUVCOGPWVFODUA554KBAWXENUQMP3A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.579584090 (47h24m24.61915721s) [noise=true , address=145.79.227.19:4088 , piece_id=H3XIGHNMODZEBYUJCABTMS4PFRK426Y265DTOUOLDBD3CX5JJXCQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:48.691947615 (47h24m24.731520735s) [noise=true , address=77.90.31.17:4804 , piece_id=MAMJEB73RPWLXT4RWJ6UVWRSRSANGIKF5IRAQ6QJ2HG65R46E3NA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:50.187188921 (47h24m26.226762041s) [noise=true , address=145.79.227.14:4865 , piece_id=UI36GKC7GI6KO2EFUDVSYP3DDR3MQJV5CCKHLNCB5DFFDATK4OQQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.025054049 (47h24m27.064627169s) [noise=true , address=145.79.227.3:4184 , piece_id=2J5VAOLXV6DA66JMCZ3JZUB2N4DWBS5KW6B5XH5AERP6UDEUJUUQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:51.869450123 (47h24m27.909023243s) [noise=true , address=145.79.227.33:4890 , piece_id=6LQL52BOKZ6E34DAZCJVT32LRVFFTL6C334ATLP4IRXL76GZ6B4A, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:52.281020669 (47h24m28.320593779s) [noise=true , address=145.79.227.13:4821 , piece_id=SREK4X2AL4V24LIP35MNONP2WWXAQLPAWMBKNUVA6NQLU5CZR4BQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.216000424 (47h24m31.255573544s) [noise=true , address=145.79.227.37:4585 , piece_id=HKVUSQXLRDJGI62SE3DBN2YGE4J7TWACOMGOZB5GNX5EHDHNCHKQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.266129620 (47h24m31.30570274s) [noise=true , address=145.79.227.18:4021 , piece_id=FZRGB3FXNXV6Z7N2GY3VNNPNOLUXOVGFKWSXD3IVWA4I2K5NVJAA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:55.401392292 (47h24m31.440965412s) [noise=true , address=45.91.116.11:4135 , piece_id=FDI5EKC3QVLIZ3NSPIFYH63CAOFYZVYVCQPKI6VBOHYFPEHZLSMA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:52:59.964108673 (47h24m36.003681813s) [noise=true , address=145.79.227.26:4671 , piece_id=KXB3GPHDABQV4POR3DN326TMHD3ONZII3YXWOYCH6NXQQEMK6WWQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232210648 (47h24m38.271783768s) [noise=true , address=45.91.116.8:4067 , piece_id=RKS5OQ42GOG673NBR6IVCQCDEF4BSBCN2CNOQSLPJZMRA2IWPDGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: <nil> Sep 8 12:53:02.232242008 (47h24m38.271815128s) [seg_pos={0 0}, upload=41635]: Segment reached optimal threshold of 14 pieces. Sep 8 12:53:02.232380182 (47h24m38.271953312s) [noise=true , address=145.79.227.32:4860 , piece_id=4YYWES3RVZJW4ZP5K6PE4327TOQKPDTJDSWA2C3V7MDSACJQZ7IA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12XQRaEnpa6KAKuBWL9eRUvPeurEiFaMbjjvDuUkbfq3MT5NWeW): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232447741 (47h24m38.272020871s) [noise=true , address=45.91.116.14:4202 , piece_id=DDAHETED7NB636CPG6J3PCDVCXE7IFUFK53B4FZVD2YTECTBSXSA, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12wXqePK1kK7iBo6wHcbqkRmkED8LGJ3rzQNJAWa14cHYhx1oyB): protocol: expected piece hash; context canceled; EOF Sep 8 12:53:02.232512285 (47h24m38.272085415s) [noise=true , address=45.91.116.9:4278 , piece_id=WBKZK4WBVSARJLHAWHLG225WUYTMMXZZM5HFCNM2G5NQDNEQ5ISQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12htsH8bL33XpUeEstKHb2yeL6TNLusbdRmms9bwzmVCHkej2Xo): protocol: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:36566->45.91.116.9:4278: use of closed network connection Sep 8 12:53:02.232542232 (47h24m38.272115352s) [noise=true , address=145.79.227.45:4234 , piece_id=PXZNRLVPB3SYQFFCOXRA7WFRZWVP3HQ4PXBPZQDWKL33FQFO4TGQ, seg_pos={0 0}, upload=41635]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:12uthP31WaBmn37h54Q6z9ZMtYRY6K8917Ms4kwyyADqu4EXPJy): protocol: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection; piecestore: piecestore close: write tcp 188.166.225.170:48292->145.79.227.45:4234: use of closed network connection Sep 8 12:53:02.232562410 (47h24m38.27213553s) [seg_pos={0 0}, upload=41635]: Done waiting for segment. successful: 14 optimal: 14 errs: <nil> Sep 8 12:53:02.232635761 (47h24m38.272208891s) [upload=41635]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:53:02.232642724 (47h24m38.272215844s) [upload=41635]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:53:03.008884431 (47h24m39.048457561s) [upload=41635]: Done uploading segments... Sep 8 12:53:03.008909649 (47h24m39.048482789s) [upload=41635]: Upload finished. err: <nil> Duration:* 14.763156865s core uplink us-select-1 us1-placement-20
checkers.Gateway{"https://s3.us-select-1.storjapi.io/", AuthURL: "https://auth.us-select-1.storjshare.io/", Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "gateway-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (gateway.us_select_1.remote) antiblip: 1 out of 60 is failed (threshold=3) [.................................................X..........] duration: 6.087203342s FAIL (2025-09-08 12:58:57 UTC) orbiter warning: Post "https://auth.us-select-1.storjshare.io/v1/access": net/http: TLS handshake timeout Duration: 6.087223321s edge gateway us-select-1
checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote) antiblip: 8 out of 60 is failed (threshold=3) [.........X..............X.....X.............X..X..XX.......X] duration: 30.002413449s FAIL (2025-09-08 12:58:52 UTC) orbiter warning: operation: sync2.Copy ======ERROR====== uplink: context deadline exceeded ======LOGS====== Sep 8 12:58:23.524515845 (47h29m59.564088965s) [upload=41724]: Starting upload Sep 8 12:58:23.524579717 (47h29m59.564152837s) [upload=41724]: Done starting upload Sep 8 12:58:23.524687924 (47h29m59.564261114s) [upload=41724]: Uploading segments... Sep 8 12:58:23.524844213 (47h29m59.564417333s) [upload=41724]: Got next segment. Inline: false Sep 8 12:58:23.524877657 (47h29m59.564450777s) [upload=41724]: Flush batch item: pb.BatchRequestItem_ObjectBegin Sep 8 12:58:23.524895441 (47h29m59.564468561s) [upload=41724]: Flush batch item: pb.BatchRequestItem_SegmentBegin Sep 8 12:58:23.809411399 (47h29m59.848984519s) [seg_pos={0 0}, upload=41724]: Begin upload segment... Sep 8 12:58:23.809451727 (47h29m59.849024847s) [seg_pos={0 0}, upload=41724]: Done begin upload segment. Sep 8 12:58:23.809470893 (47h29m59.849044013s) [noise=true , address=45.91.116.7:4009 , piece_id=LIWABT4ZVNFTFJGURN7FRYQHL2UOBMFGL6PCNCIAWM5UJETUAPIA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.809476925 (47h29m59.849050035s) [noise=true , address=77.90.31.14:4663 , piece_id=2DEH6T75MWICVVLNBRMJQCM4INW6NH7BHCTFQJ5YNSOHHRUL7EYA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.809898000 (47h29m59.849471111s) [noise=true , address=45.91.116.9:4262 , piece_id=4O5QLOWKMSMB4DT6P7AXYEJYFN7AAEVBQ5NFQQNU3YJAZPAW4ARA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.809906086 (47h29m59.849479206s) [noise=true , address=45.91.116.14:4189 , piece_id=Y53JPFVZ5XTMTECDEOFOQITLPCCBMFKPWFKOTV5YKJTKL4TAOTXA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810205008 (47h29m59.849778128s) [noise=true , address=45.91.116.8:4047 , piece_id=MQYS7HJF6TGRHTIYVSHXDOSJCWZ6LUA5T4NG334XR4XIANX74XGA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810263540 (47h29m59.84983666s) [noise=true , address=145.79.227.16:4912 , piece_id=4W6SZTNDKYFF3MQUOK72NQAG4O4PINB7KGUT4HT6TR6EESBPGJOQ, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810513619 (47h29m59.850086739s) [noise=true , address=45.91.116.9:4263 , piece_id=KLU7YBMSWODYK46STGQOGALWPP5CSIE3GPI2E4GPGJMHF2ZFHFZA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810614752 (47h29m59.850187872s) [noise=true , address=77.90.31.14:4662 , piece_id=TDXVPRZI3H3PKC4EFQNXGVCXJCDRSTBNLIRYTBZK6HQ6NNYT6W7Q, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810807110 (47h29m59.85038023s) [noise=true , address=77.90.31.12:4592 , piece_id=6VBYEVZ5A35C636R756RAMIVTZKIWCTMQY3EV2SECWBI5EZ4SYXQ, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.810883356 (47h29m59.850456466s) [noise=true , address=77.90.31.16:4735 , piece_id=VXKNEYHEIKZH6BEWOBFDTG7ADV5IZCH5RIHBZ3QIZT4S3OW6HYNA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.811073019 (47h29m59.850646139s) [noise=true , address=77.90.31.17:4771 , piece_id=DRNS6VPHVLBAHV3XXL7TCDUQXGOLGAYOH3NTOZ3YEL46KXBCHAWQ, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.811320322 (47h29m59.850893442s) [noise=true , address=77.90.31.10:4517 , piece_id=JW57FGCENDLLPWCNOHPG2TR5PMARD64EHBHSYZO76ECQJ63CMELA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.811577274 (47h29m59.851150394s) [noise=true , address=77.90.31.21:4877 , piece_id=XHW4LJQM5PNMX7IMHH2IPFN6F7GYKWLPIY2CVO4ZRQXV2E4CKS3A, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.811768991 (47h29m59.851342101s) [noise=true , address=45.91.116.14:4191 , piece_id=EP47P42QIJQPE5TXYHKPPAQP73ZSML63FBY5SPT3A7VXDY3YIOAA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.812181651 (47h29m59.851754761s) [noise=true , address=145.79.227.7:4293 , piece_id=FJ4YAV75LGHP2KHEMAOZ3JD6IBVJVIW7VDXGKBK5IZU7BBNFWDTA, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:23.812383567 (47h29m59.851956687s) [noise=true , address=45.91.116.4:4937 , piece_id=TSGQ2CJYQHUAZRLJM2C3P776AMLQC6Q5I6PXDEJWOXOBQJ7QIGVQ, seg_pos={0 0}, upload=41724]: Uploading piece... Sep 8 12:58:25.652811059 (47h30m1.692384179s) [upload=41724]: Next returned nil segment Sep 8 12:58:25.652828102 (47h30m1.692401242s) [upload=41724]: Waiting for error group managing segments... Sep 8 12:58:25.994321981 (47h30m2.033895101s) [noise=true , address=45.91.116.9:4263 , piece_id=KLU7YBMSWODYK46STGQOGALWPP5CSIE3GPI2E4GPGJMHF2ZFHFZA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.015028906 (47h30m2.054602026s) [noise=true , address=77.90.31.12:4592 , piece_id=6VBYEVZ5A35C636R756RAMIVTZKIWCTMQY3EV2SECWBI5EZ4SYXQ, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.017396505 (47h30m2.056969626s) [noise=true , address=77.90.31.14:4663 , piece_id=2DEH6T75MWICVVLNBRMJQCM4INW6NH7BHCTFQJ5YNSOHHRUL7EYA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.024482014 (47h30m2.064055135s) [noise=true , address=145.79.227.16:4912 , piece_id=4W6SZTNDKYFF3MQUOK72NQAG4O4PINB7KGUT4HT6TR6EESBPGJOQ, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.049167051 (47h30m2.088740171s) [noise=true , address=45.91.116.4:4937 , piece_id=TSGQ2CJYQHUAZRLJM2C3P776AMLQC6Q5I6PXDEJWOXOBQJ7QIGVQ, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.074326225 (47h30m2.113899345s) [noise=true , address=45.91.116.8:4047 , piece_id=MQYS7HJF6TGRHTIYVSHXDOSJCWZ6LUA5T4NG334XR4XIANX74XGA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.082953774 (47h30m2.122526894s) [noise=true , address=45.91.116.7:4009 , piece_id=LIWABT4ZVNFTFJGURN7FRYQHL2UOBMFGL6PCNCIAWM5UJETUAPIA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.090187216 (47h30m2.129760336s) [noise=true , address=45.91.116.9:4262 , piece_id=4O5QLOWKMSMB4DT6P7AXYEJYFN7AAEVBQ5NFQQNU3YJAZPAW4ARA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.092439706 (47h30m2.132012826s) [noise=true , address=145.79.227.7:4293 , piece_id=FJ4YAV75LGHP2KHEMAOZ3JD6IBVJVIW7VDXGKBK5IZU7BBNFWDTA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.093601158 (47h30m2.133174278s) [noise=true , address=77.90.31.14:4662 , piece_id=TDXVPRZI3H3PKC4EFQNXGVCXJCDRSTBNLIRYTBZK6HQ6NNYT6W7Q, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.115577672 (47h30m2.155150782s) [noise=true , address=77.90.31.21:4877 , piece_id=XHW4LJQM5PNMX7IMHH2IPFN6F7GYKWLPIY2CVO4ZRQXV2E4CKS3A, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.135872617 (47h30m2.175445737s) [noise=true , address=77.90.31.17:4771 , piece_id=DRNS6VPHVLBAHV3XXL7TCDUQXGOLGAYOH3NTOZ3YEL46KXBCHAWQ, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.151798182 (47h30m2.191371302s) [noise=true , address=77.90.31.10:4517 , piece_id=JW57FGCENDLLPWCNOHPG2TR5PMARD64EHBHSYZO76ECQJ63CMELA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: <nil> Sep 8 12:58:26.151817569 (47h30m2.191390679s) [seg_pos={0 0}, upload=41724]: Segment reached optimal threshold of 13 pieces. Sep 8 12:58:26.151927329 (47h30m2.191500449s) [noise=true , address=45.91.116.14:4191 , piece_id=EP47P42QIJQPE5TXYHKPPAQP73ZSML63FBY5SPT3A7VXDY3YIOAA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1FuLM1f14cPdZhV3wWmYD746WFCn1jMHjHyaK7s7fSomud39Zq): protocol: expected piece hash; context canceled; EOF Sep 8 12:58:26.151995800 (47h30m2.19156892s) [noise=true , address=45.91.116.14:4189 , piece_id=Y53JPFVZ5XTMTECDEOFOQITLPCCBMFKPWFKOTV5YKJTKL4TAOTXA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:1JPMPojBpksikw8rtjnpFkz6WrRXWKqTJb1XE6eJpAAVnXtP6N): protocol: expected piece hash; context canceled; EOF Sep 8 12:58:26.152125829 (47h30m2.191698949s) [noise=true , address=77.90.31.16:4735 , piece_id=VXKNEYHEIKZH6BEWOBFDTG7ADV5IZCH5RIHBZ3QIZT4S3OW6HYNA, seg_pos={0 0}, upload=41724]: Done uploading piece. err: context canceled; ecclient: upload cut due to slow connection (node:14LxqUFh6udxGJH9qJV6d1tdGgxyzv3qiZYENLtXffBCpLeG9h): protocol: expected piece hash; context canceled; EOF Sep 8 12:58:26.152185463 (47h30m2.191758613s) [seg_pos={0 0}, upload=41724]: Done waiting for segment. successful: 13 optimal: 13 errs: <nil> Sep 8 12:58:26.152295744 (47h30m2.191868864s) [upload=41724]: Flush batch item: pb.BatchRequestItem_SegmentCommit Sep 8 12:58:26.152300793 (47h30m2.191873914s) [upload=41724]: Flush batch item: pb.BatchRequestItem_ObjectCommit Sep 8 12:58:26.563915584 (47h30m2.603488704s) [upload=41724]: Done uploading segments... Sep 8 12:58:26.563935643 (47h30m2.603508763s) [upload=41724]: Upload finished. err: <nil> Duration: 30.002438857s core uplink us-select-1

Orbiter Check History

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/1K", Size: 1.0 KiB} failure (antiblip window 3/60): (uplink.us_select_1.inline)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.remote)

checkers.Uplink{Satellite: "12L9ZFwhzVpuEKMUNUqkaTLGzwY9G24tbiigLiXpmZWKwmcNDDs@eu1.storj.io:7777", Bucket: "uptime-checks-placement-15", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.eu1.placement_15)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-placement-20", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us1.placement_20.remote)

checkers.Uplink{Satellite: "12EayRS2V1kEsWESU9QMRseFhdxYxKicsiFmxrsLZHeLUtdps3S@us1.storj.io:7777", Bucket: "uptime-checks-us-select", Key: "uplink-tests/from_do_prod_ops_orbiter_ap_0/4M", Size: 4.0 MiB} failure (antiblip window 3/60): (uplink.us_select_1.remote)