msys woes

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
19 messages Options
Reply | Threaded
Open this post in threaded view
|

msys woes

Shayne Fletcher
For the last 5 days, the `./configure --enable-tarballs-autodownload` GHC build step on Windows has been failing because repo.msys2.org has been unavailable (https://github.com/msys2/MSYS2-packages/issues/2171). Apparently that's fixed today and the server can now be reached but still the configure fails now with 'curl: (22) The requested URL returned error: 404 Not Found' 😢 It would be great if someone with an understanding of what precisely `--enable-tarballs-autodownload` translates to was to file a bug-report with the right folks!

--
Shayne Fletcher

_______________________________________________
ghc-devs mailing list
[hidden email]
http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs
Reply | Threaded
Open this post in threaded view
|

Re: msys woes

lonetiger
> `./configure --enable-tarballs-autodownload` GHC build step on Windows has been failing because repo.msys2.org  

Afaik GHC doesn't rely ok repo.msys2.org for builds, only for mirroring. The primary url is haskell.org https://downloads.haskell.org/ghc/mingw/ 

So it's down time shouldn't have affected you (and works for me). 

Which url does it say is inaccessible? 

Sent from my Mobile

On Thu, Oct 8, 2020, 13:50 Shayne Fletcher <[hidden email]> wrote:
For the last 5 days, the `./configure --enable-tarballs-autodownload` GHC build step on Windows has been failing because repo.msys2.org has been unavailable (https://github.com/msys2/MSYS2-packages/issues/2171). Apparently that's fixed today and the server can now be reached but still the configure fails now with 'curl: (22) The requested URL returned error: 404 Not Found' 😢 It would be great if someone with an understanding of what precisely `--enable-tarballs-autodownload` translates to was to file a bug-report with the right folks!

--
Shayne Fletcher
_______________________________________________
ghc-devs mailing list
[hidden email]
http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs

_______________________________________________
ghc-devs mailing list
[hidden email]
http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs
Reply | Threaded
Open this post in threaded view
|

Re: msys woes

Shayne Fletcher

Hi Phyx,

On Thu, Oct 8, 2020 at 9:10 AM Phyx <[hidden email]> wrote:
> `./configure --enable-tarballs-autodownload` GHC build step on Windows has been failing because repo.msys2.org  

Afaik GHC doesn't rely ok repo.msys2.org for builds, only for mirroring. The primary url is haskell.org https://downloads.haskell.org/ghc/mingw/ 

So it's down time shouldn't have affected you (and works for me). 


I should have mentioned... as always the situation is more complicated 😉
  - This is in the context of ghc-lib CI;
  - I don't have direct access to a windows box;

A procedure to reproduce it would be,
```
cd ghc
git fetch --tags && git checkout ghc-8.8.1-release
git submodule update --init --recursive
stack --stack-yaml hadrian/stack.yaml exec -- bash -c "./configure --enable-tarballs-autodownload"
```
Looking into the hadrian/stack/yaml on that tag, that's an 8.4.3 resolver in case that's relevant.
 
Which url does it say is inaccessible? 

Sadly, doesn't say
```
2020-10-08T14:41:46.4566084Z configure: loading site script /usr/local/etc/config.site
2020-10-08T14:41:46.5682736Z checking for gfind... no
2020-10-08T14:41:46.5700226Z checking for find... /usr/bin/find
2020-10-08T14:41:46.6978096Z checking for sort... /usr/bin/sort
2020-10-08T14:41:46.9667887Z checking for GHC Git commit id... inferred 9c787d4d24f2b515934c8503ee2bbd7cfac4da20
2020-10-08T14:41:47.5669999Z checking for ghc... /c/Users/VssAdministrator/AppData/Local/Programs/stack/x86_64-windows/ghc-8.4.3/bin/ghc
2020-10-08T14:41:48.0265433Z checking version of ghc... 8.4.3
2020-10-08T14:41:49.2214006Z GHC path canonicalised to: c:/Users/VssAdministrator/AppData/Local/Programs/stack/x86_64-windows/ghc-8.4.3/bin/ghc
2020-10-08T14:41:49.8138282Z checking build system type... x86_64-w64-mingw32
2020-10-08T14:41:49.8152277Z checking host system type... x86_64-w64-mingw32
2020-10-08T14:41:49.8172851Z checking target system type... x86_64-w64-mingw32
2020-10-08T14:41:49.8197624Z Host platform inferred as: x86_64-unknown-mingw32
2020-10-08T14:41:50.1249990Z Target platform inferred as: x86_64-unknown-mingw32
2020-10-08T14:41:51.4787854Z GHC build  : x86_64-unknown-mingw32
2020-10-08T14:41:51.4788960Z GHC host   : x86_64-unknown-mingw32
2020-10-08T14:41:51.4790058Z GHC target : x86_64-unknown-mingw32
2020-10-08T14:41:51.4791914Z LLVM target: x86_64-unknown-windows
2020-10-08T14:41:51.6809080Z checking for path to top of build tree... D:/a/1/s/ghc
2020-10-08T14:41:51.7094005Z configure: Checking for Windows toolchain tarballs...
2020-10-08T14:41:53.0985704Z #=#=#                                                                         
2020-10-08T14:41:53.0986841Z 
2020-10-08T14:41:53.1745226Z ###################                                                       26.4%
2020-10-08T14:41:53.1762650Z ######################################################################## 100.0%
2020-10-08T14:41:53.4899178Z #=#=#                                                                         
2020-10-08T14:41:53.5914142Z ##O#- #                                                                       
2020-10-08T14:41:53.6973216Z ##O=#  #                                                                      
2020-10-08T14:41:53.7049675Z #=#=-#  #                                                                     
2020-10-08T14:41:53.7051106Z curl: (22) The requested URL returned error: 404 Not Found
2020-10-08T14:41:53.7596464Z 
2020-10-08T14:41:53.7600456Z ERROR: Download failed.
2020-10-08T14:41:53.7614446Z  
2020-10-08T14:41:53.7615639Z Error fetching msys2 tarballs; see errors above. ```

--
Shayne Fletcher

_______________________________________________
ghc-devs mailing list
[hidden email]
http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs
Reply | Threaded
Open this post in threaded view
|

Re: msys woes

Shayne Fletcher


On Thu, Oct 8, 2020 at 10:51 AM Shayne Fletcher <[hidden email]> wrote:

Hi Phyx,

On Thu, Oct 8, 2020 at 9:10 AM Phyx <[hidden email]> wrote:
> `./configure --enable-tarballs-autodownload` GHC build step on Windows has been failing because repo.msys2.org  

Afaik GHC doesn't rely ok repo.msys2.org for builds, only for mirroring. The primary url is haskell.org https://downloads.haskell.org/ghc/mingw/ 

So it's down time shouldn't have affected you (and works for me). 


[...]

A procedure to reproduce it would be,
```
cd ghc
git fetch --tags && git checkout ghc-8.8.1-release
git submodule update --init --recursive
stack --stack-yaml hadrian/stack.yaml exec -- bash -c "./configure --enable-tarballs-autodownload"
```

Oops, obviously, there should be a boot in there first.
```
cd ghc
git fetch --tags && git checkout ghc-8.8.1-release
git submodule update --init --recursive
stack --stack-yaml hadrian/stack.yaml exec -- bash -c ./boot
stack --stack-yaml hadrian/stack.yaml exec -- bash -c "./configure --enable-tarballs-autodownload"
```

--
Shayne Fletcher

_______________________________________________
ghc-devs mailing list
[hidden email]
http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs
Reply | Threaded
Open this post in threaded view
|

Re: msys woes

Sylvain Henry-2
In reply to this post by Shayne Fletcher

Could you share the contents of "missing-win32-tarballs" log file?

Thanks,
Sylvain

On 08/10/2020 16:51, Shayne Fletcher wrote:

Hi Phyx,

On Thu, Oct 8, 2020 at 9:10 AM Phyx <[hidden email]> wrote:
> `./configure --enable-tarballs-autodownload` GHC build step on Windows has been failing because repo.msys2.org  

Afaik GHC doesn't rely ok repo.msys2.org for builds, only for mirroring. The primary url is haskell.org https://downloads.haskell.org/ghc/mingw/ 

So it's down time shouldn't have affected you (and works for me). 


I should have mentioned... as always the situation is more complicated 😉
  - This is in the context of ghc-lib CI;
  - I don't have direct access to a windows box;

A procedure to reproduce it would be,
```
cd ghc
git fetch --tags && git checkout ghc-8.8.1-release
git submodule update --init --recursive
stack --stack-yaml hadrian/stack.yaml exec -- bash -c "./configure --enable-tarballs-autodownload"
```
Looking into the hadrian/stack/yaml on that tag, that's an 8.4.3 resolver in case that's relevant.
 
Which url does it say is inaccessible? 

Sadly, doesn't say
```
2020-10-08T14:41:46.4566084Z configure: loading site script /usr/local/etc/config.site
2020-10-08T14:41:46.5682736Z checking for gfind... no
2020-10-08T14:41:46.5700226Z checking for find... /usr/bin/find
2020-10-08T14:41:46.6978096Z checking for sort... /usr/bin/sort
2020-10-08T14:41:46.9667887Z checking for GHC Git commit id... inferred 9c787d4d24f2b515934c8503ee2bbd7cfac4da20
2020-10-08T14:41:47.5669999Z checking for ghc... /c/Users/VssAdministrator/AppData/Local/Programs/stack/x86_64-windows/ghc-8.4.3/bin/ghc
2020-10-08T14:41:48.0265433Z checking version of ghc... 8.4.3
2020-10-08T14:41:49.2214006Z GHC path canonicalised to: c:/Users/VssAdministrator/AppData/Local/Programs/stack/x86_64-windows/ghc-8.4.3/bin/ghc
2020-10-08T14:41:49.8138282Z checking build system type... x86_64-w64-mingw32
2020-10-08T14:41:49.8152277Z checking host system type... x86_64-w64-mingw32
2020-10-08T14:41:49.8172851Z checking target system type... x86_64-w64-mingw32
2020-10-08T14:41:49.8197624Z Host platform inferred as: x86_64-unknown-mingw32
2020-10-08T14:41:50.1249990Z Target platform inferred as: x86_64-unknown-mingw32
2020-10-08T14:41:51.4787854Z GHC build  : x86_64-unknown-mingw32
2020-10-08T14:41:51.4788960Z GHC host   : x86_64-unknown-mingw32
2020-10-08T14:41:51.4790058Z GHC target : x86_64-unknown-mingw32
2020-10-08T14:41:51.4791914Z LLVM target: x86_64-unknown-windows
2020-10-08T14:41:51.6809080Z checking for path to top of build tree... D:/a/1/s/ghc
2020-10-08T14:41:51.7094005Z configure: Checking for Windows toolchain tarballs...
2020-10-08T14:41:53.0985704Z #=#=#                                                                         
2020-10-08T14:41:53.0986841Z 
2020-10-08T14:41:53.1745226Z ###################                                                       26.4%
2020-10-08T14:41:53.1762650Z ######################################################################## 100.0%
2020-10-08T14:41:53.4899178Z #=#=#                                                                         
2020-10-08T14:41:53.5914142Z ##O#- #                                                                       
2020-10-08T14:41:53.6973216Z ##O=#  #                                                                      
2020-10-08T14:41:53.7049675Z #=#=-#  #                                                                     
2020-10-08T14:41:53.7051106Z curl: (22) The requested URL returned error: 404 Not Found
2020-10-08T14:41:53.7596464Z 
2020-10-08T14:41:53.7600456Z ERROR: Download failed.
2020-10-08T14:41:53.7614446Z  
2020-10-08T14:41:53.7615639Z Error fetching msys2 tarballs; see errors above. ```

--
Shayne Fletcher

_______________________________________________
ghc-devs mailing list
[hidden email]
http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs

_______________________________________________
ghc-devs mailing list
[hidden email]
http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs
Reply | Threaded
Open this post in threaded view
|

Re: msys woes

Shayne Fletcher


On Thu, Oct 8, 2020 at 11:18 AM Sylvain Henry <[hidden email]> wrote:

Could you share the contents of "missing-win32-tarballs" log file?


Where exactly does that file reside? In any case I think the answer is likely no Sylvain as it will be on an inaccessible Azure host.

--
Shayne Fletcher

_______________________________________________
ghc-devs mailing list
[hidden email]
http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs
Reply | Threaded
Open this post in threaded view
|

Re: msys woes

lonetiger
In reply to this post by Shayne Fletcher
Hi Shayne, 

8.8.1 had a different mechanism but the primary is still haskell.org.

You don't need to run the entire pipeline to test this. Just run

./mk/get-win32-tarballs.sh download x86_64

This should echo to stdout more information. 

Kind regards, 
Tamar 

Sent from my Mobile

On Thu, Oct 8, 2020, 15:54 Shayne Fletcher <[hidden email]> wrote:


On Thu, Oct 8, 2020 at 10:51 AM Shayne Fletcher <[hidden email]> wrote:

Hi Phyx,

On Thu, Oct 8, 2020 at 9:10 AM Phyx <[hidden email]> wrote:
> `./configure --enable-tarballs-autodownload` GHC build step on Windows has been failing because repo.msys2.org  

Afaik GHC doesn't rely ok repo.msys2.org for builds, only for mirroring. The primary url is haskell.org https://downloads.haskell.org/ghc/mingw/ 

So it's down time shouldn't have affected you (and works for me). 


[...]

A procedure to reproduce it would be,
```
cd ghc
git fetch --tags && git checkout ghc-8.8.1-release
git submodule update --init --recursive
stack --stack-yaml hadrian/stack.yaml exec -- bash -c "./configure --enable-tarballs-autodownload"
```

Oops, obviously, there should be a boot in there first.
```
cd ghc
git fetch --tags && git checkout ghc-8.8.1-release
git submodule update --init --recursive
stack --stack-yaml hadrian/stack.yaml exec -- bash -c ./boot
stack --stack-yaml hadrian/stack.yaml exec -- bash -c "./configure --enable-tarballs-autodownload"
```

--
Shayne Fletcher

_______________________________________________
ghc-devs mailing list
[hidden email]
http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs
Reply | Threaded
Open this post in threaded view
|

Re: msys woes

Shayne Fletcher


On Thu, Oct 8, 2020 at 12:13 PM Phyx <[hidden email]> wrote:
Hi Shayne, 

8.8.1 had a different mechanism but the primary is still haskell.org.


I think we are looking at ghc-8.4.3 here (being used on 8.8.1 sources).
 
You don't need to run the entire pipeline to test this. Just run

./mk/get-win32-tarballs.sh download x86_64


I've thrown that into the build script. Stand-by. Let's see what we get.

--
Shayne Fletcher

_______________________________________________
ghc-devs mailing list
[hidden email]
http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs
Reply | Threaded
Open this post in threaded view
|

Re: msys woes

Shayne Fletcher


On Thu, Oct 8, 2020 at 12:19 PM Shayne Fletcher <[hidden email]> wrote:


On Thu, Oct 8, 2020 at 12:13 PM Phyx <[hidden email]> wrote:
Hi Shayne, 

8.8.1 had a different mechanism but the primary is still haskell.org.


I think we are looking at ghc-8.4.3 here (being used on 8.8.1 sources).
 
You don't need to run the entire pipeline to test this. Just run

./mk/get-win32-tarballs.sh download x86_64


I've thrown that into the build script. Stand-by. Let's see what we get.


Here we go!

```
2020-10-08T16:35:14.8128041Z Downloading mingw-w64-x86_64-crt-git-5.0.0.4795.e3d96cb1-1-any.pkg.tar.xz to ghc-tarballs/mingw-w64/x86_64...
2020-10-08T16:35:15.3839177Z #=#=#                                                                         
2020-10-08T16:35:15.3841316Z 
2020-10-08T16:35:15.4836014Z ################                                                          22.6%
2020-10-08T16:35:15.4918420Z ##################################################################        92.9%
2020-10-08T16:35:15.4921362Z ######################################################################## 100.0%
2020-10-08T16:35:15.7741545Z #=#=#                                                                         
2020-10-08T16:35:15.8742272Z ##O#- #                                                                       
2020-10-08T16:35:15.9760569Z ##O=#  #                                                                      
2020-10-08T16:35:16.9768720Z #=#=-#  #                                                                     
2020-10-08T16:35:17.4160288Z -#O#- #   #                                                                   
2020-10-08T16:35:17.4162806Z -=#=#   #   #                                                                 
2020-10-08T16:35:17.4164112Z curl: (22) The requested URL returned error: 404 Not Found
2020-10-08T16:35:17.4407190Z 
2020-10-08T16:35:17.4425090Z ERROR: Download failed.
2020-10-08T16:35:17.4564686Z ghc-lib-gen.EXE: Failed when running system command: stack --stack-yaml hadrian/stack.yaml exec -- bash -c "./mk/get-win32-tarballs.sh download x86_64"
```
Hope this helps!
--
Shayne Fletcher

_______________________________________________
ghc-devs mailing list
[hidden email]
http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs
Reply | Threaded
Open this post in threaded view
|

Re: msys woes

lonetiger
Right, 

I think seems to be a bug in the script that wasn't noticed before. 

On line 40 there are () missing around the condition. So it's checking both URLs i think. 

The download to Haskell.org succeeds but the msys2 one fails since that package is gone. 

The whole thing after the || needs to be in (). 

This would need to be fixed in that branch but the tag won't move. 

Any ideas here Ben? 

Sent from my Mobile

On Thu, Oct 8, 2020, 17:42 Shayne Fletcher <[hidden email]> wrote:


On Thu, Oct 8, 2020 at 12:19 PM Shayne Fletcher <[hidden email]> wrote:


On Thu, Oct 8, 2020 at 12:13 PM Phyx <[hidden email]> wrote:
Hi Shayne, 

8.8.1 had a different mechanism but the primary is still haskell.org.


I think we are looking at ghc-8.4.3 here (being used on 8.8.1 sources).
 
You don't need to run the entire pipeline to test this. Just run

./mk/get-win32-tarballs.sh download x86_64


I've thrown that into the build script. Stand-by. Let's see what we get.


Here we go!

```
2020-10-08T16:35:14.8128041Z Downloading mingw-w64-x86_64-crt-git-5.0.0.4795.e3d96cb1-1-any.pkg.tar.xz to ghc-tarballs/mingw-w64/x86_64...
2020-10-08T16:35:15.3839177Z #=#=#                                                                         
2020-10-08T16:35:15.3841316Z 
2020-10-08T16:35:15.4836014Z ################                                                          22.6%
2020-10-08T16:35:15.4918420Z ##################################################################        92.9%
2020-10-08T16:35:15.4921362Z ######################################################################## 100.0%
2020-10-08T16:35:15.7741545Z #=#=#                                                                         
2020-10-08T16:35:15.8742272Z ##O#- #                                                                       
2020-10-08T16:35:15.9760569Z ##O=#  #                                                                      
2020-10-08T16:35:16.9768720Z #=#=-#  #                                                                     
2020-10-08T16:35:17.4160288Z -#O#- #   #                                                                   
2020-10-08T16:35:17.4162806Z -=#=#   #   #                                                                 
2020-10-08T16:35:17.4164112Z curl: (22) The requested URL returned error: 404 Not Found
2020-10-08T16:35:17.4407190Z 
2020-10-08T16:35:17.4425090Z ERROR: Download failed.
2020-10-08T16:35:17.4564686Z ghc-lib-gen.EXE: Failed when running system command: stack --stack-yaml hadrian/stack.yaml exec -- bash -c "./mk/get-win32-tarballs.sh download x86_64"
```
Hope this helps!
--
Shayne Fletcher

_______________________________________________
ghc-devs mailing list
[hidden email]
http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs
Reply | Threaded
Open this post in threaded view
|

Re: msys woes

lonetiger
From the looks of it the repo.msys2.org system doesn't have enough space to restore all these old packages. 

So we'll have to handle it on our end. The easiest way to get your builds working again is by applying a patch with the fix to the source tree. 

Sent from my Mobile

On Thu, Oct 8, 2020, 17:55 Phyx <[hidden email]> wrote:
Right, 

I think seems to be a bug in the script that wasn't noticed before. 

On line 40 there are () missing around the condition. So it's checking both URLs i think. 

The download to Haskell.org succeeds but the msys2 one fails since that package is gone. 

The whole thing after the || needs to be in (). 

This would need to be fixed in that branch but the tag won't move. 

Any ideas here Ben? 

Sent from my Mobile

On Thu, Oct 8, 2020, 17:42 Shayne Fletcher <[hidden email]> wrote:


On Thu, Oct 8, 2020 at 12:19 PM Shayne Fletcher <[hidden email]> wrote:


On Thu, Oct 8, 2020 at 12:13 PM Phyx <[hidden email]> wrote:
Hi Shayne, 

8.8.1 had a different mechanism but the primary is still haskell.org.


I think we are looking at ghc-8.4.3 here (being used on 8.8.1 sources).
 
You don't need to run the entire pipeline to test this. Just run

./mk/get-win32-tarballs.sh download x86_64


I've thrown that into the build script. Stand-by. Let's see what we get.


Here we go!

```
2020-10-08T16:35:14.8128041Z Downloading mingw-w64-x86_64-crt-git-5.0.0.4795.e3d96cb1-1-any.pkg.tar.xz to ghc-tarballs/mingw-w64/x86_64...
2020-10-08T16:35:15.3839177Z #=#=#                                                                         
2020-10-08T16:35:15.3841316Z 
2020-10-08T16:35:15.4836014Z ################                                                          22.6%
2020-10-08T16:35:15.4918420Z ##################################################################        92.9%
2020-10-08T16:35:15.4921362Z ######################################################################## 100.0%
2020-10-08T16:35:15.7741545Z #=#=#                                                                         
2020-10-08T16:35:15.8742272Z ##O#- #                                                                       
2020-10-08T16:35:15.9760569Z ##O=#  #                                                                      
2020-10-08T16:35:16.9768720Z #=#=-#  #                                                                     
2020-10-08T16:35:17.4160288Z -#O#- #   #                                                                   
2020-10-08T16:35:17.4162806Z -=#=#   #   #                                                                 
2020-10-08T16:35:17.4164112Z curl: (22) The requested URL returned error: 404 Not Found
2020-10-08T16:35:17.4407190Z 
2020-10-08T16:35:17.4425090Z ERROR: Download failed.
2020-10-08T16:35:17.4564686Z ghc-lib-gen.EXE: Failed when running system command: stack --stack-yaml hadrian/stack.yaml exec -- bash -c "./mk/get-win32-tarballs.sh download x86_64"
```
Hope this helps!
--
Shayne Fletcher

_______________________________________________
ghc-devs mailing list
[hidden email]
http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs
Reply | Threaded
Open this post in threaded view
|

Re: msys woes

Shayne Fletcher


On Thu, Oct 8, 2020 at 1:18 PM Phyx <[hidden email]> wrote:
From the looks of it the repo.msys2.org system doesn't have enough space to restore all these old packages. 

So we'll have to handle it on our end. The easiest way to get your builds working again is by applying a patch with the fix to the source tree. 


Nice one Phyx. I confirm that applying that patch at my end gets me back in the game.

--
Shayne Fletcher

_______________________________________________
ghc-devs mailing list
[hidden email]
http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs
Reply | Threaded
Open this post in threaded view
|

Re: msys woes

Ben Gamari-3
In reply to this post by lonetiger
Phyx <[hidden email]> writes:

> Right,
>
> I think seems to be a bug in the script that wasn't noticed before.
>
> On line 40 there are () missing around the condition. So it's checking both
> URLs i think.
>
> The download to Haskell.org succeeds but the msys2 one fails since that
> package is gone.
>
> The whole thing after the || needs to be in ().
>
> This would need to be fixed in that branch but the tag won't move.
>
> Any ideas here Ben?
>
I'm not sure what you mean by "the tag won't move". Could you clarify?

Regardless, I do see that some parens are needed here. I have opened
#18821 to track this.

For what it's worth, the download script was revamped in GHC 8.10 so I
don't think there is anything needed on master or ghc-8.10.

Cheers,

- Ben

_______________________________________________
ghc-devs mailing list
[hidden email]
http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs

signature.asc (497 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: msys woes

lonetiger
> I'm not sure what you mean by "the tag won't move". Could you clarify? 

I mean that the tag called 8.8.4-release will still point to the a broken hash no? Since it represents the hash of the commit the release was made from. 

Sent from my Mobile

On Thu, Oct 8, 2020, 21:28 Ben Gamari <[hidden email]> wrote:
Phyx <[hidden email]> writes:

> Right,
>
> I think seems to be a bug in the script that wasn't noticed before.
>
> On line 40 there are () missing around the condition. So it's checking both
> URLs i think.
>
> The download to Haskell.org succeeds but the msys2 one fails since that
> package is gone.
>
> The whole thing after the || needs to be in ().
>
> This would need to be fixed in that branch but the tag won't move.
>
> Any ideas here Ben?
>
I'm not sure what you mean by "the tag won't move". Could you clarify?

Regardless, I do see that some parens are needed here. I have opened
#18821 to track this.

For what it's worth, the download script was revamped in GHC 8.10 so I
don't think there is anything needed on master or ghc-8.10.

Cheers,

- Ben

_______________________________________________
ghc-devs mailing list
[hidden email]
http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs
Reply | Threaded
Open this post in threaded view
|

Re: msys woes

Shayne Fletcher
In reply to this post by Ben Gamari-3


On Thu, Oct 8, 2020 at 4:28 PM Ben Gamari <[hidden email]> wrote:
Phyx <[hidden email]> writes:

> Right,
>
> I think seems to be a bug in the script that wasn't noticed before.
>
> On line 40 there are () missing around the condition. So it's checking both
> URLs i think.
>
> The download to Haskell.org succeeds but the msys2 one fails since that
> package is gone.
>
> The whole thing after the || needs to be in ().
>
> This would need to be fixed in that branch but the tag won't move.
>
> Any ideas here Ben?
>
I'm not sure what you mean by "the tag won't move". Could you clarify?

Regardless, I do see that some parens are needed here. I have opened
#18821 to track this.

For what it's worth, the download script was revamped in GHC 8.10 so I
don't think there is anything needed on master or ghc-8.10.


I confirm that the specific script 'mk/get-win32-tarballs.sh' is not present in 8.10. There is a get-win32-tarballs.py there. Looks like the last version with the .sh was 8.8.4
 
Cheers,

- Ben


--
Shayne Fletcher

_______________________________________________
ghc-devs mailing list
[hidden email]
http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs
Reply | Threaded
Open this post in threaded view
|

Re: msys woes

Ben Gamari-3
In reply to this post by lonetiger
Phyx <[hidden email]> writes:

>> I'm not sure what you mean by "the tag won't move". Could you clarify?
>
> I mean that the tag called 8.8.4-release will still point to the a broken
> hash no? Since it represents the hash of the commit the release was made
> from.
>
Ahh, yes. 8.8.4-release will not change. In general we do not change
tags after their corresponding release has been announced.

Cheers,

- Ben

_______________________________________________
ghc-devs mailing list
[hidden email]
http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs

signature.asc (497 bytes) Download Attachment
Reply | Threaded
Open this post in threaded view
|

Re: msys woes

Shayne Fletcher
In reply to this post by lonetiger

On Thu, Oct 8, 2020 at 1:18 PM Phyx <[hidden email]> wrote:
From the looks of it the repo.msys2.org system doesn't have enough space to restore all these old packages. 

So we'll have to handle it on our end. The easiest way to get your builds working again is by applying a patch with the fix to the source tree. 


New problems in this space as of today. This time with 
```bash
stack --stack-yaml stack.yaml --resolver nightly-2020-01-08   exec -- pacman -S autoconf automake-wrapper make patch python tar mintty --noconfirm
```

which produces 404 errors
```
2020-11-01T16:02:47.2564782Z :: Retrieving packages...
2020-11-01T16:02:49.0237771Z error: failed retrieving file 'diffutils-3.6-1-x86_64.pkg.tar.xz' from repo.msys2.org : The requested URL returned error: 404
2020-11-01T16:02:49.3752086Z error: failed retrieving file 'diffutils-3.6-1-x86_64.pkg.tar.xz' from downloads.sourceforge.net : The requested URL returned error: 404
2020-11-01T16:02:49.8476086Z error: failed retrieving file 'diffutils-3.6-1-x86_64.pkg.tar.xz' from www2.futureware.at : The requested URL returned error: 404
2020-11-01T16:02:49.8482030Z warning: failed to retrieve some files
2020-11-01T16:02:51.2288388Z error: failed retrieving file 'autoconf-2.69-3-any.pkg.tar.xz' from repo.msys2.org : The requested URL returned error: 404
2020-11-01T16:02:51.3674499Z error: failed retrieving file 'autoconf-2.69-3-any.pkg.tar.xz' from downloads.sourceforge.net : The requested URL returned error: 404
2020-11-01T16:02:51.4787091Z error: failed retrieving file 'autoconf-2.69-3-any.pkg.tar.xz' from www2.futureware.at : The requested URL returned error: 404
2020-11-01T16:02:51.4791763Z warning: failed to retrieve some files
...
``` 
I've raised https://github.com/msys2/MSYS2-packages/issues/2225 with msys2.
--
Shayne Fletcher

_______________________________________________
ghc-devs mailing list
[hidden email]
http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs
Reply | Threaded
Open this post in threaded view
|

Re: msys woes

Shayne Fletcher


On Sun, Nov 1, 2020 at 12:44 PM Ben Gamari <[hidden email]> wrote:
Shayne Fletcher <[hidden email]> writes:

> On Thu, Oct 8, 2020 at 1:18 PM Phyx <[hidden email]> wrote:
>
>> From the looks of it the repo.msys2.org system doesn't have enough space
>> to restore all these old packages.
>>
>> So we'll have to handle it on our end. The easiest way to get your builds
>> working again is by applying a patch with the fix to the source tree.
>>
>>
> New problems in this space as of today. This time with
> ```bash
>
> stack --stack-yaml stack.yaml --resolver nightly-2020-01-08   exec --
> pacman -S autoconf automake-wrapper make patch python tar mintty
> --noconfirm
> ```
>
> which produces 404 errors

Oh dear; thank you for raising this with upstream, Shayne! Let's hope
there is action soon.


After looking into it a bit, I'm beginning to think that it is in fact on us (stack as it happens) to upgrade our msys installer. I have a workaround for now:
stack exec --  pacman -U msys2-keyring-r21.b39fb11-1-any.pkg.tar.xz --noconfirm
stack exec -- pacman -Syu autoconf automake-wrapper make patch python tar mintty --noconfirm"
```

--
Shayne Fletcher

_______________________________________________
ghc-devs mailing list
[hidden email]
http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs
Reply | Threaded
Open this post in threaded view
|

Re: msys woes

Shayne Fletcher


On Tue, Nov 3, 2020 at 8:18 PM Shayne Fletcher <[hidden email]> wrote:


On Sun, Nov 1, 2020 at 12:44 PM Ben Gamari <[hidden email]> wrote:
Shayne Fletcher <[hidden email]> writes:

> On Thu, Oct 8, 2020 at 1:18 PM Phyx <[hidden email]> wrote:
>
>> From the looks of it the repo.msys2.org system doesn't have enough space
>> to restore all these old packages.
>>
>> So we'll have to handle it on our end. The easiest way to get your builds
>> working again is by applying a patch with the fix to the source tree.
>>
>>
> New problems in this space as of today. This time with
> ```bash
>
> stack --stack-yaml stack.yaml --resolver nightly-2020-01-08   exec --
> pacman -S autoconf automake-wrapper make patch python tar mintty
> --noconfirm
> ```
>
> which produces 404 errors

Oh dear; thank you for raising this with upstream, Shayne! Let's hope
there is action soon.



An updated stack has been pushed. Thanks to this the issue is resolved!

--
Shayne Fletcher

_______________________________________________
ghc-devs mailing list
[hidden email]
http://mail.haskell.org/cgi-bin/mailman/listinfo/ghc-devs