win-64 firefox also vends some shared paths with qt

[bollwyvl]

Issue:

follow-on to #1

It appears the windows build (and maybe others?) of firefox and qt both vend parts of mesa:

from inside a (pretty heavy) constructor build:

Error: File 'Library/bin/libEGL.dll' found in multiple packages: qt-5.12.5-h7ef1ec2_0.tar.bz2, firefox-68.0.2-h6538335_1.tar.bz2

(it stops)

From inside conda-build, adding qt as a test dependency (full output below):

ClobberWarning: This transaction has incompatible packages due to a shared path.
  packages: local::firefox-68.0.2-ha925a31_1, conda-forge::qt-5.12.5-h7ef1ec2_0
  path: 'library/bin/libegl.dll'

ClobberWarning: This transaction has incompatible packages due to a shared path.
  packages: local::firefox-68.0.2-ha925a31_1, conda-forge::qt-5.12.5-h7ef1ec2_0
  path: 'library/bin/libglesv2.dll'
done
Executing transaction: ...working...
ClobberWarning: Conda was asked to clobber an existing path.
  source path: c:\mc3\pkgs\qt-5.12.5-h7ef1ec2_0\Library\bin\libEGL.dll
  target path: c:\mc3\conda-bld\firefox_1569869752180\_test_env\Library\bin\libEGL.dll

ClobberWarning: Conda was asked to clobber an existing path.
  source path: c:\mc3\pkgs\qt-5.12.5-h7ef1ec2_0\Library\bin\libGLESv2.dll
  target path: c:\mc3\conda-bld\firefox_1569869752180\_test_env\Library\bin\libGLESv2.dll

(but it does build the package. using qt =5.9 and qt =5.6 gives the same two conflicts, so i guess qt got there first.)

Not sure how to proceed: adding qt as a dependency seems awfully heavy, and probably not even correct.

related?

• v5.12.5: Qt5GuiConfigExtras.cmake hardcodes path to libEGL.so cdt qt-feedstock#123
• try turning off ignore_duplicate_files robots-from-jupyter/robotlab#51

Environment (conda list):

$ conda list

# packages in environment at c:\mc3:
#
# Name                    Version                   Build  Channel
asn1crypto                0.24.0                   py37_0
beautifulsoup4            4.8.0                    py37_0    conda-forge
bzip2                     1.0.8                he774522_0
ca-certificates           2019.9.11            hecc5488_0    conda-forge
certifi                   2019.9.11                py37_0
cffi                      1.12.3           py37h7a1dbc1_0
chardet                   3.0.4                    py37_1
conda                     4.7.12                   py37_0    conda-forge
conda-build               3.18.9                   py37_5    conda-forge
conda-package-handling    1.3.11                   py37_0
console_shortcut          0.1.1                         3
cryptography              2.7              py37h7a1dbc1_0
filelock                  3.0.10                     py_0    conda-forge
glob2                     0.7                        py_0    conda-forge
idna                      2.8                      py37_0
jinja2                    2.10.1                     py_0    conda-forge
libarchive                3.3.3                h0643e63_5
libiconv                  1.15                 h1df5818_7
liblief                   0.9.0                ha925a31_2
libxml2                   2.9.9                h464c3ec_0
lz4-c                     1.8.1.2              h2fa13f4_0
lzo                       2.10                 h6df0209_2
m2w64-gcc-libgfortran     5.3.0                         6
m2w64-gcc-libs            5.3.0                         7
m2w64-gcc-libs-core       5.3.0                         7
m2w64-gmp                 6.1.0                         2
m2w64-libwinpthread-git   5.0.0.4634.697f757               2
markupsafe                1.1.1            py37hfa6e2cd_0    conda-forge
menuinst                  1.4.16           py37he774522_0
msys2-conda-epoch         20160418                      1
openssl                   1.1.1c               hfa6e2cd_0    conda-forge
pip                       19.1.1                   py37_0
pkginfo                   1.5.0.1                    py_0    conda-forge
powershell_shortcut       0.0.1                         2
psutil                    5.6.3            py37hfa6e2cd_0    conda-forge
py-lief                   0.9.0            py37ha925a31_2
pycosat                   0.6.3            py37hfa6e2cd_0
pycparser                 2.19                     py37_0
pyopenssl                 19.0.0                   py37_0
pysocks                   1.7.0                    py37_0
python                    3.7.3                h8c8aaf0_1
python-libarchive-c       2.8                     py37_11
pytz                      2019.2                     py_0    conda-forge
pywin32                   223              py37hfa6e2cd_1
pyyaml                    5.1.2            py37hfa6e2cd_0    conda-forge
requests                  2.22.0                   py37_0
ripgrep                   11.0.2               h301d43c_3    conda-forge
ruamel_yaml               0.15.46          py37hfa6e2cd_0
setuptools                41.0.1                   py37_0
six                       1.12.0                   py37_0
soupsieve                 1.9.4                    py37_0    conda-forge
sqlite                    3.29.0               he774522_0
tqdm                      4.32.1                     py_0
urllib3                   1.24.2                   py37_0
vc                        14.1                 h0510ff6_4
vs2015_runtime            14.15.26706          h3a45250_4
wheel                     0.33.4                   py37_0
win_inet_pton             1.1.0                    py37_0
wincertstore              0.2                      py37_0
xz                        5.2.4                h2fa13f4_4
yaml                      0.1.7                hc54c509_2
zlib                      1.2.11               h62dcd97_3
zstd                      1.3.7                h508b16e_0

Details about conda and system ( conda info ):

$ conda info
     active environment : base
    active env location : c:\mc3
            shell level : 1
       user config file : C:\Users\IEUser\.condarc
 populated config files :
          conda version : 4.7.12
    conda-build version : 3.18.9
         python version : 3.7.3.final.0
       virtual packages :
       base environment : c:\mc3  (writable)
           channel URLs : https://repo.anaconda.com/pkgs/main/win-64
                          https://repo.anaconda.com/pkgs/main/noarch
                          https://repo.anaconda.com/pkgs/r/win-64
                          https://repo.anaconda.com/pkgs/r/noarch
                          https://repo.anaconda.com/pkgs/msys2/win-64
                          https://repo.anaconda.com/pkgs/msys2/noarch
          package cache : c:\mc3\pkgs
                          C:\Users\IEUser\.conda\pkgs
                          C:\Users\IEUser\AppData\Local\conda\conda\pkgs
       envs directories : c:\mc3\envs
                          C:\Users\IEUser\.conda\envs
                          C:\Users\IEUser\AppData\Local\conda\conda\envs
               platform : win-64
             user-agent : conda/4.7.12 requests/2.22.0 CPython/3.7.3 Windows/10 Windows/10.0.17134
          administrator : False
             netrc file : None
           offline mode : False

Adding qt to test: requires:

TEST START: c:\mc3\conda-bld\win-64\firefox-68.0.2-ha925a31_1.tar.bz2
Renaming work directory,  c:\mc3\conda-bld\firefox_1569869752180\work  to  c:\mc3\conda-bld\firefox_1569869752180\work_moved_firefox-68.0.2-ha925a31_1_win-64
Collecting package metadata (repodata.json): ...working... done
Solving environment: ...working... done
Package Plan
environment location: c:\mc3\conda-bld\firefox_1569869752180_test_env
The following NEW packages will be INSTALLED:
asn1crypto:      0.24.0-py37_1003          conda-forge
ca-certificates: 2019.9.11-hecc5488_0      conda-forge
certifi:         2019.6.16-py37_1          conda-forge
cffi:            1.12.3-py37hb32ad35_0     conda-forge
cryptography:    2.7-py37hb32ad35_0        conda-forge
firefox:         68.0.2-ha925a31_1         local
geckodriver:     0.24.0-h21ff451_1         conda-forge
icu:             64.2-he025d50_1           conda-forge
idna:            2.8-py37_1000             conda-forge
jpeg:            9c-hfa6e2cd_1001          conda-forge
libclang:        9.0.0-h74a9793_0          conda-forge
libpng:          1.6.37-h7602738_0         conda-forge
openssl:         1.1.1c-hfa6e2cd_0         conda-forge
pip:             19.2.3-py37_0             conda-forge
pycparser:       2.19-py37_1               conda-forge
pyopenssl:       19.0.0-py37_0             conda-forge
pysocks:         1.7.1-py37_0              conda-forge
python:          3.7.3-h510b542_1          conda-forge
qt:              5.12.5-h7ef1ec2_0         conda-forge
selenium:        3.141.0-py37hfa6e2cd_1000 conda-forge
setuptools:      41.2.0-py37_0             conda-forge
six:             1.12.0-py37_1000          conda-forge
sqlite:          3.29.0-hfa6e2cd_1         conda-forge
urllib3:         1.25.6-py37_0             conda-forge
vc:              14.1-h0510ff6_4
vs2015_runtime:  14.16.27012-hf0eaf9b_0
wheel:           0.33.6-py37_0             conda-forge
win_inet_pton:   1.1.0-py37_0              conda-forge
wincertstore:    0.2-py37_1002             conda-forge
zlib:            1.2.11-h2fa13f4_1006      conda-forge

Preparing transaction: ...working... done

Verifying transaction: ...working...

ClobberWarning: This transaction has incompatible packages due to a shared path.

packages: local::firefox-68.0.2-ha925a31_1, conda-forge::qt-5.12.5-h7ef1ec2_0

path: 'library/bin/libegl.dll'
ClobberWarning: This transaction has incompatible packages due to a shared path.

packages: local::firefox-68.0.2-ha925a31_1, conda-forge::qt-5.12.5-h7ef1ec2_0

path: 'library/bin/libglesv2.dll'
done

Executing transaction: ...working...

ClobberWarning: Conda was asked to clobber an existing path.

source path: c:\mc3\pkgs\qt-5.12.5-h7ef1ec2_0\Library\bin\libEGL.dll

target path: c:\mc3\conda-bld\firefox_1569869752180_test_env\Library\bin\libEGL.dll
ClobberWarning: Conda was asked to clobber an existing path.

source path: c:\mc3\pkgs\qt-5.12.5-h7ef1ec2_0\Library\bin\libGLESv2.dll

target path: c:\mc3\conda-bld\firefox_1569869752180_test_env\Library\bin\libGLESv2.dll
done

set PREFIX=c:\mc3\conda-bld\firefox_1569869752180_test_env

set SRC_DIR=c:\mc3\conda-bld\firefox_1569869752180\test_tmp
(base) %SRC_DIR%>call "%SRC_DIR%\conda_test_env_vars.bat"
(base) %SRC_DIR%>set "CONDA_SHLVL="   &&
(base) %SRC_DIR%>conda activate "%PREFIX%"
(%PREFIX%) %SRC_DIR%>IF 0 NEQ 0 exit 1
(%PREFIX%) %SRC_DIR%>"%PREFIX%\python.exe" -s "%SRC_DIR%\run_test.py"

===== testing package: firefox-68.0.2-ha925a31_1 =====

running run_test.py

checking firefox binary at %PREFIX%\Library\bin\firefox.exe...

... ok

checking binary version...

... ok

testing about:license with selenium...

... ok

===== firefox-68.0.2-ha925a31_1 OK =====
(%PREFIX%) %SRC_DIR%>IF 0 NEQ 0 exit 1
Resource usage statistics from testing firefox:

Process count: 8

CPU time: Sys=0:00:01.6, User=0:00:04.2

Memory: 396.4M

Disk usage: 12.8K

Time elapsed: 0:00:12.2
TEST END: c:\mc3\conda-bld\win-64\firefox-68.0.2-ha925a31_1.tar.bz2

Renaming work directory,  c:\mc3\conda-bld\firefox_1569869752180\work  to  c:\mc3\conda-bld\firefox_1569869752180\work_moved_firefox-68.0.2-ha925a31_1_win-64_main_build_loop
Automatic uploading is disabled
If you want to upload package(s) to anaconda.org later, type:
anaconda upload c:\mc3\conda-bld\win-64\firefox-68.0.2-ha925a31_1.tar.bz2
To have conda build upload to anaconda.org automatically, use
$ conda config --set anaconda_upload yes
anaconda_upload is not set.  Not uploading wheels: []

####################################################################################

Resource usage summary:
Total time: 0:03:50.6

CPU usage: sys=0:00:01.7, user=0:00:04.3

Maximum memory usage observed: 396.4M

Total disk usage observed (not including envs): 46.3M
####################################################################################

Source and build intermediates have been left in c:\mc3\conda-bld.

There are currently 2 accumulated.

To remove them, you can run the conda build purge command

[bollwyvl]

i kinda wish it would tell me if their hashes (or even sizes) matched...

[bollwyvl]

Adding requirements: host: qt =5.12 reduces the number of packaged files to 62 from 64, and conda-build no longer complains. Doing a simple screenshot test with WebGL indicates that it is (at least not horrible in-)compatible with qt =5.12 (note that said test cannot be run with --headless). The license canary test works with qt =5.9, but the webgl one does not.