# Ipopt built with MKL not resolving dependencies when called from Julia

**URL:** <https://discourse.julialang.org/t/ipopt-built-with-mkl-not-resolving-dependencies-when-called-from-julia/3436>\
**Category:** Optimization (Mathematical)\
**Created:** [April 29, 2017, 5:27pm UTC](https://discourse.julialang.org/t/ipopt-built-with-mkl-not-resolving-dependencies-when-called-from-julia/3436 "2017-04-29T17:27:35Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![iaravena](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/iaravena/32/4657_2.png) [@iaravena](https://discourse.julialang.org/u/iaravena)\
**Post date:** [April 29, 2017, 5:27pm UTC](https://discourse.julialang.org/t/ipopt-built-with-mkl-not-resolving-dependencies-when-called-from-julia/3436/1 "2017-04-29T17:27:35Z")

</div>

Hi all,  
I have been trying to make Ipopt.jl to work with my Ipopt built against MKL using ICC (which is working without errors, all test passing). Following [this topic](https://groups.google.com/forum/#!searchin/julia-opt/ipopt%7Csort:relevance/julia-opt/Qj_Tvli5Z54/bJJ2OHg5nogJ) I modified the file ~/.julia/v0.5/Ipopt/deps/deps.jl to point to my custom Ipopt. Then, I tried to run the test and I got the following error:

> MKL FATAL ERROR: Cannot load libmkl\_mc3.so or libmkl\_def.so.  
> ===================================[ERROR: Ipopt]====================================

> failed process: Process(`/usr/local/julia/julia-0.5.1/bin/julia -Cx86-64 -J/usr/local/julia/julia-0.5.1/lib/julia/sys.so --compile=yes --depwarn=yes --check-bounds=yes --code-coverage=none --color=yes --compilecache=yes /home/users/i/a/iaravena/.julia/v0.5/Ipopt/test/runtests.jl`, ProcessExited(1)) [1]

> =======================================================================================  
> ERROR: Ipopt had test errors  
> in #test#61(::Bool, ::Function, ::Array{AbstractString,1}) at ./pkg/entry.jl:749  
> in (::Base.Pkg.Entry.#kw##test)(::Array{Any,1}, ::Base.Pkg.Entry.#test, ::Array{AbstractString,1}) at ./:0  
> in (::Base.Pkg.Dir.##2#3{Array{Any,1},Base.Pkg.Entry.#test,Tuple{Array{AbstractString,1}}})() at ./pkg/dir.jl:31  
> in cd(::Base.Pkg.Dir.##2#3{Array{Any,1},Base.Pkg.Entry.#test,Tuple{Array{AbstractString,1}}}, ::String) at ./file.jl:59  
> in #cd#1(::Array{Any,1}, ::Function, ::Function, ::Array{AbstractString,1}, ::Vararg{Array{AbstractString,1},N}) at ./pkg/dir.jl:31  
> in (::Base.Pkg.Dir.#kw##cd)(::Array{Any,1}, ::Base.Pkg.Dir.#cd, ::Function, ::Array{AbstractString,1}, ::Vararg{Array{AbstractString,1},N}) at ./:0  
> in #test#3(::Bool, ::Function, ::String, ::Vararg{String,N}) at ./pkg/pkg.jl:258  
> in test(::String, ::Vararg{String,N}) at ./pkg/pkg.jl:258

Following other posts for Python with similar errors, I first verified that the directories containing those shared objects were included in LD\_LIBRARY\_PATH and that other environment variables required for ICC and MKL were set properly. Then I tried to load these shared objects directly to Julia with

> cd(“/usr/local/intel/ics\_2013.0.028/composer\_xe\_2013.1.117/mkl/lib/intel64”) do  
> Libdl.dlopen(“libmkl\_core.so”)  
> Libdl.dlopen(“libmkl\_intel\_thread.so”)  
> end

only to realize that there were undefined symbols in both of them. Those symbols were defined in libiomp5.so, libmkl\_core.so and libmkl\_intel\_thread.so and I was able to load the shared objects causing the MKL FATAL ERROR to Julia using

> Libdl.dlopen(“/usr/local/intel/ics\_2013.0.028/composer\_xe\_2013.1.117/compiler/lib/intel64/libiomp5.so”, Libdl.RTLD\_GLOBAL)  
> cd(“/usr/local/intel/ics\_2013.0.028/composer\_xe\_2013.1.117/mkl/lib/intel64”) do  
> Libdl.dlopen(“libmkl\_core.so”, Libdl.RTLD\_GLOBAL)  
> Libdl.dlopen(“libmkl\_intel\_thread.so”, Libdl.RTLD\_GLOBAL)  
> Libdl.dlopen(“libmkl\_def.so”, Libdl.RTLD\_GLOBAL)  
> Libdl.dlopen(“libmkl\_mc3.so”, Libdl.RTLD\_GLOBAL)  
> end

I included those lines in deps.jl but the original error persisted. Finally, I was able to make everything work by preloading libiomp5.so, libmkl\_core.so and libmkl\_intel\_thread.so when starting Julia, i.e. starting Julia with

> LD\_PRELOAD=/usr/local/intel/ics\_2013.0.028/composer\_xe\_2013.1.117/mkl/lib/intel64/libmkl\_core.so:/usr/local/intel/ics\_2013.0.028/composer\_xe\_2013.1.117/mkl/lib/intel64/libmkl\_intel\_thread.so:/usr/local/intel/ics\_2013.0.028/composer\_xe\_2013.1.117/compiler/lib/intel64/libiomp5.so julia

however, this is more of a hack than a solution. Is there a proper way to solve the issue of Ipopt not loading these dependencies when called from Julia? Any suggestions are welcome.

Ignacio

PS1: The same problem arose in another newer machine where I also have Ipopt, but with libmkl\_avx.so instead of libmkl\_mc3.so.  
PS2: Both of the machines with the error are in GNU/Linux. I am not sure whether this will happen in other platforms.

---

<div class="post-metadata">

**Author:** ![tkelman](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/tkelman/32/692_2.png) [@tkelman](https://discourse.julialang.org/u/tkelman)\
**Post date:** [April 29, 2017, 11:57pm UTC](https://discourse.julialang.org/t/ipopt-built-with-mkl-not-resolving-dependencies-when-called-from-julia/3436/2 "2017-04-29T23:57:09Z")

</div>

Maybe try to adjust the way Ipopt gets linked to mkl so that all the dependencies show up when you run ldd on libipopt. If that’s too complicated, then I’d say you can put the dlopen lines in your juliarc file, slightly better than using LD\_PRELOAD

---

<div class="post-metadata">

**Author:** ![iaravena](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/iaravena/32/4657_2.png) [@iaravena](https://discourse.julialang.org/u/iaravena)\
**Post date:** [April 30, 2017, 4:28pm UTC](https://discourse.julialang.org/t/ipopt-built-with-mkl-not-resolving-dependencies-when-called-from-julia/3436/3 "2017-04-30T16:28:39Z")

</div>

@tkelman thanks for idea. Putting the dlopen lines in juliarc worked, but now I am somewhat confused. Why putting these lines in juliarc works, but putting them in deps.jl does not?

I will try to rebuild Ipopt so that all dependencies are listed upfront. I will post on a couple of days how that goes.

---

<div class="post-metadata">

**Author:** ![tkelman](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/tkelman/32/692_2.png) [@tkelman](https://discourse.julialang.org/u/tkelman)\
**Post date:** [April 30, 2017, 10:56pm UTC](https://discourse.julialang.org/t/ipopt-built-with-mkl-not-resolving-dependencies-when-called-from-julia/3436/4 "2017-04-30T22:56:26Z")

</div>

Might be that dlopen doesn’t help when loaded from precompiled code. Having it in ` __init__ ` might also work?