# Mentor for HPC GSoC project

**URL:** <https://discourse.julialang.org/t/mentor-for-hpc-gsoc-project/2343>\
**Category:** Community\
**Created:** [February 27, 2017, 4:57pm UTC](https://discourse.julialang.org/t/mentor-for-hpc-gsoc-project/2343 "2017-02-27T16:57:22Z")\
**Posts on this page:** 3\
**Page:** 1

<div class="post-metadata">

**Author:** ![lopezm94](https://avatars.discourse-cdn.com/v4/letter/l/91b2a8/32.png) [@lopezm94](https://discourse.julialang.org/u/lopezm94)\
**Post date:** [February 27, 2017, 4:57pm UTC](https://discourse.julialang.org/t/mentor-for-hpc-gsoc-project/2343/1 "2017-02-27T16:57:22Z")

</div>

Hello everyone,

I’m checking out the HPC projects in the Julia GSoC idea section but there doesn’t seem to be any proposed mentors. I have experience in Julia and would love to get more expertise on programming models and distributed computing, is there someone I could contact for the [Dynamic distributed execution for data parallel tasks in Julia](http://julialang.org/soc/projects/hpc.html#dynamic-distributed-execution-for-data-parallel-tasks-in-julia) project?

Any leads on where I could find someone would also be helpful. Thanks!

---

<div class="post-metadata">

**Author:** ![MikeInnes](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/mikeinnes/32/3656_2.png) [@MikeInnes](https://discourse.julialang.org/u/MikeInnes)\
**Post date:** [February 27, 2017, 6:29pm UTC](https://discourse.julialang.org/t/mentor-for-hpc-gsoc-project/2343/2 "2017-02-27T18:29:58Z")

</div>

You might want to talk to @shashi, and check out his package [Dagger.jl](https://github.com/JuliaParallel/Dagger.jl) which is in a very related area.

---

<div class="post-metadata">

**Author:** ![shashi](https://sea2.discourse-cdn.com/julialang/user_avatar/discourse.julialang.org/shashi/32/1824_2.png) [@shashi](https://discourse.julialang.org/u/shashi)\
**Post date:** [February 28, 2017, 4:29am UTC](https://discourse.julialang.org/t/mentor-for-hpc-gsoc-project/2343/3 "2017-02-28T04:29:21Z")

</div>

@lopezm94 nice to see that you’re interested in that project 🙂 It’s true that Dagger.jl concerns itself with some of those issues… Some project ideas:

There is an important issue with the current scheduler to tackle ASAP: [https://github.com/JuliaParallel/Dagger.jl/issues/53](https://github.com/JuliaParallel/Dagger.jl/issues/53)

Depending on how you want to solve it, this might constitute a whole GSoC project. I would suggest hooking into [`Dask.distributed`](https://distributed.readthedocs.io/en/latest/index.html) scheduler. This will not only fix that problem but bring a slew of new optimizations from `Dask.distributed` (e.g. HDFS locality optimizations) to Dagger. Matt Rocklin, the author of dask might also be interested in mentoring such a project.

Another interesting experiment would be to try and implement something like [Naiad](https://www.microsoft.com/en-us/research/project/naiad/), then try to use that as Dagger’s scheduler and compare its performance with the existing scheduler in Dagger which is based on [dask’s shared-memory scheduler](http://dask.pydata.org/en/latest/shared.html). I think this is a great project for the time scale of GSoC. But I believe it’s high-risk compared to the former. It’s unclear to me if this sort of scheduling is a good fit for array based abstractions we want to build up to in Dagger.

Another small task is to dust off the GPU support PR [https://github.com/JuliaParallel/Dagger.jl/pull/33](https://github.com/JuliaParallel/Dagger.jl/pull/33) (This may be too small to constitute a whole GSoC project on its own.)

I encourage you to read up the links and prepare a draft proposal if you are interested in any of this! 🙂 New ideas are also welcome!

**Updated:** Changed ordering, formatting changes.