# Specific Domains

**URL:** https://discourse.julialang.org/c/domain/10.md?page=545

[Latest](https://discourse.julialang.org/latest.md) · [Categories](https://discourse.julialang.org/categories.md) · [Tags](https://discourse.julialang.org/tags.md)

**Page:** 546

---

## [Concatenate CSV data into Feather using DataStreams](https://discourse.julialang.org/t/concatenate-csv-data-into-feather-using-datastreams/3690)

<div class="topic-metadata">

**Author:** [@Tamas\_Papp](https://discourse.julialang.org/u/Tamas_Papp)\
**Replies:** 5\
**Last updated:** [February 1, 2018, 6:50am UTC](https://discourse.julialang.org/t/concatenate-csv-data-into-feather-using-datastreams/3690 "2018-02-01T06:50:32Z")

</div>

I have about 400G of data in 15 .csv.gz files, overall 2e9 records with 20 columns, same schema in each file. I would like to read all of them and save in a single .feather file for further analysis. I could not figure …

---

## [Stochastic solver pushes chemical langevin equations into negative concentrations](https://discourse.julialang.org/t/stochastic-solver-pushes-chemical-langevin-equations-into-negative-concentrations/8688)

<div class="topic-metadata">

**Author:** [@Torkel](https://discourse.julialang.org/u/Torkel)\
**Replies:** 3\
**Last updated:** [January 31, 2018, 2:08pm UTC](https://discourse.julialang.org/t/stochastic-solver-pushes-chemical-langevin-equations-into-negative-concentrations/8688 "2018-01-31T14:08:14Z")

</div>

Summary: When I simulate the stochastic time development of a reaction network the simulation crashes due to concentrations becoming negative (works fine for deterministic solution). I have this chemical reaction networ…

---

## [Correct way to express SOSII constraints](https://discourse.julialang.org/t/correct-way-to-express-sosii-constraints/8596)

<div class="topic-metadata">

**Author:** [@michaellindon](https://discourse.julialang.org/u/michaellindon)\
**Replies:** 8\
**Last updated:** [January 31, 2018, 3:46am UTC](https://discourse.julialang.org/t/correct-way-to-express-sosii-constraints/8596 "2018-01-31T03:46:19Z")

</div>

I have an application in which I would like to use SOS II constraints to model a piecewise linear approximation to non-linear function. In particular I have a log(z) term in my objective which I would like to approximate…

---

## [Thread lock with async channel?](https://discourse.julialang.org/t/thread-lock-with-async-channel/8674)

<div class="topic-metadata">

**Author:** [@jwu](https://discourse.julialang.org/u/jwu)\
**Replies:** 2\
**Last updated:** [January 31, 2018, 3:37am UTC](https://discourse.julialang.org/t/thread-lock-with-async-channel/8674 "2018-01-31T03:37:25Z")

</div>

The @threads seems not working well with async channel. the following code blocks forever, is there something wrong? using Base.Threads c = Channel{Int}(1) mutex = SpinLock() @sync begin @async begin # …

---

## [Various by-group strategies compared](https://discourse.julialang.org/t/various-by-group-strategies-compared/6594)

<div class="topic-metadata">

**Author:** [@xiaodai](https://discourse.julialang.org/u/xiaodai)\
**Replies:** 36\
**Last updated:** [January 30, 2018, 11:28pm UTC](https://discourse.julialang.org/t/various-by-group-strategies-compared/6594 "2018-01-30T23:28:40Z")

</div>

Update 12th Nov 2017 2nd Update Implemented a multi-threaded that is almost 2x faster than data.table! Implemented a new radixgroup that is even faster than the previous method by 18% on 250 million element arrays. Up…

---

## [Julia Support for File Loading](https://discourse.julialang.org/t/julia-support-for-file-loading/8673)

<div class="topic-metadata">

**Author:** [@RandomString123](https://discourse.julialang.org/u/RandomString123)\
**Replies:** 22\
**Last updated:** [January 30, 2018, 2:07pm UTC](https://discourse.julialang.org/t/julia-support-for-file-loading/8673 "2018-01-30T14:07:58Z")

</div>

As a first learning project in Julia I have started to try to convert a project I did in R into Julia. And it turns out I quickly ran into a couple roadblocks. All of which are related to reading in legacy data files l…

---

## [Replicating a useful Stata Workflow with DataFramesMeta](https://discourse.julialang.org/t/replicating-a-useful-stata-workflow-with-dataframesmeta/8671)

<div class="topic-metadata">

**Author:** [@pdeffebach](https://discourse.julialang.org/u/pdeffebach)\
**Replies:** 6\
**Last updated:** [January 30, 2018, 2:07pm UTC](https://discourse.julialang.org/t/replicating-a-useful-stata-workflow-with-dataframesmeta/8671 "2018-01-30T14:07:20Z")

</div>

One thing that is necessary when working with survey data is being able create new variables by standardizing capping existing variables variables. One workflow might look like this: sysuse auto local variables\_to\_cap …

---

## [Convex.jl: Return number of solver iterations](https://discourse.julialang.org/t/convex-jl-return-number-of-solver-iterations/8689)

<div class="topic-metadata">

**Author:** [@migarstka](https://discourse.julialang.org/u/migarstka)\
**Replies:** 0\
**Last updated:** [January 30, 2018, 12:17pm UTC](https://discourse.julialang.org/t/convex-jl-return-number-of-solver-iterations/8689 "2018-01-30T12:17:23Z")

</div>

Hi, is there any way to return the number of solver iterations to convergence when I solve an optimization problem with Convex.jl and the SCS-solver? Thank you!

---

## [Linking axes](https://discourse.julialang.org/t/linking-axes/8633)

<div class="topic-metadata">

**Author:** [@airpmb](https://discourse.julialang.org/u/airpmb)\
**Replies:** 8\
**Last updated:** [January 29, 2018, 11:01pm UTC](https://discourse.julialang.org/t/linking-axes/8633 "2018-01-29T23:01:07Z")

</div>

Do any of the plotting packages for Julia support linking the axes of plots, as well as interactive zooming/panning? I’ve found mention (though not in docs, only in GitHub issues) of a link kwarg in Plots.jl, but it didn…

---

## [JuMP (Not) Passing Exact Hessians to Ipopt](https://discourse.julialang.org/t/jump-not-passing-exact-hessians-to-ipopt/7844)

<div class="topic-metadata">

**Author:** [@Juser](https://discourse.julialang.org/u/Juser)\
**Replies:** 12\
**Last updated:** [January 29, 2018, 10:17pm UTC](https://discourse.julialang.org/t/jump-not-passing-exact-hessians-to-ipopt/7844 "2018-01-29T22:17:30Z")

</div>

When using Ipopt through JuMP, I find myself unable to set hessian\_approximation=“exact” (i.e. to tell Ipopt that I will give it an exact hessian). When I try, I get an error to the effect of “Exception message: eval\_h…

---

## [Nonlinear Constraints with Splatting](https://discourse.julialang.org/t/nonlinear-constraints-with-splatting/8677)

<div class="topic-metadata">

**Author:** [@shoshievass](https://discourse.julialang.org/u/shoshievass)\
**Replies:** 7\
**Last updated:** [January 29, 2018, 9:47pm UTC](https://discourse.julialang.org/t/nonlinear-constraints-with-splatting/8677 "2018-01-29T21:47:05Z")

</div>

I’m trying to solve an optimization problem w/ (N+1) parameters subject to a set of N nonlinear constraints, each of which relies on the whole vector of the parameters. A simplified version of my problem looks like this…

---

## [Progress towards faster \`sortperm\` for Strings](https://discourse.julialang.org/t/progress-towards-faster-sortperm-for-strings/8505)

<div class="topic-metadata">

**Author:** [@xiaodai](https://discourse.julialang.org/u/xiaodai)\
**Replies:** 16\
**Last updated:** [January 29, 2018, 4:45am UTC](https://discourse.julialang.org/t/progress-towards-faster-sortperm-for-strings/8505 "2018-01-29T04:45:39Z")

</div>

I have just implemented an idea I had to make sortperm faster for Strings. It is implemented in SortingLab.jl’s fsortperm; and I got the performance on a particular benchmark to be 7x faster than Base.sortperm, see code …

---

## [NLopt 0.3.6 segfaults Julia 0.6.2](https://discourse.julialang.org/t/nlopt-0-3-6-segfaults-julia-0-6-2/8645)

<div class="topic-metadata">

**Author:** [@ivo\_welch](https://discourse.julialang.org/u/ivo_welch)\
**Replies:** 0\
**Last updated:** [January 27, 2018, 9:54pm UTC](https://discourse.julialang.org/t/nlopt-0-3-6-segfaults-julia-0-6-2/8645 "2018-01-27T21:54:54Z")

</div>

julia\> using NLopt julia\> myfun(x::Vector, unused::Vector)= (x\[1\]-2)^2 + (x\[2\]-3)^2 + (x\[1\]\*x\[2\])^2 myfun (generic function with 1 method) julia\> opt= Opt(:LN\_NELDERMEAD,2) Opt(:LN\_NELDERMEAD, 2) julia\> lower\_bounds!(…

---

## [Optim L-BFGS() - Can I save internal state?](https://discourse.julialang.org/t/optim-l-bfgs-can-i-save-internal-state/8583)

<div class="topic-metadata">

**Author:** [@egcjm](https://discourse.julialang.org/u/egcjm)\
**Replies:** 1\
**Last updated:** [January 25, 2018, 11:32am UTC](https://discourse.julialang.org/t/optim-l-bfgs-can-i-save-internal-state/8583 "2018-01-25T11:32:52Z")

</div>

Oftentimes, L-BFGS has not converged when it stops after a few hours of crunching away because I specified too few iterations… I then would like to continue without having to restart from scratch, i.e. without L-BFGS reb…

---

## [optim arguments: higher dimensional arrays and gradient specification](https://discourse.julialang.org/t/optim-arguments-higher-dimensional-arrays-and-gradient-specification/8500)

<div class="topic-metadata">

**Author:** [@egcjm](https://discourse.julialang.org/u/egcjm)\
**Replies:** 10\
**Last updated:** [January 26, 2018, 2:31pm UTC](https://discourse.julialang.org/t/optim-arguments-higher-dimensional-arrays-and-gradient-specification/8500 "2018-01-26T14:31:30Z")

</div>

Two questions regarding optim,jl: Gradient specification for higher dimensional arrays. Optim.jl documentation states that “for zeroth and first order methods, it is also possible to pass in matrices, or even higher d…

---

## [On Machine Learning and Programming Languages](https://discourse.julialang.org/t/on-machine-learning-and-programming-languages/7574)

<div class="topic-metadata">

**Author:** [@Mason](https://discourse.julialang.org/u/Mason)\
**Replies:** 48\
**Last updated:** [January 25, 2018, 3:50pm UTC](https://discourse.julialang.org/t/on-machine-learning-and-programming-languages/7574 "2018-01-25T15:50:52Z")

</div>

New blog post on the Julia website

---

## [Help with eigenvalue decomposition for symmetric matrices](https://discourse.julialang.org/t/help-with-eigenvalue-decomposition-for-symmetric-matrices/8272)

<div class="topic-metadata">

**Author:** [@MarioSouto](https://discourse.julialang.org/u/MarioSouto)\
**Replies:** 2\
**Last updated:** [January 25, 2018, 3:17pm UTC](https://discourse.julialang.org/t/help-with-eigenvalue-decomposition-for-symmetric-matrices/8272 "2018-01-25T15:17:47Z")

</div>

Dear all, For some reason Julia’s eigenvalue factorization for symmetric matrices is considerable slow in my machine (MacBook Air, 1.8 GHz Intel Core i5, 4 GB 1600 MHz DDR3). In this same machine, Scipy’s eigenvalue fac…

---

## [Julia Script running with SQL datas](https://discourse.julialang.org/t/julia-script-running-with-sql-datas/8566)

<div class="topic-metadata">

**Author:** [@fenosoa](https://discourse.julialang.org/u/fenosoa)\
**Replies:** 5\
**Last updated:** [January 24, 2018, 10:44pm UTC](https://discourse.julialang.org/t/julia-script-running-with-sql-datas/8566 "2018-01-24T22:44:35Z")

</div>

Hi, I’m currently working on a web app for a college. In this app, students have to rank a list of classes (front in React). Datas and rankings are send to a Node.js - MySQL - Sequelize backend, and we found a .jl algor…

---

## [Equivalent for tf.keras.layers.Lambda in Tensorflow.jl/MXNet.jl](https://discourse.julialang.org/t/equivalent-for-tf-keras-layers-lambda-in-tensorflow-jl-mxnet-jl/8511)

<div class="topic-metadata">

**Author:** [@v-i-s-h](https://discourse.julialang.org/u/v-i-s-h)\
**Replies:** 1\
**Last updated:** [January 24, 2018, 4:55pm UTC](https://discourse.julialang.org/t/equivalent-for-tf-keras-layers-lambda-in-tensorflow-jl-mxnet-jl/8511 "2018-01-24T16:55:44Z")

</div>

Hi, I’m porting some code from Python using Tensorflow to Julia. I’m unable to find an equivalent for custom layer in TensorFlow.jl or in MXNet.jl. This is the exact code I want to translate: from tensorflow.python.ke…

---

## [Converting Float32 to N0f32 in FixedPointNumbers.jl](https://discourse.julialang.org/t/converting-float32-to-n0f32-in-fixedpointnumbers-jl/8555)

<div class="topic-metadata">

**Author:** [@jwu](https://discourse.julialang.org/u/jwu)\
**Replies:** 2\
**Last updated:** [January 24, 2018, 4:22pm UTC](https://discourse.julialang.org/t/converting-float32-to-n0f32-in-fixedpointnumbers-jl/8555 "2018-01-24T16:22:57Z")

</div>

this works in Julia 0.6.2: Float32(1.0) |\> N0f8 Float32(1.0) |\> N0f16 this will not work Float32(1.0) |\> N0f32 Float32(1.0) |\> N0f64 Float64(1.0) |\> N0f64 It looks like when the number of bits is the same or larger, …

---

## [Linking solver binaries with models (JuMP)](https://discourse.julialang.org/t/linking-solver-binaries-with-models-jump/8453)

<div class="topic-metadata">

**Author:** [@Curious1](https://discourse.julialang.org/u/Curious1)\
**Replies:** 7\
**Last updated:** [January 24, 2018, 11:43am UTC](https://discourse.julialang.org/t/linking-solver-binaries-with-models-jump/8453 "2018-01-24T11:43:57Z")

</div>

I have binaries of solvers in a particular directory of my linux systems. Now I want to solve my JuMP model using those binaries. How do I do that?

---

## [TeaPot like thing in Julia](https://discourse.julialang.org/t/teapot-like-thing-in-julia/8561)

<div class="topic-metadata">

**Author:** [@Arshpreet\_Singh](https://discourse.julialang.org/u/Arshpreet_Singh)\
**Replies:** 0\
**Last updated:** [January 24, 2018, 11:04am UTC](https://discourse.julialang.org/t/teapot-like-thing-in-julia/8561 "2018-01-24T11:04:22Z")

</div>

I was looking for Teapot like in Julia. Here is Teapot in Python: To summarize what we’ve learned so far about effective machine learning system design, we should: Always tune the hyperparameters for our models Always…

---

## [Rationalize() error](https://discourse.julialang.org/t/rationalize-error/8544)

<div class="topic-metadata">

**Author:** [@Yaroslav\_Kavenchuk](https://discourse.julialang.org/u/Yaroslav_Kavenchuk)\
**Replies:** 2\
**Last updated:** [January 23, 2018, 9:34pm UTC](https://discourse.julialang.org/t/rationalize-error/8544 "2018-01-23T21:34:56Z")

</div>

\_ \_ \_ \_(\_)\_ | A fresh approach to technical computing (\_) | (\_) (\_) | Documentation: https://docs.julialang.org \_ \_ \_| |\_ \_\_ \_ | Type "?help" for help. | | | | | | |/ \_\` …

---

## [Rounding off error in simple calculations](https://discourse.julialang.org/t/rounding-off-error-in-simple-calculations/8543)

<div class="topic-metadata">

**Author:** [@sambitdash](https://discourse.julialang.org/u/sambitdash)\
**Replies:** 3\
**Last updated:** [January 23, 2018, 12:34pm UTC](https://discourse.julialang.org/t/rounding-off-error-in-simple-calculations/8543 "2018-01-23T12:34:23Z")

</div>

julia\> 2.5/3 0.8333333333333334 The result should have been reported 0.8333333333333333. An infinite series of 3s will never reach to 4 and will be a floor when rounded. Is there any specific reason we have preferred r…

---

## [Confused \`spdiagm\` with matlab function](https://discourse.julialang.org/t/confused-spdiagm-with-matlab-function/8525)

<div class="topic-metadata">

**Author:** [@jacob-roth](https://discourse.julialang.org/u/jacob-roth)\
**Replies:** 4\
**Last updated:** [January 22, 2018, 5:16pm UTC](https://discourse.julialang.org/t/confused-spdiagm-with-matlab-function/8525 "2018-01-22T17:16:33Z")

</div>

I’m having issues running cholfact on a sparse tridiagonal matrix (Julia v0.6) which works in matlab. When I try to factor L: L = spdiagm((-1.\*v,10.\*v,-1.\*v),(-1,0,1)) println(typeof(L)) cholfact(L) I get: SparseMatri…

---

## [JuMP : Adding variables/constraints to a model dynamically](https://discourse.julialang.org/t/jump-adding-variables-constraints-to-a-model-dynamically/3974)

<div class="topic-metadata">

**Author:** [@Julie](https://discourse.julialang.org/u/Julie)\
**Replies:** 8\
**Last updated:** [October 27, 2017, 12:51pm UTC](https://discourse.julialang.org/t/jump-adding-variables-constraints-to-a-model-dynamically/3974 "2017-10-27T12:51:32Z")

</div>

Is it possible to add dynamically constraints and/or variables to a model? I know there is a syntax to add variable (for column generation) but in the documentation I found that “Some solvers do not expose the ability t…

---

## [Optimization routines for Bigfloat/doubledouble/higher precision objective and gradient functions?](https://discourse.julialang.org/t/optimization-routines-for-bigfloat-doubledouble-higher-precision-objective-and-gradient-functions/8448)

<div class="topic-metadata">

**Author:** [@egcjm](https://discourse.julialang.org/u/egcjm)\
**Replies:** 3\
**Last updated:** [January 19, 2018, 4:46pm UTC](https://discourse.julialang.org/t/optimization-routines-for-bigfloat-doubledouble-higher-precision-objective-and-gradient-functions/8448 "2018-01-19T16:46:18Z")

</div>

Are there Julia optimizers that operate on bigfloat/doubledouble/higher precision objective and gradient functions? I am specifically interested in a L-BGFS functionality for higher that double precision.

---

## [Solvers, nonlinear constraints and user defined functions](https://discourse.julialang.org/t/solvers-nonlinear-constraints-and-user-defined-functions/4690)

<div class="topic-metadata">

**Author:** [@kguo](https://discourse.julialang.org/u/kguo)\
**Replies:** 10\
**Last updated:** [January 18, 2018, 1:17pm UTC](https://discourse.julialang.org/t/solvers-nonlinear-constraints-and-user-defined-functions/4690 "2018-01-18T13:17:28Z")

</div>

I apologize if someone had raised questions like this. And I understand the topic sounded similar to some previous topics. I did do a search. But didn’t found specific answers to all the questions I have. I understan…

---

## [Text in figure using PyPlot](https://discourse.julialang.org/t/text-in-figure-using-pyplot/1337)

<div class="topic-metadata">

**Author:** [@chobbes](https://discourse.julialang.org/u/chobbes)\
**Replies:** 7\
**Last updated:** [January 17, 2018, 5:33am UTC](https://discourse.julialang.org/t/text-in-figure-using-pyplot/1337 "2018-01-17T05:33:27Z")

</div>

I’m trying to add some text in a figure made by PyPlot. It seems that the matplotlib command text doesn’t work in PyPlot. So annotate is the only option? Another question is how to have the in-figure texts tilted/rotate…

---

## [Append!() function extremely slow in DataFrames + CSV](https://discourse.julialang.org/t/append-function-extremely-slow-in-dataframes-csv/8396)

<div class="topic-metadata">

**Author:** [@Fred](https://discourse.julialang.org/u/Fred)\
**Replies:** 14\
**Last updated:** [January 16, 2018, 2:21pm UTC](https://discourse.julialang.org/t/append-function-extremely-slow-in-dataframes-csv/8396 "2018-01-16T14:21:16Z")

</div>

Hi, When I switched to CSV instead of readtable() to read tabular data, I was surprised to see an extreme slowdown. I attached a small benchmark which seems to indicate that the slowdown is in the append!() function. T…

[Previous page](https://discourse.julialang.org/c/domain/10.md?page=544)

[Next page](https://discourse.julialang.org/c/domain/10.md?page=546)