Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Accuracy didnt increase #1

Open
Timmmeyyy opened this issue Oct 22, 2019 · 1 comment
Open

Accuracy didnt increase #1

Timmmeyyy opened this issue Oct 22, 2019 · 1 comment

Comments

@Timmmeyyy
Copy link

Timmmeyyy commented Oct 22, 2019

Hi, i have a probleme that my accuracy didnt increase, it is always 0,66 after 1400 epochs. Do you have any idea whtat can i check first. I think my input data and labels are right. Greetz Tim

@brakid
Copy link
Owner

brakid commented Oct 22, 2019

Hi,

maybe you need to tweak a bit the hyperparameters of the model such as the layer-count and size:

fc1 = mx.symbol.FullyConnected(data, name="fc1", num_hidden=59)
and following lines. You might also want to check different activation functions such as tanh or softrelu in the layers: https://beta.mxnet.io/api/ndarray/_autogen/mxnet.ndarray.Activation.html

In general, if the model fails to match your data, this is a sign that the model is not powerful enough to capture the subtleties in your dataset, adding additional layers could be helpful as well.

Another option could be that the optimizer is not calibrated correctly for your data. The learning rate might be too high or low:

optimizer_params={'learning_rate':0.01},

There are various resources on hyperparameter tuning for Neural networks, such as: https://towardsdatascience.com/hyper-parameter-tuning-techniques-in-deep-learning-4dad592c63c8.

Hopefully this helps you increase the accuracy and performance of your neural network.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants