Related questions

Tfa.layers.ESN Example

2021-02-22 22:37 Pedro JF. imported from Stackoverflow

Does anyone have a working example implementing Each State Network with Tfa.layers.ESN.

Currently, I have the following model

Model: "model"
_________________________________________________________________
Layer (type)                 Output Shape              Param #   
_________________________________________________________________
digits (InputLayer)          [(None, 41, 4)]           0         
_________________________________________________________________
ESN                          (None, 41, 242)           30492     
_________________________________________________________________
flatten (Flatten)            (None, 9922)              0         
_________________________________________________________________
predictions (Dense)          (None, 2)                 19846  
_________________________________________________________________   
Total params: 50,338
Trainable params: 19,846
Non-trainable params: 30,492
_________________________________________________________________

The problem that I am having is that once I increase the number of hidden units the accuracy of the model drops instead of increasing, both in training and testing dataset. Also, the accuracy that I got is very low.

See also questions close to this topic

  • How can I flatten a json in pandas with wildcard?

    Given this json:

    "World_Regions": {
    "Americas": {
        "0": {
            "Name": "North America",
            "Category_Average": "54.53",
            "Stocks_%": "55.44",
            "Benchmark": "59.02"
        },
        "1": {
            "Name": "Latin America",
            "Category_Average": "0.87",
            "Stocks_%": "1.14",
            "Benchmark": "0.93"
        }
    },
    "Greater Asia": {
        "0": {
            "Name": "Japan",
            "Category_Average": "6.58",
            "Stocks_%": "3.74",
            "Benchmark": "7.76"
        },
        "1": {
            "Name": "Australasia",
            "Category_Average": "1.79",
            "Stocks_%": "7.45",
            "Benchmark": "2.17"
        },
        "2": {
            "Name": "Asia Developed",
            "Category_Average": "5.56",
            "Stocks_%": "7.27",
            "Benchmark": "4.57"
        },
        "3": {
            "Name": "Asia Emerging",
            "Category_Average": "6.63",
            "Stocks_%": "2.96",
            "Benchmark": "6.58"
        }
    },

    I want to get this result:

    Name    Category_Average    Stocks_%    Benchmark
0   North America   54.53   55.44   59.02
1   Latin America   0.87    1.14    0.93
2   Japan   6.58    3.74    7.76
3   Australasia 1.79    7.45    2.17
4   Asia Developed  5.56    7.27    4.57
6   Asia Emerging   6.63    2.96    6.58

    but unfortunately the different names for region name(Americas/Greater Asia) is causing a problem. I am trying to this cleanly in one command right now I can get the result by doing this:

    pd.DataFrame.from_dict(jsonFile['World_Regions']['Greater Asia']).transpose()
        Name    Category_Average    Stocks_%    Benchmark
    0   Japan   6.58    3.74    7.76
    1   Australasia 1.79    7.45    2.17
    2   Asia Developed  5.56    7.27    4.57
    3   Asia Emerging   6.63    2.96    6.58

    then the same for Americas then merge the dataframes. Is there a way to do it that's more direct(i.e. one command?)

  • Python Splinter: Opening Chrome Dev Tools fixes timeout

    One of the weekly scrapes that I run has been timing out. Instead of search results, their error page comes up with a message that translates to "The webserver is unavailable"

    The program will reload the page and try again. Sometimes it will get past it on its own, but that can take a while and is not guaranteed. The browser.reload() will timeout and try again when the exception is caught. But if I just open dev tools at any point while it's stuck, the page will immediately start functioning normally, the reload will stop hanging, the page will load, and the search results will be there. The next few (anywhere from 3 to 20+) searches will be fine and then it will happen again, with dev tools getting things back on track.

    Can anyone offer any insight as to why this may be happening?

    They don't use captcha or anything but could this be under the umbrella of limiting traffic?

    I looked into trying to have splinter/selenium open dev tools but was unable to make it happen.

    I'm running searches for a list of locations and a list of dates for each location. My next thought is to build a function to kill the browser instance, create a new one, and handle a few things that are necessary upon initially visiting the site, so it can pick up where it left off within the loops. Before that, is there anything else I should look into? Google gave me nothing on this specific scenario.

  • Does np.save remove duplicates in saving content? 
    wiki_knowledge = []

for k in knowledge:

  wiki_knowledge.append(k)

  num += 1
  if num%500 == 0: # save periodically
     np.save(save_path + "wiki_knowledge.npy", wiki_knowledge)
np.save(save_path + "wiki_knowledge.npy", wiki_knowledge)

    I am new to np.save() function. I am seeing other's code above. The array wiki_knowledge is accumulated and in the loop, how does np.save avoid to saving multiple times for the same element in the wiki_knowledge array?

  • How are the multiple source files (.cc) compiled? in which order?

    I am working on a project that represents a network simulation. In this network, the signal undergoes multiple processing stages, each one represented in the library as a .cc source code file (and a .h file aswell). Now, Since the signal processing must follow an order (each layer (.cc file) does some operations on the signal and then delivers the signal to the next layer (another .cc file), I was wondering how is this order decided? where is it specified inside the library? should there be a file containing a main function calling all those .cc files?

    Another question is, when a .cc file is compiled, are all the functions inside if it run sequencially? like starting from the first line going to the last. If now, how are the functions etc. run inside the .cc file? In which order, and how is it enstablished?

    I apologize if this question might sound a little dumb, but I'm relatively new to this kind of programming, and I'm trying to figure out the logics behind it.

    Thank you all.

  • Define jacobian with tensorflow custom_gradient

    I'm trying to define a custom gradient in TensorFlow for a function that returns a non-scalar.

    A simplified toy version of the problem is:

    import tensorflow as tf

@tf.custom_gradient
def f(x):
    y = tf.Variable([x[1], 2.0*x[0]])

    def grad(upstream):
        dg = tf.Variable([[0.0, 2.0], [1.0, 0.0]])
        return dg * upstream # ? no idea here

    return y, grad

x = tf.Variable([1.0, 2.0])
with tf.GradientTape() as tape:
    y = f(x)
tape.jacobian(y, x)
# tape.gradient(y,x)

    I do not understand what shape the grad function needs to return. In the above form, tape.gradient returns the full jacobian and tape.jacobian returns a warning about tracing:

    WARNING:tensorflow:11 out of the last 11 calls to <function pfor.<locals>.f at 0x7f40886001f0> triggered tf.function retracing. Tracing is expensive and the excessive number of tracings could be due to (1) creating @tf.function repeatedly in a loop, (2) passing tensors with different shapes, (3) passing Python objects instead of tensors. For (1), please define your @tf.function outside of the loop. For (2), @tf.function has experimental_relax_shapes=True option that relaxes argument shapes that can avoid unnecessary retracing. For (3), please refer to https://www.tensorflow.org/tutorials/customization/performance#python_or_tensor_args and https://www.tensorflow.org/api_docs/python/tf/function for more details.
  • ERROR: Could not find a version that satisfies the requirement tensorflow

    I intend to install tensorflow using pip in command prompt. This is what I have written:

    pip install tensorflow

    and

    py -m pip install tensorflow

    However, this is the error that appears:

    ERROR: Could not find a version that satisfies the requirement tensorflow
ERROR: No matching distribution found for tensorflow

    The version of my Python is 3.7 and it is 64 bit. I can't download it either through the settings.