python requests lib is not working in amazon aws

You get different IP after ping because www.nseindia.com is delivered to you through akamai CDN. So you are pinging different edge location whether you are doing this from home/work or AWS servers.

What's more, IP address ranges of AWS are publicly known. Thus, its not uncommon for websites to explicitly block AWS connections, to protect from scraping, attacks or otherwise unwanted access. Thus it seems that nseindia is blocking all these AWS IP addresses. It is a known issue as indicated here and here for examples.

The solution is not to use AWS nor other popular could providers (nseindia also blocks others). You could try to proxy your AWS requests through some commercial VPN maybe, home/work network, or something that is not blacklisted. Sadly, this is try-and-see approach. But you have to also consider potential legal/ethical issues of bypassing these restrictions.

Tags:

Amazon Web Services

Python 3.X

Python Requests

Related

IntelliJ Idea mapstruct java: Internal error in the mapping processor: java.lang.NullPointerException What is the difference between "async with lock" and "with await lock"? Isn't there a nicer way to combine multiple `Union{T, Nothing}` Most efficient way of adding elements given the index list in numpy How does a backslash-newline combo affect the value of the C preprocessor's __LINE__ macro? How do I properly import python modules in a multi directory project? Why doesn't my forward_ function work for rvalues? Errors while initializing MongoDB with Nestjs/Angular What is the reason for seemingly inconsistent sizes of pointers and struct types? anthoscli ERROR on installing Google Cloud SDK on Apple Silicon / Big Sur PyCharm venv failed: 'no such option: --build-dir' Error Upgrading Blazor from 3.1 to 5.0 "does not have a property matching the name 'PreferExactMatches'"

Recent Posts