Unable to import pandas on arm64

[HAK-CODE]

Describe the bug

Unable to import pandas as I import aws-data-wrangler lambda layer in one of my functions.

[ERROR] Runtime.ImportModuleError: Unable to import module 'handlers/import_data_es': Unable to import required dependencies:
numpy: 

IMPORTANT: PLEASE READ THIS FOR ADVICE ON HOW TO SOLVE THIS ISSUE!

Importing the numpy C-extensions failed. This error can happen for
many reasons, often due to issues with your setup or how NumPy was
installed.

We have compiled some common reasons and troubleshooting tips at:

    https://numpy.org/devdocs/user/troubleshooting-importerror.html

Please note and check the following:

  * The Python version is: Python3.9 from "/var/lang/bin/python3.9"
  * The NumPy version is: "1.21.4"

and make sure that they are the versions you expect.
Please carefully study the documentation linked above for further help.

Original error was: No module named 'numpy.core._multiarray_umath'
Traceback (most recent call last):

Environment
Python Version: 3.9
Lambda Arch: arm64

Package            Version  
------------------ ---------
asn1crypto         1.4.0    
awswrangler        2.13.0   
beautifulsoup4     4.10.0   
boto3              1.20.39  
botocore           1.23.39  
certifi            2021.10.8
charset-normalizer 2.0.10   
decorator          5.1.1    
et-xmlfile         1.1.0    
idna               3.3      
jmespath           0.10.0   
jsonpath-ng        1.5.3    
lxml               4.7.1    
numpy              1.22.1   
openpyxl           3.0.9    
opensearch-py      1.0.0    
packaging          21.3     
pandas             1.3.5    
pg8000             1.22.1   
pip                20.0.2   
pkg-resources      0.0.0    
ply                3.11     
progressbar2       3.55.0   
pyarrow            6.0.1    
PyMySQL            1.0.2    
pyparsing          3.0.6    
python-dateutil    2.8.2    
python-utils       3.1.0    
pytz               2021.3   
redshift-connector 2.0.903  
requests           2.27.1   
requests-aws4auth  1.1.1    
s3transfer         0.5.0    
scramp             1.4.1    
setuptools         44.0.0   
six                1.16.0   
soupsieve          2.3.1    
urllib3            1.26.8

To Reproduce

Steps to reproduce the behavior.

• Create a lambda function python with version 3.9 with arm64 arch.

• Add Aws Data Wrangler Layer

[jaidisido]

The underlying Docker image used to create the Wrangler Lambda layer is lambci/lambda. As far as I could find, only x86 architectures are supported in Lambda images at the moment.

[cnfait]

@HAK-CODE we've changed the underlying Docker image used to create the aws-data-wrangler lambda layer and updated our internal build project. We are now able to build layers dedicated to arm64 for Python 3.8 and 3.9. Hopefully these should be available in the next release of aws-data-wrangler!