Phoenix - Your AI AssistantPython Script
- Posted:
- Proposals: 8
- Remote
- #3786789
- Awarded
Dubai 
Description
Experience Level: Entry
Hey
I´ve this code to read a PYTHON API and store the data in a mysql, I need to optimize and be faster.
Can you help me to optimize the python script to be faster.?
cur = con.cursor(buffered=True)
t = Tranco(cache=True, cache_dir='.tranco')
latest_list = t.list()
print(latest_list.top(1000000))
for i in range(len(latest_list.top(1000000))):
mySql_insert_query = """INSERT INTO Domain (rank, Domain, date) VALUES (%s, %s, %s)"""
my = (i,latest_list.top(1000000)[i],datetime.datetime.today())
cur.execute(mySql_insert_query, my)
con.commit()
print("Data was was inserted.")
i+=1
I´ve this code to read a PYTHON API and store the data in a mysql, I need to optimize and be faster.
Can you help me to optimize the python script to be faster.?
cur = con.cursor(buffered=True)
t = Tranco(cache=True, cache_dir='.tranco')
latest_list = t.list()
print(latest_list.top(1000000))
for i in range(len(latest_list.top(1000000))):
mySql_insert_query = """INSERT INTO Domain (rank, Domain, date) VALUES (%s, %s, %s)"""
my = (i,latest_list.top(1000000)[i],datetime.datetime.today())
cur.execute(mySql_insert_query, my)
con.commit()
print("Data was was inserted.")
i+=1
New Proposal
Login to your account and send a proposal now to get this project.
Log inClarification Board Ask a Question
-
You can create a temp table and add the rows in one transaction. The SQL query takes very long because of commiting each single row.
-
Hi I have experience with these kind of pipelines.
What is your ODBC driver version? and how much the memory on the server where you are running this script?