Python 處理數(shù)據(jù)的實(shí)例詳解
最近用python（3.2的版本）寫(xiě)了根據(jù)特定規(guī)則，處理數(shù)據(jù)的一個(gè)小程序，用到了一些python常用的基礎(chǔ)知識(shí)，在此總結(jié)一下：
1，python讀文件
2，python寫(xiě)文件
3，python的流程控制
4，python的for循環(huán)
5，python的集合，或字符串里判斷是否存在某個(gè)元素
6，python的邏輯或，邏輯與
7，python的正則過(guò)濾
8，python的字符串忽略空格，和以某個(gè)字符串開(kāi)頭和按某個(gè)字符拆分成list
python的打開(kāi)文件的模式：
關(guān)于open 模式：
w 以寫(xiě)方式打開(kāi)，
a 以追加模式打開(kāi) (從 EOF 開(kāi)始, 必要時(shí)創(chuàng)建新文件)
r+ 以讀寫(xiě)模式打開(kāi)
w+ 以讀寫(xiě)模式打開(kāi) (參見(jiàn) w )
a+ 以讀寫(xiě)模式打開(kāi) (參見(jiàn) a )
rb 以二進(jìn)制讀模式打開(kāi)
wb 以二進(jìn)制寫(xiě)模式打開(kāi) (參見(jiàn) w )
ab 以二進(jìn)制追加模式打開(kāi) (參見(jiàn) a )
rb+ 以二進(jìn)制讀寫(xiě)模式打開(kāi) (參見(jiàn) r+ )
wb+ 以二進(jìn)制讀寫(xiě)模式打開(kāi) (參見(jiàn) w+ )
ab+ 以二進(jìn)制讀寫(xiě)模式打開(kāi) (參見(jiàn) a+ )
處理代碼如下：
|
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
|
def showtxt(path,outpathname,detailpath): greenpath=r"C:\\Users\\qindongliang\\Desktop\\tnstxt\\green.txt"; redpath=r"C:\\Users\\qindongliang\\Desktop\\tnstxt\\red.txt"; redset=listtxt(redpath) greenset=listtxt(greenpath) print("紅色詞數(shù)量: ",len(redset)) print("綠色詞數(shù)量: ",len(greenset)) #符合1條件的內(nèi)容寫(xiě)入 f1=open(r"C:\Users\qindongliang\Desktop\tnstxt\result\\"+detailpath+"\\1.txt",encoding="UTF-8",mode="a+") #符合2條件的內(nèi)容寫(xiě)入 f2=open(r"C:\Users\qindongliang\Desktop\tnstxt\result\\"+detailpath+"\\2.txt",encoding="UTF-8",mode="a+") #符合3條件的內(nèi)容寫(xiě)入 f3=open(r"C:\Users\qindongliang\Desktop\tnstxt\result\\"+detailpath+"\\3.txt",encoding="UTF-8",mode="a+") #符合4條件的內(nèi)容寫(xiě)入 f4=open(r"C:\Users\qindongliang\Desktop\tnstxt\result\\"+detailpath+"\\4.txt",encoding="UTF-8",mode="a+") delcount=1; f=open(path,encoding="UTF-8",mode="r+") fnew=open(outpathname,encoding="UTF-8",mode="a+") flog=open(outpathname+".log",encoding="UTF-8",mode="a+") #count=1; for line in f: list=line.strip().split("\t") line=line.strip() catalogid=list[0] score=list[1] keyword=clear(list[4].strip()) if keyword in redset: if catalogid.startswith("018022") or catalogid.startswith("018035") or catalogid.startswith("014023003") : f1.write(line+"\n")#符合1條件寫(xiě)入 fnew.write(line+"\n")#符合1條件寫(xiě)入 else: flog.write(line+" 不符合條件1 "+"\n") delcount=delcount+1 if keyword in greenset: if not (catalogid.startswith("018022") or catalogid.startswith("018035") or catalogid.startswith("014023003")) : fnew.write(line+"\n") else: f2.write(line+"\n") flog.write(line+" 不符合條件2"+"\n") delcount=delcount+1 flist=formatStrList(keyword) if "sexy" in flist or "sex" in flist: if catalogid.startswith("018022") or catalogid.startswith("018035") or catalogid.startswith("014023003") : f3.write(line+"\n") fnew.write(line+"\n") else: flog.write(line+" 不符合條件3"+"\n") delcount=delcount+1 #if (keyword.find("underwear")!=-1) & keyword.find("sexy")==-1 & keyword.find("sex")==-1: if "underwear" in flist and "sexy" not in flist and "sex" not in flist: if catalogid.startswith("014032") : f4.write(line+"\n") fnew.write(line+"\n") else: flog.write(line+" 不符合條件4"+"\n") delcount=delcount+1 #print(list[0]," ",list[1]," ",list[4]) #print() flog.write("刪除總數(shù)目： "+str(delcount)) f.close() f1.close() f2.close() f3.close() f4.close() fnew.close() flog.close() import re def clear(str): str=re.sub("[\"\"\'\'+]","",str) return str def formatStrList(keyword): list=keyword.split(" ") for item in list: item.strip(); return list def listtxt(path): f=open(path,encoding="UTF-8") s=set() for line in f: s.add(line.strip()) f.close() return s path1=r"C:\\Users\\qindongliang\\Desktop\\tnstxt\\highfrequency.txt"pathout1=r"C:\\Users\\qindongliang\\Desktop\\tnstxt\\detail\\a_highfrequency.txt"detail1path="highfrequency"path2=r"C:\\Users\\qindongliang\\Desktop\\tnstxt\\highfrequency_d1.txt"pathout2=r"C:\\Users\\qindongliang\\Desktop\\tnstxt\\detail\\b_highfrequency_d1.txt"detail2path="highfrequency_d1" #showtxt(path1,pathout1,detail1path) showtxt(path2,pathout2,detail2path) |
以上就是對(duì)Python 的數(shù)據(jù)處理的實(shí)例詳解，如有疑問(wèn)請(qǐng)留言或者到本站社區(qū)交流討論，感謝閱讀，希望能幫助到大家，謝謝大家對(duì)本站的支持！
原文鏈接：http://qindongliang.iteye.com/blog/2162304
