ps做网站的效果图搜索引擎推广方式

数据：

 mysql select 'xx1','xx2' union select xx1,xx2 from xx into outfile '/atmd/aa/bb.csv' fields terminated by '\t'

总的数据量有2500w

1在导出时，指定limit或者where条件，将数据在导出时就分别放在不同的文件里

2直接导出一个大的文件里的情况：

 1使用spark分别读取再写文件，因为不需要做处理，这种方式有点大材小用

 2 在excel可以打开的情况下，可以使用excel自带的代码工具VB，按照某一列去分割为多个文件：

  https://www.microsoft.com/zh-cn/download/confirmation.aspx?id=13255

https://jingyan.baidu.com/article/64d05a0219ceacde55f73bf6.html

表sheet只有一个，名为“数据源”，选择查看代码---插入--模块---写入一下内容，再回到excel 表格窗口，执行 按钮...

 3 使用linux命令拆分 split命令按行或者按大小拆分为多个文件

下面为方法2excel的vb方法模块

Sub CFGZB()Dim myRange As VariantDim myArrayDim titleRange As RangeDim title As StringDim columnNum As IntegermyRange = Application.InputBox(prompt:="请选择标题行：", Type:=8)myArray = WorksheetFunction.Transpose(myRange)Set titleRange = Application.InputBox(prompt:="请选择拆分的表头，必须是第一行，且为一个单元格，如：“姓名”", Type:=8)title = titleRange.ValuecolumnNum = titleRange.ColumnApplication.ScreenUpdating = FalseApplication.DisplayAlerts = FalseDim i&, Myr&, Arr, num&Dim d, kFor i = Sheets.Count To 1 Step -1If Sheets(i).Name <> "数据源" ThenSheets(i).DeleteEnd IfNext iSet d = CreateObject("Scripting.Dictionary")Myr = Worksheets("数据源").UsedRange.Rows.CountArr = Worksheets("数据源").Range(Cells(2, columnNum), Cells(Myr, columnNum))For i = 1 To UBound(Arr)d(Arr(i, 1)) = ""Nextk = d.keysFor i = 0 To UBound(k) Set conn = CreateObject("adodb.connection")conn.Open "provider=Microsoft.ACE.OLEDB.12.0;extended properties=Excel 8.0;data source=" & ThisWorkbook.FullNameSql = "select * from [数据源$] where " & title & " = '" & k(i) & "'"Dim Nowbook As WorkbookSet Nowbook = Workbooks.AddWith NowbookWith .Sheets(1).Name = k(i)For num = 1 To UBound(myArray).Cells(1, num) = myArray(num, 1)Next num.Range("A2").CopyFromRecordset conn.Execute(Sql)End WithEnd WithThisWorkbook.ActivateSheets(1).Cells.SelectSelection.CopyWorkbooks(Nowbook.Name).ActivateActiveSheet.Cells.SelectSelection.PasteSpecial Paste:=xlPasteFormats, Operation:=xlNone,SkipBlanks:=False, Transpose:=FalseApplication.CutCopyMode = FalseNowbook.SaveAs ThisWorkbook.Path & "\" & k(i)Nowbook.Close TrueSet Nowbook = NothingNext iconn.CloseSet conn = NothingApplication.DisplayAlerts = TrueApplication.ScreenUpdating = TrueEnd Sub